2024-04-14T09:46:41.583 INFO:root:teuthology version: 0.0.1.dev265+gd7d6e60 2024-04-14T09:46:41.584 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} --owner scheduled_teuthology@teuthology --verbose --name teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/orig.config.yaml 2024-04-14T09:46:41.630 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T09:46:41.734 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} email: ceph-qa@ceph.com first_in_suite: false job_id: '7638509' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Reduced data availability - Degraded data redundancy sha1: d7e176b41636f150fe82aaedea82def3e9af0203 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d7e176b41636f150fe82aaedea82def3e9af0203 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9 owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1489 sha1: d7e176b41636f150fe82aaedea82def3e9af0203 sleep_before_teardown: 0 subset: 22/512 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi040.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzH7cJXkvjPgH0AvDFhJfPkIoJqQaDdZOD6OC0IFwm6yFotdZmjaUcPkUxG/fSqo05knPl+wIqZamAcCiQvA9g= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5zvmtuuyG6cFSTvPJHmGvLNanQPKwdkeociGSt0ivzkIViLM/cBKcnE3qgeEXabU8rDzxsUaIVPP9e4sqiSM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_acls teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: d7d6e60867cadf19fbfd7655a551ae7d58060757 timestamp: 2024-04-03_20:24:15 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-14T09:46:41.734 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa; will attempt to use it 2024-04-14T09:46:41.735 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks 2024-04-14T09:46:41.735 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-14T09:46:41.737 INFO:teuthology.task.internal:Checking packages... 2024-04-14T09:46:41.763 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd7e176b41636f150fe82aaedea82def3e9af0203' 2024-04-14T09:46:41.764 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-14T09:46:41.764 INFO:teuthology.packaging:ref: None 2024-04-14T09:46:41.764 INFO:teuthology.packaging:tag: None 2024-04-14T09:46:41.764 INFO:teuthology.packaging:branch: main 2024-04-14T09:46:41.764 INFO:teuthology.packaging:sha1: d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:46:41.764 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-04-14T09:46:41.980 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3080.gc2d8c315 2024-04-14T09:46:41.982 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-14T09:46:41.990 INFO:teuthology.task.internal:no buildpackages task found 2024-04-14T09:46:41.990 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-14T09:46:42.047 INFO:teuthology.task.internal:Saving configuration 2024-04-14T09:46:42.064 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-14T09:46:42.072 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T09:46:42.097 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:41:52.101174', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzH7cJXkvjPgH0AvDFhJfPkIoJqQaDdZOD6OC0IFwm6yFotdZmjaUcPkUxG/fSqo05knPl+wIqZamAcCiQvA9g='} 2024-04-14T09:46:42.120 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:41:52.099603', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5zvmtuuyG6cFSTvPJHmGvLNanQPKwdkeociGSt0ivzkIViLM/cBKcnE3qgeEXabU8rDzxsUaIVPP9e4sqiSM='} 2024-04-14T09:46:42.121 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-14T09:46:42.129 INFO:teuthology.task.internal:roles: ubuntu@smithi040.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-14T09:46:42.129 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-14T09:46:42.129 INFO:teuthology.run_tasks:Running task console_log... 2024-04-14T09:46:42.219 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7eca0c40d0>, signals=[15]) 2024-04-14T09:46:42.219 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-14T09:46:42.226 INFO:teuthology.task.internal:Opening connections... 2024-04-14T09:46:42.227 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:46:42.228 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:42.343 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:46:42.344 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:46:42.441 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-14T09:46:42.450 DEBUG:teuthology.orchestra.run.smithi040:> uname -m 2024-04-14T09:46:42.468 INFO:teuthology.orchestra.run.smithi040.stdout:x86_64 2024-04-14T09:46:42.468 DEBUG:teuthology.orchestra.run.smithi040:> cat /etc/os-release 2024-04-14T09:46:42.525 INFO:teuthology.orchestra.run.smithi040.stdout:NAME="CentOS Stream" 2024-04-14T09:46:42.525 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION="9" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:ID="centos" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:VERSION_ID="9" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:ANSI_COLOR="0;31" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:46:42.526 INFO:teuthology.orchestra.run.smithi040.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:46:42.527 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:46:42.527 INFO:teuthology.orchestra.run.smithi040.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:46:42.527 INFO:teuthology.lock.ops:Updating smithi040.front.sepia.ceph.com on lock server 2024-04-14T09:46:43.262 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-04-14T09:46:43.280 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-04-14T09:46:43.280 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-04-14T09:46:43.337 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-14T09:46:43.338 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-14T09:46:43.338 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-04-14T09:46:43.354 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-14T09:46:43.365 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-14T09:46:43.373 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-14T09:46:43.373 DEBUG:teuthology.orchestra.run.smithi040:> test '!' -e /home/ubuntu/cephtest 2024-04-14T09:46:43.376 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-04-14T09:46:43.394 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-14T09:46:43.402 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-14T09:46:43.402 DEBUG:teuthology.orchestra.run.smithi040:> test -z $(ls -A /var/lib/ceph) 2024-04-14T09:46:43.435 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-04-14T09:46:43.464 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-14T09:46:43.517 INFO:teuthology.run_tasks:Running task kernel... 2024-04-14T09:46:43.531 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-14T09:46:43.531 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-04-14T09:46:43.531 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-14T09:46:43.532 DEBUG:teuthology.orchestra.run.smithi040:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T09:46:43.532 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-14T09:46:43.549 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:46:43.550 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-14T09:46:43.550 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:46:43.551 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-04-14T09:46:43.606 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-361.el9.x86_64 2024-04-14T09:46:43.607 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-361.el9.x86_64 2024-04-14T09:46:43.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-04-14T09:46:43.609 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-361.el9.x86_64 2024-04-14T09:46:43.609 INFO:teuthology.task.kernel:Running kernel on smithi040: 5.14.0-361.el9.x86_64 2024-04-14T09:46:43.609 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y kernel 2024-04-14T09:46:46.000 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 11 MB/s | 8.1 MB 00:00 2024-04-14T09:46:46.070 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 10 MB/s | 8.1 MB 00:00 2024-04-14T09:46:47.658 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 8.1 MB/s | 2.5 MB 00:00 2024-04-14T09:46:47.770 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 7.7 MB/s | 2.5 MB 00:00 2024-04-14T09:46:48.677 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-04-14T09:46:48.716 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-14T09:46:50.595 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-14T09:46:52.333 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 7.8 MB/s | 19 MB 00:02 2024-04-14T09:46:57.600 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.2 MB 00:01 2024-04-14T09:46:58.428 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.2 MB 00:04 2024-04-14T09:46:59.209 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 16 kB 00:00 2024-04-14T09:47:00.004 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 16 kB 00:00 2024-04-14T09:47:01.346 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-04-14T09:47:01.381 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-04-14T09:47:06.527 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-14T09:47:06.681 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr:Modular dependency problems: 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 1: conflicting requests 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 2: conflicting requests 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 3: conflicting requests 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 4: conflicting requests 2024-04-14T09:47:08.781 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 5: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 6: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 7: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 8: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 9: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 10: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 11: conflicting requests 2024-04-14T09:47:08.782 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 12: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 13: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 14: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 15: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 16: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 17: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 18: conflicting requests 2024-04-14T09:47:08.783 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 19: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 20: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 21: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 22: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 23: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 24: conflicting requests 2024-04-14T09:47:08.784 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 25: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 26: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 27: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 28: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 29: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 30: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 31: conflicting requests 2024-04-14T09:47:08.785 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 32: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 33: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 34: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 35: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 36: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 37: conflicting requests 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.786 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 39: conflicting requests 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.787 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.788 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.789 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:47:08.790 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr:Modular dependency problems: 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 1: conflicting requests 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 2: conflicting requests 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 3: conflicting requests 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 4: conflicting requests 2024-04-14T09:47:09.043 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 5: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 6: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 7: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 8: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 9: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 10: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 11: conflicting requests 2024-04-14T09:47:09.044 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 12: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 13: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 14: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 15: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 16: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 17: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 18: conflicting requests 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.045 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 19: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 20: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 21: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 22: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 23: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 24: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 25: conflicting requests 2024-04-14T09:47:09.046 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 26: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 27: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 28: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 29: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 30: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 31: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 32: conflicting requests 2024-04-14T09:47:09.047 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 33: conflicting requests 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 34: conflicting requests 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 35: conflicting requests 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 36: conflicting requests 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 37: conflicting requests 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.048 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 39: conflicting requests 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.049 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.050 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.051 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.051 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:47:09.051 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.052 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:47:09.209 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T09:47:09.209 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T09:47:09.322 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:09.327 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 77 M 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 123 M 2024-04-14T09:47:09.328 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-04-14T09:47:09.488 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-14T09:47:09.488 INFO:teuthology.orchestra.run.smithi040.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-04-14T09:47:09.593 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout: Package Architecture Version Repository Size 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout: kernel x86_64 5.14.0-435.el9 baseos 214 k 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core x86_64 5.14.0-435.el9 baseos 15 M 2024-04-14T09:47:09.609 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules x86_64 5.14.0-435.el9 baseos 34 M 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core x86_64 5.14.0-435.el9 baseos 28 M 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout:================================================================================ 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout:Install 4 Packages 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:47:09.610 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 77 M 2024-04-14T09:47:09.611 INFO:teuthology.orchestra.run.smithi040.stdout:Installed size: 123 M 2024-04-14T09:47:09.611 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-14T09:47:09.919 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 1.3 MB/s | 214 kB 00:00 2024-04-14T09:47:10.236 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 31 MB/s | 15 MB 00:00 2024-04-14T09:47:10.449 INFO:teuthology.orchestra.run.smithi040.stdout:(1/4): kernel-5.14.0-435.el9.x86_64.rpm 321 kB/s | 214 kB 00:00 2024-04-14T09:47:10.595 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 41 MB/s | 28 MB 00:00 2024-04-14T09:47:10.904 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 29 MB/s | 34 MB 00:01 2024-04-14T09:47:10.904 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-04-14T09:47:10.904 INFO:teuthology.orchestra.run.smithi136.stdout:Total 49 MB/s | 77 MB 00:01 2024-04-14T09:47:11.573 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-04-14T09:47:11.958 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-04-14T09:47:11.958 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-04-14T09:47:13.014 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-04-14T09:47:13.014 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-04-14T09:47:15.149 INFO:teuthology.orchestra.run.smithi040.stdout:(2/4): kernel-core-5.14.0-435.el9.x86_64.rpm 2.8 MB/s | 15 MB 00:05 2024-04-14T09:47:15.477 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-04-14T09:47:16.076 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T09:47:16.165 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:47:17.548 INFO:teuthology.orchestra.run.smithi040.stdout:(3/4): kernel-modules-core-5.14.0-435.el9.x86_6 3.9 MB/s | 28 MB 00:07 2024-04-14T09:47:18.919 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:47:19.060 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:47:21.240 INFO:teuthology.orchestra.run.smithi040.stdout:(4/4): kernel-modules-5.14.0-435.el9.x86_64.rpm 2.9 MB/s | 34 MB 00:11 2024-04-14T09:47:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-14T09:47:21.241 INFO:teuthology.orchestra.run.smithi040.stdout:Total 6.6 MB/s | 77 MB 00:11 2024-04-14T09:47:21.946 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-14T09:47:22.360 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-14T09:47:22.361 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-14T09:47:23.402 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-14T09:47:23.402 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-14T09:47:23.769 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:47:23.886 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:25.992 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-14T09:47:26.615 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-core-5.14.0-435.el9.x86_64 1/4 2024-04-14T09:47:26.699 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:47:28.627 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:29.603 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:47:29.734 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:47:34.820 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:47:34.861 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:39.962 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:58.089 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:58.090 INFO:teuthology.orchestra.run.smithi136.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T09:47:58.090 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:58.134 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:58.501 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:58.502 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T09:47:58.502 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:47:58.502 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:47:58.935 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:47:58.935 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:58.935 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:58.936 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-04-14T09:47:59.288 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T09:47:59.382 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T09:47:59.382 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T09:47:59.383 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T09:47:59.383 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T09:47:59.383 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T09:47:59.383 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-14T09:47:59.383 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T09:47:59.383 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T09:47:59.465 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T09:47:59.466 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T09:47:59.466 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-04-14T09:47:59.505 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T09:47:59.506 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T09:47:59.507 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-04-14T09:47:59.507 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:47:59.507 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T09:47:59.508 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T09:47:59.508 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-435.el9.x86_64 2024-04-14T09:47:59.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T09:48:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-04-14T09:48:01.503 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T09:48:01.544 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-04-14T09:48:01.546 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-14T09:48:01.562 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.XaxSsKeKgu 2024-04-14T09:48:01.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XaxSsKeKgu 2024-04-14T09:48:01.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.XaxSsKeKgu 2024-04-14T09:48:01.770 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.XaxSsKeKgu is 6KB 2024-04-14T09:48:01.818 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.XaxSsKeKgu 2024-04-14T09:48:01.832 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T09:48:01.897 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T09:48:01.897 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T09:48:01.898 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T09:48:01.898 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T09:48:01.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T09:48:02.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-04-14T09:48:10.806 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:48:10.807 INFO:teuthology.orchestra.run.smithi040.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-14T09:48:10.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:48:10.854 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-modules-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:48:11.202 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: kernel-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:48:11.202 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-5.14.0-435.el9.x86_64 1/4 2024-04-14T09:48:11.202 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-core-5.14.0-435.el9.x86_64 2/4 2024-04-14T09:48:11.203 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-5.14.0-435.el9.x86_64 3/4 2024-04-14T09:48:11.607 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : kernel-modules-core-5.14.0-435.el9.x86_64 4/4 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-5.14.0-435.el9.x86_64 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-core-5.14.0-435.el9.x86_64 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-5.14.0-435.el9.x86_64 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: kernel-modules-core-5.14.0-435.el9.x86_64 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:48:11.608 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-14T09:48:11.946 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T09:48:12.052 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T09:48:12.052 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T09:48:12.053 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-435.el9.x86_64 2024-04-14T09:48:12.053 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-14T09:48:12.053 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-14T09:48:12.053 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-14T09:48:12.053 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi040.front.sepia.ceph.com, path=None, version=distro) 2024-04-14T09:48:12.053 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q kernel | sort -rV | head -n 1 2024-04-14T09:48:12.136 INFO:teuthology.orchestra.run.smithi040.stdout:kernel-5.14.0-435.el9.x86_64 2024-04-14T09:48:12.137 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-435.el9.x86_64 2024-04-14T09:48:12.137 DEBUG:teuthology.orchestra.run.smithi040:> sudo rpm -qi grub2-tools 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Name : grub2-tools 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Epoch : 1 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Version : 2.06 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Release : 68.el9 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Architecture: x86_64 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Group : Unspecified 2024-04-14T09:48:12.181 INFO:teuthology.orchestra.run.smithi040.stdout:Size : 8264254 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:License : GPLv3+ 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Packager : builder@centos.org 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Vendor : CentOS 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Summary : Support tools for GRUB. 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:Description : 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-14T09:48:12.182 INFO:teuthology.orchestra.run.smithi040.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-14T09:48:12.183 INFO:teuthology.orchestra.run.smithi040.stdout:hardware devices. 2024-04-14T09:48:12.183 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:48:12.183 INFO:teuthology.orchestra.run.smithi040.stdout:This subpackage provides tools for support of all platforms. 2024-04-14T09:48:12.183 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-14T09:48:12.183 INFO:teuthology.task.kernel:Updating grub on smithi040 to boot 5.14.0-435.el9.x86_64 2024-04-14T09:48:12.183 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-14T09:48:12.784 INFO:teuthology.orchestra.run.smithi040.stderr:Generating grub configuration file ... 2024-04-14T09:48:14.231 INFO:teuthology.orchestra.run.smithi040.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-14T09:48:14.266 INFO:teuthology.orchestra.run.smithi040.stderr:done 2024-04-14T09:48:14.268 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-04-14T09:48:14.283 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.7RIn37Esdd 2024-04-14T09:48:14.284 DEBUG:teuthology.orchestra.run.smithi040:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7RIn37Esdd 2024-04-14T09:48:14.355 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.7RIn37Esdd 2024-04-14T09:48:14.499 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.7RIn37Esdd is 6KB 2024-04-14T09:48:14.548 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.7RIn37Esdd 2024-04-14T09:48:14.563 DEBUG:teuthology.orchestra.run.smithi040:> sudo /bin/ls /boot/loader/entries || true 2024-04-14T09:48:14.631 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-14T09:48:14.631 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-14T09:48:14.631 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-14T09:48:14.631 INFO:teuthology.orchestra.run.smithi040.stdout:15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64.conf 2024-04-14T09:48:14.632 DEBUG:teuthology.orchestra.run.smithi040:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-435.el9.x86_64 2024-04-14T09:48:14.785 DEBUG:teuthology.orchestra.run.smithi040:> sudo shutdown -r now 2024-04-14T09:48:32.046 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-14T09:48:32.047 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:48:32.048 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:44.799 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-14T09:48:44.799 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:48:44.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:48:50.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-14T09:48:59.599 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:48:59.600 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:49:02.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-04-14T09:49:03.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.40 2024-04-14T09:49:12.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:49:12.144 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:49:14.657 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:49:14.658 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:49:46.693 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-14T09:49:47.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:49:47.059 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-435.el9.x86_64"... 2024-04-14T09:49:47.059 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-04-14T09:49:47.073 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-435.el9.x86_64 2024-04-14T09:49:47.073 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T09:49:47.073 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T09:49:47.074 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T09:49:48.074 DEBUG:teuthology.parallel:result is None 2024-04-14T09:50:12.147 DEBUG:teuthology.orchestra.remote:timed out 2024-04-14T09:50:24.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:50:24.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:50:24.445 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-14T09:50:24.806 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:50:24.806 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-435.el9.x86_64"... 2024-04-14T09:50:24.806 DEBUG:teuthology.orchestra.run.smithi040:> uname -r 2024-04-14T09:50:24.822 INFO:teuthology.orchestra.run.smithi040.stdout:5.14.0-435.el9.x86_64 2024-04-14T09:50:24.822 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-435.el9.x86_64 vs 5.14.0-435.el9.x86_64 2024-04-14T09:50:24.822 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-14T09:50:24.822 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-14T09:50:25.823 DEBUG:teuthology.parallel:result is None 2024-04-14T09:50:25.824 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-14T09:50:25.831 INFO:teuthology.task.internal:Creating test directory... 2024-04-14T09:50:25.832 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T09:50:25.834 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-14T09:50:25.852 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-14T09:50:25.901 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-14T09:50:25.948 INFO:teuthology.task.internal:Creating archive directory... 2024-04-14T09:50:25.948 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T09:50:25.951 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-14T09:50:26.032 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-14T09:50:26.039 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-14T09:50:26.039 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T09:50:26.042 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-14T09:50:26.141 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:50:26.145 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:50:26.170 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:50:26.195 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-14T09:50:26.196 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-14T09:50:26.204 INFO:teuthology.task.internal:Configuring sudo... 2024-04-14T09:50:26.204 DEBUG:teuthology.orchestra.run.smithi040:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T09:50:26.206 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-14T09:50:26.238 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-14T09:50:26.249 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-14T09:50:26.249 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T09:50:26.276 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-14T09:50:26.295 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:50:26.369 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:50:26.427 DEBUG:teuthology.orchestra.run.smithi040:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:50:26.505 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:50:26.551 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:50:26.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T09:50:26.618 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:50:26.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-14T09:50:26.718 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:50:26.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-14T09:50:26.846 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:50:26.846 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-14T09:50:26.916 DEBUG:teuthology.orchestra.run.smithi040:> sudo service rsyslog restart 2024-04-14T09:50:26.919 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-04-14T09:50:26.959 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T09:50:27.007 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T09:50:27.476 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-14T09:50:27.485 INFO:teuthology.task.internal:Starting timer... 2024-04-14T09:50:27.485 INFO:teuthology.run_tasks:Running task pcp... 2024-04-14T09:50:27.532 INFO:teuthology.run_tasks:Running task selinux... 2024-04-14T09:50:27.579 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-14T09:50:27.580 DEBUG:teuthology.orchestra.run.smithi040:> sudo service auditd rotate 2024-04-14T09:50:27.656 INFO:teuthology.orchestra.run.smithi040.stdout:Rotating logs: 2024-04-14T09:50:27.658 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-04-14T09:50:27.716 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-04-14T09:50:27.718 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-14T09:50:27.718 DEBUG:teuthology.orchestra.run.smithi040:> /usr/sbin/getenforce 2024-04-14T09:50:27.737 INFO:teuthology.orchestra.run.smithi040.stdout:Permissive 2024-04-14T09:50:27.738 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-04-14T09:50:27.757 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-04-14T09:50:27.758 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi040.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-04-14T09:50:27.758 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T09:50:27.805 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:50:27.806 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T09:50:27.834 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:50:27.834 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-14T09:50:27.834 DEBUG:teuthology.orchestra.run.smithi040:> sudo /usr/sbin/setenforce permissive 2024-04-14T09:50:27.887 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-04-14T09:50:27.926 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-14T09:50:27.935 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-14T09:50:27.953 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-14T09:50:27.954 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi040.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-14T09:55:08.849 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi040.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-04-14T09:55:08.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:55:08.852 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi040.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:55:08.947 DEBUG:teuthology.orchestra.run.smithi040:> true 2024-04-14T09:55:09.026 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi040.front.sepia.ceph.com' 2024-04-14T09:55:09.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:55:09.027 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-14T09:55:09.118 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-04-14T09:55:09.202 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-04-14T09:55:09.203 INFO:teuthology.run_tasks:Running task clock... 2024-04-14T09:55:09.214 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-14T09:55:09.214 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T09:55:09.214 DEBUG:teuthology.orchestra.run.smithi040:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T09:55:09.217 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-14T09:55:09.217 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T09:55:09.248 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T09:55:09.265 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T09:55:09.274 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-14T09:55:09.291 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-14T09:55:09.296 INFO:teuthology.orchestra.run.smithi040.stderr:sudo: ntpd: command not found 2024-04-14T09:55:09.309 INFO:teuthology.orchestra.run.smithi040.stdout:506 Cannot talk to daemon 2024-04-14T09:55:09.321 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-04-14T09:55:09.326 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T09:55:09.335 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-04-14T09:55:09.343 INFO:teuthology.orchestra.run.smithi040.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T09:55:09.351 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-14T09:55:09.371 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-14T09:55:09.392 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.396 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.423 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-04-14T09:55:09.426 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T09:55:09.426 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-04-14T09:55:09.427 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.427 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.427 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.427 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T09:55:09.428 INFO:teuthology.run_tasks:Running task install... 2024-04-14T09:55:09.437 DEBUG:teuthology.task.install:project ceph 2024-04-14T09:55:09.437 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}} 2024-04-14T09:55:09.437 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'} 2024-04-14T09:55:09.437 INFO:teuthology.task.install:Using flavor: default 2024-04-14T09:55:09.443 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-14T09:55:09.443 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-14T09:55:09.443 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'tag': None, 'wait_for_package': False} 2024-04-14T09:55:09.444 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:55:09.446 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'tag': None, 'wait_for_package': False} 2024-04-14T09:55:09.446 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:55:09.587 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/ 2024-04-14T09:55:09.587 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2592.gd7e176b4 2024-04-14T09:55:09.661 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/ 2024-04-14T09:55:09.661 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2592.gd7e176b4 2024-04-14T09:55:09.756 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T09:55:09.756 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:55:09.756 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T09:55:09.768 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/d7e176b41636f150fe82aaedea82def3e9af0203/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-14T09:55:09.768 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:55:09.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-14T09:55:09.784 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T09:55:09.784 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d7e176b41636f150fe82aaedea82def3e9af0203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T09:55:09.798 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-14T09:55:09.798 DEBUG:teuthology.orchestra.run.smithi040:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d7e176b41636f150fe82aaedea82def3e9af0203/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-14T09:55:09.852 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T09:55:09.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-14T09:55:09.939 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T09:55:09.956 DEBUG:teuthology.orchestra.run.smithi040:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-14T09:55:10.013 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-04-14T09:55:10.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-04-14T09:55:10.030 INFO:teuthology.orchestra.run.smithi040.stdout:check_obsoletes = 1 2024-04-14T09:55:10.032 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum clean all 2024-04-14T09:55:10.279 INFO:teuthology.orchestra.run.smithi136.stdout:74 files removed 2024-04-14T09:55:10.281 INFO:teuthology.orchestra.run.smithi040.stdout:74 files removed 2024-04-14T09:55:10.307 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T09:55:10.308 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-14T09:55:10.923 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 269 kB/s | 83 kB 00:00 2024-04-14T09:55:11.010 INFO:teuthology.orchestra.run.smithi040.stdout:ceph packages for x86_64 212 kB/s | 83 kB 00:00 2024-04-14T09:55:11.307 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 34 kB/s | 11 kB 00:00 2024-04-14T09:55:11.369 INFO:teuthology.orchestra.run.smithi040.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-04-14T09:55:11.744 INFO:teuthology.orchestra.run.smithi040.stdout:ceph source packages 5.7 kB/s | 1.9 kB 00:00 2024-04-14T09:55:11.749 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-04-14T09:55:12.201 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 20 MB/s | 8.1 MB 00:00 2024-04-14T09:55:12.221 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - AppStream 19 MB/s | 8.1 MB 00:00 2024-04-14T09:55:13.898 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS-9 - BaseOS 7.9 MB/s | 2.5 MB 00:00 2024-04-14T09:55:13.985 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.5 MB 00:00 2024-04-14T09:55:15.040 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-04-14T09:55:23.440 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 917 kB/s | 8.0 MB 00:08 2024-04-14T09:55:25.258 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-04-14T09:55:32.108 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.2 MB 00:03 2024-04-14T09:55:33.692 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 16 kB 00:00 2024-04-14T09:55:35.229 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-14T09:55:36.647 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - AppStream 945 kB/s | 19 MB 00:20 2024-04-14T09:55:40.418 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-14T09:55:43.002 INFO:teuthology.orchestra.run.smithi136.stderr:Modular dependency problems: 2024-04-14T09:55:43.002 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-04-14T09:55:43.002 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 1: conflicting requests 2024-04-14T09:55:43.002 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 2: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 3: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 4: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 5: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 6: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 7: conflicting requests 2024-04-14T09:55:43.003 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 8: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 9: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 10: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 11: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 12: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 13: conflicting requests 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.004 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 14: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 15: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 16: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 17: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 18: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 19: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 20: conflicting requests 2024-04-14T09:55:43.005 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 21: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 22: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 23: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 24: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 25: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 26: conflicting requests 2024-04-14T09:55:43.006 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 27: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 28: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 29: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 30: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 31: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 32: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 33: conflicting requests 2024-04-14T09:55:43.007 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 34: conflicting requests 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 35: conflicting requests 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 36: conflicting requests 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 37: conflicting requests 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.008 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 39: conflicting requests 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.009 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.010 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.011 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.012 INFO:teuthology.orchestra.run.smithi136.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:55:43.456 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T09:55:43.457 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T09:55:43.470 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T09:55:43.471 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T09:55:43.472 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T09:55:43.473 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T09:55:43.475 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T09:55:43.478 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T09:55:43.479 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T09:55:43.570 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-04-14T09:55:43.599 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================= 2024-04-14T09:55:43.599 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-04-14T09:55:43.599 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================= 2024-04-14T09:55:43.599 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 6.6 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.4 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 890 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 145 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 1.5 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 141 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 3.5 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 7.4 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 49 k 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 9.8 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 48 M 2024-04-14T09:55:43.600 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 264 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 762 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 225 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 27 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 18 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 32 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 746 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 127 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T09:55:43.601 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 162 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 321 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 298 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 99 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 85 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 171 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T09:55:43.602 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T09:55:43.603 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.4 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T09:55:43.604 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 21 M 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 34 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 2.4 M 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 249 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 4.7 M 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 17 M 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 16 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 25 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T09:55:43.605 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 163 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T09:55:43.606 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 501 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.1 M 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T09:55:43.607 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 45 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 134 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T09:55:43.608 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T09:55:43.609 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T09:55:43.610 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T09:55:43.611 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T09:55:43.612 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T09:55:43.613 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T09:55:43.613 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T09:55:43.613 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T09:55:43.613 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout:========================================================================================= 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout:Install 150 Packages 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 24 Packages 2024-04-14T09:55:43.614 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:55:43.615 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 228 M 2024-04-14T09:55:43.615 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-04-14T09:55:44.386 INFO:teuthology.orchestra.run.smithi136.stdout:(1/174): ceph-19.0.0-2592.gd7e176b4.el9.x86_64. 41 kB/s | 6.6 kB 00:00 2024-04-14T09:55:44.602 INFO:teuthology.orchestra.run.smithi136.stdout:(2/174): ceph-fuse-19.0.0-2592.gd7e176b4.el9.x8 4.0 MB/s | 890 kB 00:00 2024-04-14T09:55:44.661 INFO:teuthology.orchestra.run.smithi136.stdout:(3/174): ceph-immutable-object-cache-19.0.0-259 2.4 MB/s | 145 kB 00:00 2024-04-14T09:55:44.994 INFO:teuthology.orchestra.run.smithi136.stdout:(4/174): ceph-mds-19.0.0-2592.gd7e176b4.el9.x86 7.1 MB/s | 2.4 MB 00:00 2024-04-14T09:55:45.345 INFO:teuthology.orchestra.run.smithi136.stdout:(5/174): ceph-base-19.0.0-2592.gd7e176b4.el9.x8 4.8 MB/s | 5.4 MB 00:01 2024-04-14T09:55:45.428 INFO:teuthology.orchestra.run.smithi136.stdout:(6/174): ceph-mgr-19.0.0-2592.gd7e176b4.el9.x86 3.4 MB/s | 1.5 MB 00:00 2024-04-14T09:55:46.329 INFO:teuthology.orchestra.run.smithi136.stdout:(7/174): ceph-common-19.0.0-2592.gd7e176b4.el9. 9.8 MB/s | 21 MB 00:02 2024-04-14T09:55:46.395 INFO:teuthology.orchestra.run.smithi136.stdout:(8/174): ceph-mon-19.0.0-2592.gd7e176b4.el9.x86 4.5 MB/s | 4.7 MB 00:01 2024-04-14T09:55:46.471 INFO:teuthology.orchestra.run.smithi136.stdout:(9/174): ceph-selinux-19.0.0-2592.gd7e176b4.el9 336 kB/s | 25 kB 00:00 2024-04-14T09:55:47.221 INFO:teuthology.orchestra.run.smithi136.stdout:(10/174): ceph-radosgw-19.0.0-2592.gd7e176b4.el 11 MB/s | 9.8 MB 00:00 2024-04-14T09:55:47.279 INFO:teuthology.orchestra.run.smithi136.stdout:(11/174): cephfs-mirror-19.0.0-2592.gd7e176b4.e 3.8 MB/s | 225 kB 00:00 2024-04-14T09:55:47.338 INFO:teuthology.orchestra.run.smithi136.stdout:(12/174): cephfs-shell-19.0.0-2592.gd7e176b4.el 465 kB/s | 27 kB 00:00 2024-04-14T09:55:47.396 INFO:teuthology.orchestra.run.smithi136.stdout:(13/174): libcephfs-devel-19.0.0-2592.gd7e176b4 546 kB/s | 32 kB 00:00 2024-04-14T09:55:47.622 INFO:teuthology.orchestra.run.smithi136.stdout:(14/174): ceph-osd-19.0.0-2592.gd7e176b4.el9.x8 7.7 MB/s | 17 MB 00:02 2024-04-14T09:55:47.655 INFO:teuthology.orchestra.run.smithi136.stdout:(15/174): libcephfs2-19.0.0-2592.gd7e176b4.el9. 2.8 MB/s | 746 kB 00:00 2024-04-14T09:55:47.680 INFO:teuthology.orchestra.run.smithi136.stdout:(16/174): libcephsqlite-19.0.0-2592.gd7e176b4.e 2.7 MB/s | 163 kB 00:00 2024-04-14T09:55:47.697 INFO:teuthology.orchestra.run.smithi136.stdout:(17/174): librados-devel-19.0.0-2592.gd7e176b4. 3.0 MB/s | 127 kB 00:00 2024-04-14T09:55:47.764 INFO:teuthology.orchestra.run.smithi136.stdout:(18/174): libradosstriper1-19.0.0-2592.gd7e176b 5.9 MB/s | 501 kB 00:00 2024-04-14T09:55:47.814 INFO:teuthology.orchestra.run.smithi136.stdout:(19/174): python3-ceph-argparse-19.0.0-2592.gd7 906 kB/s | 45 kB 00:00 2024-04-14T09:55:47.898 INFO:teuthology.orchestra.run.smithi136.stdout:(20/174): python3-ceph-common-19.0.0-2592.gd7e1 1.6 MB/s | 134 kB 00:00 2024-04-14T09:55:47.949 INFO:teuthology.orchestra.run.smithi136.stdout:(21/174): python3-cephfs-19.0.0-2592.gd7e176b4. 3.2 MB/s | 162 kB 00:00 2024-04-14T09:55:48.016 INFO:teuthology.orchestra.run.smithi136.stdout:(22/174): python3-rados-19.0.0-2592.gd7e176b4.e 4.7 MB/s | 321 kB 00:00 2024-04-14T09:55:48.082 INFO:teuthology.orchestra.run.smithi136.stdout:(23/174): python3-rbd-19.0.0-2592.gd7e176b4.el9 4.4 MB/s | 298 kB 00:00 2024-04-14T09:55:48.089 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - CRB 817 kB/s | 6.2 MB 00:07 2024-04-14T09:55:48.158 INFO:teuthology.orchestra.run.smithi136.stdout:(24/174): librgw2-19.0.0-2592.gd7e176b4.el9.x86 11 MB/s | 5.1 MB 00:00 2024-04-14T09:55:48.183 INFO:teuthology.orchestra.run.smithi136.stdout:(25/174): python3-rgw-19.0.0-2592.gd7e176b4.el9 994 kB/s | 99 kB 00:00 2024-04-14T09:55:48.208 INFO:teuthology.orchestra.run.smithi136.stdout:(26/174): rbd-fuse-19.0.0-2592.gd7e176b4.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-14T09:55:48.259 INFO:teuthology.orchestra.run.smithi136.stdout:(27/174): rbd-nbd-19.0.0-2592.gd7e176b4.el9.x86 3.3 MB/s | 171 kB 00:00 2024-04-14T09:55:48.317 INFO:teuthology.orchestra.run.smithi136.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2592.g 586 kB/s | 34 kB 00:00 2024-04-14T09:55:48.384 INFO:teuthology.orchestra.run.smithi136.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2592.gd7e176b 2.1 MB/s | 141 kB 00:00 2024-04-14T09:55:48.576 INFO:teuthology.orchestra.run.smithi136.stdout:(30/174): rbd-mirror-19.0.0-2592.gd7e176b4.el9. 7.9 MB/s | 3.1 MB 00:00 2024-04-14T09:55:48.760 INFO:teuthology.orchestra.run.smithi136.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2592.gd7e17 9.4 MB/s | 3.5 MB 00:00 2024-04-14T09:55:48.818 INFO:teuthology.orchestra.run.smithi136.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2592.gd7 4.2 MB/s | 249 kB 00:00 2024-04-14T09:55:48.868 INFO:teuthology.orchestra.run.smithi136.stdout:(33/174): ceph-mgr-rook-19.0.0-2592.gd7e176b4.e 990 kB/s | 49 kB 00:00 2024-04-14T09:55:48.910 INFO:teuthology.orchestra.run.smithi136.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2592.gd 396 kB/s | 16 kB 00:00 2024-04-14T09:55:48.960 INFO:teuthology.orchestra.run.smithi136.stdout:(35/174): ceph-volume-19.0.0-2592.gd7e176b4.el9 5.2 MB/s | 264 kB 00:00 2024-04-14T09:55:49.069 INFO:teuthology.orchestra.run.smithi136.stdout:(36/174): cephadm-19.0.0-2592.gd7e176b4.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-14T09:55:49.128 INFO:teuthology.orchestra.run.smithi136.stdout:(37/174): cephfs-top-19.0.0-2592.gd7e176b4.el9. 314 kB/s | 18 kB 00:00 2024-04-14T09:55:49.370 INFO:teuthology.orchestra.run.smithi136.stdout:(38/174): ceph-mgr-diskprediction-local-19.0.0- 9.3 MB/s | 7.4 MB 00:00 2024-04-14T09:55:49.395 INFO:teuthology.orchestra.run.smithi136.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 66 kB/s | 18 kB 00:00 2024-04-14T09:55:49.595 INFO:teuthology.orchestra.run.smithi136.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 357 kB/s | 80 kB 00:00 2024-04-14T09:55:49.656 INFO:teuthology.orchestra.run.smithi040.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-04-14T09:55:49.662 INFO:teuthology.orchestra.run.smithi136.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 702 kB/s | 187 kB 00:00 2024-04-14T09:55:49.754 INFO:teuthology.orchestra.run.smithi136.stdout:(42/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 803 kB 00:00 2024-04-14T09:55:49.779 INFO:teuthology.orchestra.run.smithi136.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-04-14T09:55:49.838 INFO:teuthology.orchestra.run.smithi136.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-04-14T09:55:49.905 INFO:teuthology.orchestra.run.smithi136.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.0 MB/s | 253 kB 00:00 2024-04-14T09:55:49.972 INFO:teuthology.orchestra.run.smithi136.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-14T09:55:50.005 INFO:teuthology.orchestra.run.smithi136.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-04-14T09:55:50.039 INFO:teuthology.orchestra.run.smithi136.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-04-14T09:55:50.081 INFO:teuthology.orchestra.run.smithi136.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-04-14T09:55:50.106 INFO:teuthology.orchestra.run.smithi136.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-14T09:55:50.206 INFO:teuthology.orchestra.run.smithi136.stdout:(51/174): automake-1.16.2-8.el9.noarch.rpm 5.4 MB/s | 689 kB 00:00 2024-04-14T09:55:50.240 INFO:teuthology.orchestra.run.smithi136.stdout:(52/174): bison-3.7.4-5.el9.x86_64.rpm 6.9 MB/s | 943 kB 00:00 2024-04-14T09:55:50.290 INFO:teuthology.orchestra.run.smithi136.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 429 kB/s | 21 kB 00:00 2024-04-14T09:55:50.316 INFO:teuthology.orchestra.run.smithi136.stdout:(54/174): boost-program-options-1.75.0-8.el9.x8 983 kB/s | 107 kB 00:00 2024-04-14T09:55:50.366 INFO:teuthology.orchestra.run.smithi136.stdout:(55/174): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-04-14T09:55:50.391 INFO:teuthology.orchestra.run.smithi136.stdout:(56/174): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-04-14T09:55:50.441 INFO:teuthology.orchestra.run.smithi136.stdout:(57/174): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-04-14T09:55:50.508 INFO:teuthology.orchestra.run.smithi136.stdout:(58/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-04-14T09:55:50.584 INFO:teuthology.orchestra.run.smithi136.stdout:(59/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-04-14T09:55:50.609 INFO:teuthology.orchestra.run.smithi136.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-04-14T09:55:50.684 INFO:teuthology.orchestra.run.smithi136.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 662 kB 00:00 2024-04-14T09:55:50.734 INFO:teuthology.orchestra.run.smithi136.stdout:(62/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 511 kB/s | 25 kB 00:00 2024-04-14T09:55:50.760 INFO:teuthology.orchestra.run.smithi136.stdout:(63/174): libtool-2.4.6-45.el9.x86_64.rpm 3.8 MB/s | 582 kB 00:00 2024-04-14T09:55:50.810 INFO:teuthology.orchestra.run.smithi136.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-04-14T09:55:50.844 INFO:teuthology.orchestra.run.smithi136.stdout:(65/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-04-14T09:55:50.894 INFO:teuthology.orchestra.run.smithi136.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-14T09:55:50.911 INFO:teuthology.orchestra.run.smithi136.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 527 kB/s | 35 kB 00:00 2024-04-14T09:55:51.103 INFO:teuthology.orchestra.run.smithi136.stdout:(68/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 22 MB/s | 4.1 MB 00:00 2024-04-14T09:55:51.170 INFO:teuthology.orchestra.run.smithi136.stdout:(69/174): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-04-14T09:55:51.595 INFO:teuthology.orchestra.run.smithi136.stdout:(70/174): ceph-test-19.0.0-2592.gd7e176b4.el9.x 9.3 MB/s | 48 MB 00:05 2024-04-14T09:55:51.662 INFO:teuthology.orchestra.run.smithi136.stdout:(71/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-14T09:55:51.712 INFO:teuthology.orchestra.run.smithi136.stdout:(72/174): postgresql-contrib-13.14-1.el9.x86_64 1.6 MB/s | 911 kB 00:00 2024-04-14T09:55:51.745 INFO:teuthology.orchestra.run.smithi136.stdout:(73/174): postgresql-13.14-1.el9.x86_64.rpm 2.5 MB/s | 1.6 MB 00:00 2024-04-14T09:55:51.804 INFO:teuthology.orchestra.run.smithi136.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-14T09:55:51.854 INFO:teuthology.orchestra.run.smithi136.stdout:(75/174): protobuf-3.14.0-13.el9.x86_64.rpm 7.1 MB/s | 1.0 MB 00:00 2024-04-14T09:55:51.938 INFO:teuthology.orchestra.run.smithi136.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-04-14T09:55:52.030 INFO:teuthology.orchestra.run.smithi136.stdout:(77/174): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-04-14T09:55:52.080 INFO:teuthology.orchestra.run.smithi136.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 1.7 MB/s | 248 kB 00:00 2024-04-14T09:55:52.122 INFO:teuthology.orchestra.run.smithi136.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 279 kB/s | 26 kB 00:00 2024-04-14T09:55:52.164 INFO:teuthology.orchestra.run.smithi136.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 229 kB/s | 19 kB 00:00 2024-04-14T09:55:52.240 INFO:teuthology.orchestra.run.smithi136.stdout:(81/174): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 6.0 MB 00:00 2024-04-14T09:55:52.264 INFO:teuthology.orchestra.run.smithi136.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-04-14T09:55:52.290 INFO:teuthology.orchestra.run.smithi136.stdout:(83/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 172 kB 00:00 2024-04-14T09:55:52.357 INFO:teuthology.orchestra.run.smithi136.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.7 MB/s | 250 kB 00:00 2024-04-14T09:55:52.390 INFO:teuthology.orchestra.run.smithi136.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.2 MB/s | 222 kB 00:00 2024-04-14T09:55:52.457 INFO:teuthology.orchestra.run.smithi136.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 769 kB/s | 77 kB 00:00 2024-04-14T09:55:52.508 INFO:teuthology.orchestra.run.smithi136.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 361 kB/s | 42 kB 00:00 2024-04-14T09:55:52.527 INFO:teuthology.orchestra.run.smithi040.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 21 MB 00:02 2024-04-14T09:55:52.575 INFO:teuthology.orchestra.run.smithi136.stdout:(88/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-04-14T09:55:52.625 INFO:teuthology.orchestra.run.smithi136.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 1.6 MB/s | 269 kB 00:00 2024-04-14T09:55:52.658 INFO:teuthology.orchestra.run.smithi136.stdout:(90/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-04-14T09:55:52.683 INFO:teuthology.orchestra.run.smithi136.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-04-14T09:55:52.709 INFO:teuthology.orchestra.run.smithi136.stdout:(92/174): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-04-14T09:55:52.734 INFO:teuthology.orchestra.run.smithi136.stdout:(93/174): python3-requests-oauthlib-1.3.0-12.el 713 kB/s | 54 kB 00:00 2024-04-14T09:55:52.784 INFO:teuthology.orchestra.run.smithi136.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 554 kB/s | 42 kB 00:00 2024-04-14T09:55:52.810 INFO:teuthology.orchestra.run.smithi136.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 587 kB/s | 44 kB 00:00 2024-04-14T09:55:52.860 INFO:teuthology.orchestra.run.smithi136.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 724 kB/s | 36 kB 00:00 2024-04-14T09:55:52.885 INFO:teuthology.orchestra.run.smithi136.stdout:(97/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.1 MB/s | 221 kB 00:00 2024-04-14T09:55:52.935 INFO:teuthology.orchestra.run.smithi136.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-04-14T09:55:52.986 INFO:teuthology.orchestra.run.smithi136.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-04-14T09:55:53.011 INFO:teuthology.orchestra.run.smithi136.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-04-14T09:55:53.078 INFO:teuthology.orchestra.run.smithi136.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-04-14T09:55:53.103 INFO:teuthology.orchestra.run.smithi136.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 693 kB/s | 64 kB 00:00 2024-04-14T09:55:53.262 INFO:teuthology.orchestra.run.smithi136.stdout:(103/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-04-14T09:55:53.287 INFO:teuthology.orchestra.run.smithi136.stdout:(104/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 216 kB/s | 45 kB 00:00 2024-04-14T09:55:53.345 INFO:teuthology.orchestra.run.smithi136.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-04-14T09:55:53.471 INFO:teuthology.orchestra.run.smithi136.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-04-14T09:55:53.704 INFO:teuthology.orchestra.run.smithi136.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 83 kB/s | 19 kB 00:00 2024-04-14T09:55:53.771 INFO:teuthology.orchestra.run.smithi136.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 770 kB/s | 309 kB 00:00 2024-04-14T09:55:53.796 INFO:teuthology.orchestra.run.smithi136.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-14T09:55:53.846 INFO:teuthology.orchestra.run.smithi136.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-14T09:55:53.872 INFO:teuthology.orchestra.run.smithi136.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-04-14T09:55:53.930 INFO:teuthology.orchestra.run.smithi136.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 807 kB/s | 67 kB 00:00 2024-04-14T09:55:53.955 INFO:teuthology.orchestra.run.smithi136.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-04-14T09:55:54.081 INFO:teuthology.orchestra.run.smithi136.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-04-14T09:55:54.123 INFO:teuthology.orchestra.run.smithi136.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-04-14T09:55:54.148 INFO:teuthology.orchestra.run.smithi136.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 649 kB/s | 43 kB 00:00 2024-04-14T09:55:54.182 INFO:teuthology.orchestra.run.smithi136.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 550 kB/s | 32 kB 00:00 2024-04-14T09:55:54.240 INFO:teuthology.orchestra.run.smithi136.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-04-14T09:55:54.266 INFO:teuthology.orchestra.run.smithi136.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-04-14T09:55:54.291 INFO:teuthology.orchestra.run.smithi136.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-04-14T09:55:54.333 INFO:teuthology.orchestra.run.smithi136.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-04-14T09:55:54.358 INFO:teuthology.orchestra.run.smithi136.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-14T09:55:54.383 INFO:teuthology.orchestra.run.smithi136.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 383 kB/s | 35 kB 00:00 2024-04-14T09:55:54.417 INFO:teuthology.orchestra.run.smithi136.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-04-14T09:55:54.451 INFO:teuthology.orchestra.run.smithi136.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-14T09:55:54.501 INFO:teuthology.orchestra.run.smithi136.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-04-14T09:55:54.526 INFO:teuthology.orchestra.run.smithi136.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 98 kB/s | 11 kB 00:00 2024-04-14T09:55:54.551 INFO:teuthology.orchestra.run.smithi136.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 176 kB/s | 18 kB 00:00 2024-04-14T09:55:54.576 INFO:teuthology.orchestra.run.smithi136.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-14T09:55:54.602 INFO:teuthology.orchestra.run.smithi136.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 257 kB/s | 19 kB 00:00 2024-04-14T09:55:54.627 INFO:teuthology.orchestra.run.smithi136.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-14T09:55:54.669 INFO:teuthology.orchestra.run.smithi136.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 692 kB/s | 46 kB 00:00 2024-04-14T09:55:54.694 INFO:teuthology.orchestra.run.smithi136.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.1 MB/s | 79 kB 00:00 2024-04-14T09:55:54.728 INFO:teuthology.orchestra.run.smithi136.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-04-14T09:55:54.753 INFO:teuthology.orchestra.run.smithi136.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-04-14T09:55:54.778 INFO:teuthology.orchestra.run.smithi136.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-04-14T09:55:54.803 INFO:teuthology.orchestra.run.smithi136.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-04-14T09:55:54.820 INFO:teuthology.orchestra.run.smithi136.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-14T09:55:54.845 INFO:teuthology.orchestra.run.smithi136.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-04-14T09:55:54.871 INFO:teuthology.orchestra.run.smithi136.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 458 kB/s | 31 kB 00:00 2024-04-14T09:55:54.896 INFO:teuthology.orchestra.run.smithi136.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-14T09:55:54.921 INFO:teuthology.orchestra.run.smithi136.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-04-14T09:55:54.947 INFO:teuthology.orchestra.run.smithi136.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-04-14T09:55:54.972 INFO:teuthology.orchestra.run.smithi136.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-14T09:55:54.997 INFO:teuthology.orchestra.run.smithi136.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-14T09:55:55.023 INFO:teuthology.orchestra.run.smithi136.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-14T09:55:55.056 INFO:teuthology.orchestra.run.smithi136.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-14T09:55:55.081 INFO:teuthology.orchestra.run.smithi136.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 237 kB/s | 20 kB 00:00 2024-04-14T09:55:55.106 INFO:teuthology.orchestra.run.smithi136.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-14T09:55:55.207 INFO:teuthology.orchestra.run.smithi136.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-14T09:55:55.515 INFO:teuthology.orchestra.run.smithi136.stdout:(151/174): librados2-19.0.0-2592.gd7e176b4.el9. 7.8 MB/s | 3.4 MB 00:00 2024-04-14T09:55:55.566 INFO:teuthology.orchestra.run.smithi136.stdout:(152/174): NetworkManager-1.47.4-1.el9.x86_64.r 6.4 MB/s | 2.3 MB 00:00 2024-04-14T09:55:55.616 INFO:teuthology.orchestra.run.smithi136.stdout:(153/174): librbd1-19.0.0-2592.gd7e176b4.el9.x8 6.2 MB/s | 3.1 MB 00:00 2024-04-14T09:55:55.666 INFO:teuthology.orchestra.run.smithi136.stdout:(154/174): NetworkManager-libnm-1.47.4-1.el9.x8 12 MB/s | 1.8 MB 00:00 2024-04-14T09:55:55.733 INFO:teuthology.orchestra.run.smithi136.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-04-14T09:55:55.817 INFO:teuthology.orchestra.run.smithi136.stdout:(156/174): NetworkManager-team-1.47.4-1.el9.x86 167 kB/s | 42 kB 00:00 2024-04-14T09:55:55.842 INFO:teuthology.orchestra.run.smithi136.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 436 kB/s | 36 kB 00:00 2024-04-14T09:55:55.867 INFO:teuthology.orchestra.run.smithi136.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 405 kB/s | 71 kB 00:00 2024-04-14T09:55:55.892 INFO:teuthology.orchestra.run.smithi136.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2024-04-14T09:55:55.934 INFO:teuthology.orchestra.run.smithi136.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 345 kB/s | 23 kB 00:00 2024-04-14T09:55:55.968 INFO:teuthology.orchestra.run.smithi136.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.0 MB/s | 256 kB 00:00 2024-04-14T09:55:55.993 INFO:teuthology.orchestra.run.smithi136.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-04-14T09:55:56.018 INFO:teuthology.orchestra.run.smithi136.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-04-14T09:55:56.044 INFO:teuthology.orchestra.run.smithi136.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 136 kB 00:00 2024-04-14T09:55:56.144 INFO:teuthology.orchestra.run.smithi136.stdout:(165/174): libsmartcols-2.37.4-18.el9.x86_64.rp 425 kB/s | 64 kB 00:00 2024-04-14T09:55:56.169 INFO:teuthology.orchestra.run.smithi136.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 191 kB/s | 29 kB 00:00 2024-04-14T09:55:56.211 INFO:teuthology.orchestra.run.smithi136.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 7.2 MB/s | 1.2 MB 00:00 2024-04-14T09:55:56.303 INFO:teuthology.orchestra.run.smithi136.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 17 MB/s | 2.3 MB 00:00 2024-04-14T09:55:56.353 INFO:teuthology.orchestra.run.smithi136.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 10 MB/s | 2.2 MB 00:00 2024-04-14T09:55:56.404 INFO:teuthology.orchestra.run.smithi136.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.4 MB/s | 465 kB 00:00 2024-04-14T09:55:56.429 INFO:teuthology.orchestra.run.smithi136.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 248 kB/s | 31 kB 00:00 2024-04-14T09:55:56.454 INFO:teuthology.orchestra.run.smithi136.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-04-14T09:55:56.487 INFO:teuthology.orchestra.run.smithi136.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-04-14T09:55:56.512 INFO:teuthology.orchestra.run.smithi136.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 891 kB/s | 74 kB 00:00 2024-04-14T09:55:56.520 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-04-14T09:55:56.520 INFO:teuthology.orchestra.run.smithi136.stdout:Total 18 MB/s | 228 MB 00:12 2024-04-14T09:55:57.833 INFO:teuthology.orchestra.run.smithi040.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-04-14T09:55:57.900 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-04-14T09:55:58.183 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-04-14T09:55:58.183 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-04-14T09:56:00.332 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-04-14T09:56:00.332 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr:Modular dependency problems: 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 1: conflicting requests 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 2: conflicting requests 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 3: conflicting requests 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 4: conflicting requests 2024-04-14T09:56:00.539 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 5: conflicting requests 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 6: conflicting requests 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 7: conflicting requests 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 8: conflicting requests 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 9: conflicting requests 2024-04-14T09:56:00.540 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 10: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 11: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 12: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 13: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 14: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 15: conflicting requests 2024-04-14T09:56:00.541 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 16: conflicting requests 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 17: conflicting requests 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 18: conflicting requests 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 19: conflicting requests 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 20: conflicting requests 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.542 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 21: conflicting requests 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 22: conflicting requests 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 23: conflicting requests 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 24: conflicting requests 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 25: conflicting requests 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.543 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 26: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 27: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 28: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 29: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 30: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 31: conflicting requests 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.544 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 32: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 33: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 34: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 35: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 36: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 37: conflicting requests 2024-04-14T09:56:00.545 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 39: conflicting requests 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.546 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.547 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.548 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:56:00.549 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:56:01.005 INFO:teuthology.orchestra.run.smithi040.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T09:56:01.006 INFO:teuthology.orchestra.run.smithi040.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-14T09:56:01.020 INFO:teuthology.orchestra.run.smithi040.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-14T09:56:01.022 INFO:teuthology.orchestra.run.smithi040.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-14T09:56:01.022 INFO:teuthology.orchestra.run.smithi040.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-14T09:56:01.023 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-14T09:56:01.025 INFO:teuthology.orchestra.run.smithi040.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T09:56:01.028 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-14T09:56:01.029 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-14T09:56:01.132 INFO:teuthology.orchestra.run.smithi040.stdout:Dependencies resolved. 2024-04-14T09:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-04-14T09:56:01.154 INFO:teuthology.orchestra.run.smithi040.stdout: Package Arch Version Repository Size 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout:Installing: 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: ceph x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 6.6 k 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.4 M 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 890 k 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 145 k 2024-04-14T09:56:01.155 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 1.5 M 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 141 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 3.5 M 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 7.4 M 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 49 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 9.8 M 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 48 M 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 264 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 762 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 225 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 27 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 18 k 2024-04-14T09:56:01.156 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 32 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 746 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 127 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 162 k 2024-04-14T09:56:01.157 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 321 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 298 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 99 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 85 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 171 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrading: 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-14T09:56:01.158 INFO:teuthology.orchestra.run.smithi040.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: librados2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.4 M 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 3.1 M 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-14T09:56:01.159 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout:Installing dependencies: 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 21 M 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 34 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 2.4 M 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 249 k 2024-04-14T09:56:01.160 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 4.7 M 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 17 M 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2592.gd7e176b4.el9 ceph-noarch 16 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 25 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 163 k 2024-04-14T09:56:01.161 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 501 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2 x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 5.1 M 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-14T09:56:01.162 INFO:teuthology.orchestra.run.smithi040.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-14T09:56:01.163 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 45 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common x86_64 2:19.0.0-2592.gd7e176b4.el9 ceph 134 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-14T09:56:01.164 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-14T09:56:01.165 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-14T09:56:01.166 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-14T09:56:01.167 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-14T09:56:01.168 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:Installing weak dependencies: 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:01.169 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction Summary 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:========================================================================================= 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:Install 150 Packages 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:Upgrade 24 Packages 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:Total download size: 228 M 2024-04-14T09:56:01.170 INFO:teuthology.orchestra.run.smithi040.stdout:Downloading Packages: 2024-04-14T09:56:02.176 INFO:teuthology.orchestra.run.smithi040.stdout:(1/174): ceph-19.0.0-2592.gd7e176b4.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-04-14T09:56:02.351 INFO:teuthology.orchestra.run.smithi040.stdout:(2/174): ceph-fuse-19.0.0-2592.gd7e176b4.el9.x8 5.0 MB/s | 890 kB 00:00 2024-04-14T09:56:02.393 INFO:teuthology.orchestra.run.smithi040.stdout:(3/174): ceph-immutable-object-cache-19.0.0-259 3.4 MB/s | 145 kB 00:00 2024-04-14T09:56:02.660 INFO:teuthology.orchestra.run.smithi040.stdout:(4/174): ceph-mds-19.0.0-2592.gd7e176b4.el9.x86 8.8 MB/s | 2.4 MB 00:00 2024-04-14T09:56:02.861 INFO:teuthology.orchestra.run.smithi040.stdout:(5/174): ceph-mgr-19.0.0-2592.gd7e176b4.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-04-14T09:56:02.986 INFO:teuthology.orchestra.run.smithi040.stdout:(6/174): ceph-base-19.0.0-2592.gd7e176b4.el9.x8 5.5 MB/s | 5.4 MB 00:00 2024-04-14T09:56:03.411 INFO:teuthology.orchestra.run.smithi040.stdout:(7/174): ceph-mon-19.0.0-2592.gd7e176b4.el9.x86 8.5 MB/s | 4.7 MB 00:00 2024-04-14T09:56:04.519 INFO:teuthology.orchestra.run.smithi040.stdout:(8/174): ceph-osd-19.0.0-2592.gd7e176b4.el9.x86 11 MB/s | 17 MB 00:01 2024-04-14T09:56:04.570 INFO:teuthology.orchestra.run.smithi040.stdout:(9/174): ceph-selinux-19.0.0-2592.gd7e176b4.el9 505 kB/s | 25 kB 00:00 2024-04-14T09:56:04.804 INFO:teuthology.orchestra.run.smithi040.stdout:(10/174): ceph-common-19.0.0-2592.gd7e176b4.el9 7.4 MB/s | 21 MB 00:02 2024-04-14T09:56:04.920 INFO:teuthology.orchestra.run.smithi040.stdout:(11/174): ceph-radosgw-19.0.0-2592.gd7e176b4.el 6.5 MB/s | 9.8 MB 00:01 2024-04-14T09:56:04.946 INFO:teuthology.orchestra.run.smithi040.stdout:(12/174): cephfs-mirror-19.0.0-2592.gd7e176b4.e 1.6 MB/s | 225 kB 00:00 2024-04-14T09:56:04.979 INFO:teuthology.orchestra.run.smithi040.stdout:(13/174): cephfs-shell-19.0.0-2592.gd7e176b4.el 465 kB/s | 27 kB 00:00 2024-04-14T09:56:05.005 INFO:teuthology.orchestra.run.smithi040.stdout:(14/174): libcephfs-devel-19.0.0-2592.gd7e176b4 542 kB/s | 32 kB 00:00 2024-04-14T09:56:05.080 INFO:teuthology.orchestra.run.smithi040.stdout:(15/174): libcephsqlite-19.0.0-2592.gd7e176b4.e 2.1 MB/s | 163 kB 00:00 2024-04-14T09:56:05.105 INFO:teuthology.orchestra.run.smithi040.stdout:(16/174): libcephfs2-19.0.0-2592.gd7e176b4.el9. 5.8 MB/s | 746 kB 00:00 2024-04-14T09:56:05.155 INFO:teuthology.orchestra.run.smithi040.stdout:(17/174): librados-devel-19.0.0-2592.gd7e176b4. 1.6 MB/s | 127 kB 00:00 2024-04-14T09:56:05.422 INFO:teuthology.orchestra.run.smithi040.stdout:(18/174): libradosstriper1-19.0.0-2592.gd7e176b 1.5 MB/s | 501 kB 00:00 2024-04-14T09:56:05.480 INFO:teuthology.orchestra.run.smithi040.stdout:(19/174): python3-ceph-argparse-19.0.0-2592.gd7 776 kB/s | 45 kB 00:00 2024-04-14T09:56:05.531 INFO:teuthology.orchestra.run.smithi040.stdout:(20/174): python3-ceph-common-19.0.0-2592.gd7e1 2.6 MB/s | 134 kB 00:00 2024-04-14T09:56:05.589 INFO:teuthology.orchestra.run.smithi040.stdout:(21/174): python3-cephfs-19.0.0-2592.gd7e176b4. 2.7 MB/s | 162 kB 00:00 2024-04-14T09:56:05.648 INFO:teuthology.orchestra.run.smithi040.stdout:(22/174): python3-rados-19.0.0-2592.gd7e176b4.e 5.4 MB/s | 321 kB 00:00 2024-04-14T09:56:05.708 INFO:teuthology.orchestra.run.smithi040.stdout:(23/174): python3-rbd-19.0.0-2592.gd7e176b4.el9 5.0 MB/s | 298 kB 00:00 2024-04-14T09:56:05.766 INFO:teuthology.orchestra.run.smithi040.stdout:(24/174): python3-rgw-19.0.0-2592.gd7e176b4.el9 1.7 MB/s | 99 kB 00:00 2024-04-14T09:56:05.830 INFO:teuthology.orchestra.run.smithi040.stdout:(25/174): rbd-fuse-19.0.0-2592.gd7e176b4.el9.x8 1.4 MB/s | 85 kB 00:00 2024-04-14T09:56:05.975 INFO:teuthology.orchestra.run.smithi040.stdout:(26/174): librgw2-19.0.0-2592.gd7e176b4.el9.x86 6.3 MB/s | 5.1 MB 00:00 2024-04-14T09:56:06.075 INFO:teuthology.orchestra.run.smithi040.stdout:(27/174): rbd-nbd-19.0.0-2592.gd7e176b4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-04-14T09:56:06.167 INFO:teuthology.orchestra.run.smithi040.stdout:(28/174): rbd-mirror-19.0.0-2592.gd7e176b4.el9. 9.0 MB/s | 3.1 MB 00:00 2024-04-14T09:56:06.192 INFO:teuthology.orchestra.run.smithi040.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2592.g 290 kB/s | 34 kB 00:00 2024-04-14T09:56:06.234 INFO:teuthology.orchestra.run.smithi040.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2592.gd7e176b 2.1 MB/s | 141 kB 00:00 2024-04-14T09:56:06.809 INFO:teuthology.orchestra.run.smithi040.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2592.gd7e17 5.7 MB/s | 3.5 MB 00:00 2024-04-14T09:56:06.909 INFO:teuthology.orchestra.run.smithi040.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2592.gd7 2.4 MB/s | 249 kB 00:00 2024-04-14T09:56:07.002 INFO:teuthology.orchestra.run.smithi040.stdout:(33/174): ceph-mgr-rook-19.0.0-2592.gd7e176b4.e 537 kB/s | 49 kB 00:00 2024-04-14T09:56:07.102 INFO:teuthology.orchestra.run.smithi040.stdout:(34/174): ceph-mgr-diskprediction-local-19.0.0- 8.5 MB/s | 7.4 MB 00:00 2024-04-14T09:56:07.127 INFO:teuthology.orchestra.run.smithi040.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2592.gd 131 kB/s | 16 kB 00:00 2024-04-14T09:56:07.169 INFO:teuthology.orchestra.run.smithi040.stdout:(36/174): ceph-volume-19.0.0-2592.gd7e176b4.el9 3.9 MB/s | 264 kB 00:00 2024-04-14T09:56:07.219 INFO:teuthology.orchestra.run.smithi040.stdout:(37/174): cephfs-top-19.0.0-2592.gd7e176b4.el9. 364 kB/s | 18 kB 00:00 2024-04-14T09:56:07.269 INFO:teuthology.orchestra.run.smithi040.stdout:(38/174): cephadm-19.0.0-2592.gd7e176b4.el9.noa 5.2 MB/s | 762 kB 00:00 2024-04-14T09:56:07.378 INFO:teuthology.orchestra.run.smithi040.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 111 kB/s | 18 kB 00:00 2024-04-14T09:56:07.403 INFO:teuthology.orchestra.run.smithi040.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 743 kB/s | 80 kB 00:00 2024-04-14T09:56:07.520 INFO:teuthology.orchestra.run.smithi040.stdout:(41/174): libgfortran-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 803 kB 00:00 2024-04-14T09:56:07.562 INFO:teuthology.orchestra.run.smithi040.stdout:(42/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-04-14T09:56:07.586 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-04-14T09:56:07.587 INFO:teuthology.orchestra.run.smithi040.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2024-04-14T09:56:07.621 INFO:teuthology.orchestra.run.smithi040.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.6 MB/s | 218 kB 00:00 2024-04-14T09:56:07.647 INFO:teuthology.orchestra.run.smithi040.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-04-14T09:56:07.675 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T09:56:07.688 INFO:teuthology.orchestra.run.smithi040.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-04-14T09:56:07.709 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T09:56:07.722 INFO:teuthology.orchestra.run.smithi040.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.2 MB 00:00 2024-04-14T09:56:07.747 INFO:teuthology.orchestra.run.smithi040.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 2.3 MB/s | 135 kB 00:00 2024-04-14T09:56:07.748 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T09:56:07.757 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T09:56:07.764 INFO:teuthology.orchestra.run.smithi040.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-04-14T09:56:07.790 INFO:teuthology.orchestra.run.smithi040.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-04-14T09:56:07.805 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T09:56:07.868 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T09:56:07.916 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T09:56:07.942 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T09:56:07.992 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T09:56:08.265 INFO:teuthology.orchestra.run.smithi040.stdout:(51/174): ceph-test-19.0.0-2592.gd7e176b4.el9.x 13 MB/s | 48 MB 00:03 2024-04-14T09:56:08.314 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T09:56:08.377 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:56:08.499 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:56:08.524 INFO:teuthology.orchestra.run.smithi040.stdout:(52/174): boost-program-options-1.75.0-8.el9.x8 414 kB/s | 107 kB 00:00 2024-04-14T09:56:08.527 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:56:08.599 INFO:teuthology.orchestra.run.smithi040.stdout:(53/174): elfutils-libelf-devel-0.190-2.el9.x86 287 kB/s | 21 kB 00:00 2024-04-14T09:56:08.620 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:56:08.633 INFO:teuthology.orchestra.run.smithi040.stdout:(54/174): automake-1.16.2-8.el9.noarch.rpm 794 kB/s | 689 kB 00:00 2024-04-14T09:56:08.649 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T09:56:08.683 INFO:teuthology.orchestra.run.smithi040.stdout:(55/174): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-04-14T09:56:08.691 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T09:56:08.716 INFO:teuthology.orchestra.run.smithi040.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-04-14T09:56:08.742 INFO:teuthology.orchestra.run.smithi040.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 313 kB 00:00 2024-04-14T09:56:08.792 INFO:teuthology.orchestra.run.smithi040.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 241 kB/s | 18 kB 00:00 2024-04-14T09:56:08.818 INFO:teuthology.orchestra.run.smithi040.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-04-14T09:56:08.859 INFO:teuthology.orchestra.run.smithi040.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-04-14T09:56:08.883 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T09:56:08.939 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T09:56:08.951 INFO:teuthology.orchestra.run.smithi040.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-04-14T09:56:08.966 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:56:09.027 INFO:teuthology.orchestra.run.smithi040.stdout:(62/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 339 kB/s | 25 kB 00:00 2024-04-14T09:56:09.071 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:56:09.092 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T09:56:09.093 INFO:teuthology.orchestra.run.smithi040.stdout:(63/174): libtool-2.4.6-45.el9.x86_64.rpm 2.4 MB/s | 582 kB 00:00 2024-04-14T09:56:09.119 INFO:teuthology.orchestra.run.smithi040.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 517 kB/s | 47 kB 00:00 2024-04-14T09:56:09.157 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T09:56:09.197 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T09:56:09.202 INFO:teuthology.orchestra.run.smithi040.stdout:(65/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-04-14T09:56:09.218 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T09:56:09.227 INFO:teuthology.orchestra.run.smithi040.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-04-14T09:56:09.234 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T09:56:09.278 INFO:teuthology.orchestra.run.smithi040.stdout:(67/174): openblas-0.3.21-2.el9.x86_64.rpm 469 kB/s | 35 kB 00:00 2024-04-14T09:56:09.419 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T09:56:09.461 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T09:56:09.495 INFO:teuthology.orchestra.run.smithi040.stdout:(68/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.7 MB/s | 3.0 MB 00:00 2024-04-14T09:56:09.499 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T09:56:09.685 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T09:56:09.837 INFO:teuthology.orchestra.run.smithi040.stdout:(69/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 7.4 MB/s | 4.1 MB 00:00 2024-04-14T09:56:09.843 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T09:56:09.879 INFO:teuthology.orchestra.run.smithi040.stdout:(70/174): postgresql-13.14-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-04-14T09:56:09.898 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T09:56:09.971 INFO:teuthology.orchestra.run.smithi040.stdout:(71/174): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-04-14T09:56:09.994 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:10.015 INFO:teuthology.orchestra.run.smithi040.stdout:(72/174): postgresql-contrib-13.14-1.el9.x86_64 5.1 MB/s | 911 kB 00:00 2024-04-14T09:56:10.055 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:10.171 INFO:teuthology.orchestra.run.smithi040.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-04-14T09:56:10.252 INFO:teuthology.orchestra.run.smithi040.stdout:(74/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-04-14T09:56:10.261 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:10.314 INFO:teuthology.orchestra.run.smithi040.stdout:(75/174): openblas-openmp-0.3.21-2.el9.x86_64.r 4.4 MB/s | 4.7 MB 00:01 2024-04-14T09:56:10.368 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T09:56:10.380 INFO:teuthology.orchestra.run.smithi040.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-04-14T09:56:10.447 INFO:teuthology.orchestra.run.smithi040.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-04-14T09:56:10.462 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T09:56:10.494 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T09:56:10.523 INFO:teuthology.orchestra.run.smithi040.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 341 kB/s | 26 kB 00:00 2024-04-14T09:56:10.528 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T09:56:10.590 INFO:teuthology.orchestra.run.smithi040.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-04-14T09:56:10.592 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T09:56:10.628 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T09:56:10.665 INFO:teuthology.orchestra.run.smithi040.stdout:(80/174): postgresql-server-13.14-1.el9.x86_64. 8.3 MB/s | 5.8 MB 00:00 2024-04-14T09:56:10.679 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T09:56:10.690 INFO:teuthology.orchestra.run.smithi040.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-04-14T09:56:10.718 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T09:56:10.748 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T09:56:10.774 INFO:teuthology.orchestra.run.smithi040.stdout:(82/174): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-04-14T09:56:10.799 INFO:teuthology.orchestra.run.smithi040.stdout:(83/174): python3-markupsafe-1.1.1-12.el9.x86_6 259 kB/s | 35 kB 00:00 2024-04-14T09:56:10.815 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T09:56:10.841 INFO:teuthology.orchestra.run.smithi040.stdout:(84/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-04-14T09:56:10.858 INFO:teuthology.orchestra.run.smithi040.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-14T09:56:10.870 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T09:56:10.900 INFO:teuthology.orchestra.run.smithi040.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-14T09:56:10.925 INFO:teuthology.orchestra.run.smithi040.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 630 kB/s | 42 kB 00:00 2024-04-14T09:56:10.926 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T09:56:10.967 INFO:teuthology.orchestra.run.smithi040.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-14T09:56:10.969 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T09:56:10.992 INFO:teuthology.orchestra.run.smithi040.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 159 kB 00:00 2024-04-14T09:56:11.034 INFO:teuthology.orchestra.run.smithi040.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-14T09:56:11.044 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T09:56:11.060 INFO:teuthology.orchestra.run.smithi040.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-04-14T09:56:11.081 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 39/198 2024-04-14T09:56:11.101 INFO:teuthology.orchestra.run.smithi040.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 803 kB/s | 54 kB 00:00 2024-04-14T09:56:11.124 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 40/198 2024-04-14T09:56:11.152 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 41/198 2024-04-14T09:56:11.160 INFO:teuthology.orchestra.run.smithi040.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-04-14T09:56:11.219 INFO:teuthology.orchestra.run.smithi040.stdout:(94/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-04-14T09:56:11.229 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T09:56:11.275 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T09:56:11.294 INFO:teuthology.orchestra.run.smithi040.stdout:(95/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.4 MB/s | 5.1 MB 00:00 2024-04-14T09:56:11.319 INFO:teuthology.orchestra.run.smithi040.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-04-14T09:56:11.348 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T09:56:11.361 INFO:teuthology.orchestra.run.smithi040.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 536 kB/s | 36 kB 00:00 2024-04-14T09:56:11.387 INFO:teuthology.orchestra.run.smithi040.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-04-14T09:56:11.428 INFO:teuthology.orchestra.run.smithi040.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-04-14T09:56:11.445 INFO:teuthology.orchestra.run.smithi040.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-04-14T09:56:11.490 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T09:56:11.496 INFO:teuthology.orchestra.run.smithi040.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-04-14T09:56:11.513 INFO:teuthology.orchestra.run.smithi040.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-04-14T09:56:11.553 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T09:56:11.555 INFO:teuthology.orchestra.run.smithi040.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-04-14T09:56:11.905 INFO:teuthology.orchestra.run.smithi040.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 57 kB/s | 22 kB 00:00 2024-04-14T09:56:12.064 INFO:teuthology.orchestra.run.smithi040.stdout:(105/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-04-14T09:56:12.068 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T09:56:12.149 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T09:56:12.214 INFO:teuthology.orchestra.run.smithi040.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-04-14T09:56:12.238 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T09:56:12.277 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T09:56:12.287 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T09:56:12.318 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T09:56:12.358 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T09:56:12.396 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 53/198 2024-04-14T09:56:12.427 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T09:56:12.464 INFO:teuthology.orchestra.run.smithi040.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-04-14T09:56:12.498 INFO:teuthology.orchestra.run.smithi040.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 926 kB/s | 548 kB 00:00 2024-04-14T09:56:12.523 INFO:teuthology.orchestra.run.smithi040.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 673 kB/s | 309 kB 00:00 2024-04-14T09:56:12.590 INFO:teuthology.orchestra.run.smithi040.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 283 kB/s | 26 kB 00:00 2024-04-14T09:56:12.624 INFO:teuthology.orchestra.run.smithi040.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 484 kB/s | 49 kB 00:00 2024-04-14T09:56:12.683 INFO:teuthology.orchestra.run.smithi040.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 729 kB/s | 67 kB 00:00 2024-04-14T09:56:12.707 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T09:56:12.724 INFO:teuthology.orchestra.run.smithi040.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-04-14T09:56:12.850 INFO:teuthology.orchestra.run.smithi040.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-04-14T09:56:12.900 INFO:teuthology.orchestra.run.smithi040.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.1 MB/s | 548 kB 00:00 2024-04-14T09:56:12.930 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T09:56:12.942 INFO:teuthology.orchestra.run.smithi040.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-14T09:56:12.992 INFO:teuthology.orchestra.run.smithi040.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2024-04-14T09:56:13.034 INFO:teuthology.orchestra.run.smithi040.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 163 kB/s | 15 kB 00:00 2024-04-14T09:56:13.047 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T09:56:13.126 INFO:teuthology.orchestra.run.smithi040.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-04-14T09:56:13.151 INFO:teuthology.orchestra.run.smithi040.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-04-14T09:56:13.185 INFO:teuthology.orchestra.run.smithi040.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-04-14T09:56:13.227 INFO:teuthology.orchestra.run.smithi040.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-04-14T09:56:13.252 INFO:teuthology.orchestra.run.smithi040.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 351 kB/s | 35 kB 00:00 2024-04-14T09:56:13.277 INFO:teuthology.orchestra.run.smithi040.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.1 MB/s | 203 kB 00:00 2024-04-14T09:56:13.301 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T09:56:13.353 INFO:teuthology.orchestra.run.smithi040.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-14T09:56:13.378 INFO:teuthology.orchestra.run.smithi040.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-04-14T09:56:13.445 INFO:teuthology.orchestra.run.smithi040.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-04-14T09:56:13.470 INFO:teuthology.orchestra.run.smithi040.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-04-14T09:56:13.476 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T09:56:13.526 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T09:56:13.537 INFO:teuthology.orchestra.run.smithi040.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 211 kB/s | 19 kB 00:00 2024-04-14T09:56:13.562 INFO:teuthology.orchestra.run.smithi040.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 214 kB/s | 20 kB 00:00 2024-04-14T09:56:13.581 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T09:56:13.654 INFO:teuthology.orchestra.run.smithi040.stdout:(131/174): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-14T09:56:13.655 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T09:56:13.679 INFO:teuthology.orchestra.run.smithi040.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 396 kB/s | 46 kB 00:00 2024-04-14T09:56:13.693 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T09:56:13.730 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T09:56:13.746 INFO:teuthology.orchestra.run.smithi040.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 858 kB/s | 79 kB 00:00 2024-04-14T09:56:13.763 INFO:teuthology.orchestra.run.smithi040.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 689 kB/s | 58 kB 00:00 2024-04-14T09:56:13.777 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T09:56:13.813 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T09:56:13.847 INFO:teuthology.orchestra.run.smithi040.stdout:(135/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-04-14T09:56:13.856 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T09:56:13.864 INFO:teuthology.orchestra.run.smithi040.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-14T09:56:13.898 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T09:56:13.939 INFO:teuthology.orchestra.run.smithi040.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 979 kB/s | 90 kB 00:00 2024-04-14T09:56:13.956 INFO:teuthology.orchestra.run.smithi040.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-04-14T09:56:14.031 INFO:teuthology.orchestra.run.smithi040.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2024-04-14T09:56:14.039 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T09:56:14.056 INFO:teuthology.orchestra.run.smithi040.stdout:(140/174): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-04-14T09:56:14.087 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T09:56:14.118 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T09:56:14.132 INFO:teuthology.orchestra.run.smithi040.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2024-04-14T09:56:14.157 INFO:teuthology.orchestra.run.smithi040.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 355 kB/s | 36 kB 00:00 2024-04-14T09:56:14.159 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T09:56:14.225 INFO:teuthology.orchestra.run.smithi040.stdout:(143/174): python3-typing-extensions-4.4.0-2.el 555 kB/s | 51 kB 00:00 2024-04-14T09:56:14.250 INFO:teuthology.orchestra.run.smithi040.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-04-14T09:56:14.253 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T09:56:14.301 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T09:56:14.317 INFO:teuthology.orchestra.run.smithi040.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2024-04-14T09:56:14.341 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T09:56:14.359 INFO:teuthology.orchestra.run.smithi040.stdout:(146/174): python3-grpcio-1.46.7-10.el9.x86_64. 1.8 MB/s | 2.0 MB 00:01 2024-04-14T09:56:14.366 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T09:56:14.384 INFO:teuthology.orchestra.run.smithi040.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-04-14T09:56:14.391 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T09:56:14.409 INFO:teuthology.orchestra.run.smithi040.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-04-14T09:56:14.459 INFO:teuthology.orchestra.run.smithi040.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-04-14T09:56:14.470 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T09:56:14.568 INFO:teuthology.orchestra.run.smithi040.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-04-14T09:56:14.602 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T09:56:14.641 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T09:56:14.669 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T09:56:14.703 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T09:56:14.742 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T09:56:14.743 INFO:teuthology.orchestra.run.smithi040.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-04-14T09:56:14.774 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T09:56:14.794 INFO:teuthology.orchestra.run.smithi040.stdout:(152/174): librados2-19.0.0-2592.gd7e176b4.el9. 8.8 MB/s | 3.4 MB 00:00 2024-04-14T09:56:14.806 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T09:56:14.838 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T09:56:14.844 INFO:teuthology.orchestra.run.smithi040.stdout:(153/174): NetworkManager-libnm-1.47.4-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-04-14T09:56:14.869 INFO:teuthology.orchestra.run.smithi040.stdout:(154/174): NetworkManager-team-1.47.4-1.el9.x86 556 kB/s | 42 kB 00:00 2024-04-14T09:56:14.871 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T09:56:14.895 INFO:teuthology.orchestra.run.smithi040.stdout:(155/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.8 MB/s | 249 kB 00:00 2024-04-14T09:56:14.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T09:56:14.945 INFO:teuthology.orchestra.run.smithi040.stdout:(156/174): librbd1-19.0.0-2592.gd7e176b4.el9.x8 6.5 MB/s | 3.1 MB 00:00 2024-04-14T09:56:14.948 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T09:56:14.970 INFO:teuthology.orchestra.run.smithi040.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 709 kB/s | 71 kB 00:00 2024-04-14T09:56:14.987 INFO:teuthology.orchestra.run.smithi040.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 395 kB/s | 36 kB 00:00 2024-04-14T09:56:15.012 INFO:teuthology.orchestra.run.smithi040.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 6.0 MB/s | 256 kB 00:00 2024-04-14T09:56:15.029 INFO:teuthology.orchestra.run.smithi040.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 552 kB/s | 23 kB 00:00 2024-04-14T09:56:15.034 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T09:56:15.054 INFO:teuthology.orchestra.run.smithi040.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.5 MB/s | 108 kB 00:00 2024-04-14T09:56:15.081 INFO:teuthology.orchestra.run.smithi040.stdout:(162/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.4 MB/s | 192 kB 00:00 2024-04-14T09:56:15.105 INFO:teuthology.orchestra.run.smithi040.stdout:(163/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.0 MB/s | 155 kB 00:00 2024-04-14T09:56:15.130 INFO:teuthology.orchestra.run.smithi040.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-04-14T09:56:15.155 INFO:teuthology.orchestra.run.smithi040.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 136 kB 00:00 2024-04-14T09:56:15.181 INFO:teuthology.orchestra.run.smithi040.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 379 kB/s | 29 kB 00:00 2024-04-14T09:56:15.223 INFO:teuthology.orchestra.run.smithi040.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 13 MB/s | 1.2 MB 00:00 2024-04-14T09:56:15.265 INFO:teuthology.orchestra.run.smithi040.stdout:(168/174): util-linux-core-2.37.4-18.el9.x86_64 11 MB/s | 465 kB 00:00 2024-04-14T09:56:15.289 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T09:56:15.315 INFO:teuthology.orchestra.run.smithi040.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-04-14T09:56:15.349 INFO:teuthology.orchestra.run.smithi040.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 372 kB/s | 31 kB 00:00 2024-04-14T09:56:15.391 INFO:teuthology.orchestra.run.smithi040.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 11 MB/s | 2.3 MB 00:00 2024-04-14T09:56:15.416 INFO:teuthology.orchestra.run.smithi040.stdout:(172/174): xfsdump-3.1.12-4.el9.x86_64.rpm 3.1 MB/s | 323 kB 00:00 2024-04-14T09:56:15.450 INFO:teuthology.orchestra.run.smithi040.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-04-14T09:56:15.476 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T09:56:15.550 INFO:teuthology.orchestra.run.smithi040.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 468 kB/s | 74 kB 00:00 2024-04-14T09:56:15.552 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T09:56:15.553 INFO:teuthology.orchestra.run.smithi040.stdout:-------------------------------------------------------------------------------- 2024-04-14T09:56:15.553 INFO:teuthology.orchestra.run.smithi040.stdout:Total 16 MB/s | 228 MB 00:14 2024-04-14T09:56:15.654 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T09:56:15.711 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T09:56:16.450 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T09:56:16.491 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T09:56:16.525 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T09:56:16.634 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T09:56:16.692 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T09:56:16.780 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T09:56:16.819 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T09:56:16.922 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction check 2024-04-14T09:56:16.998 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T09:56:17.025 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T09:56:17.103 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T09:56:17.225 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction check succeeded. 2024-04-14T09:56:17.225 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction test 2024-04-14T09:56:17.754 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T09:56:17.880 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T09:56:19.121 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T09:56:19.244 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T09:56:19.271 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T09:56:19.456 INFO:teuthology.orchestra.run.smithi040.stdout:Transaction test succeeded. 2024-04-14T09:56:19.456 INFO:teuthology.orchestra.run.smithi040.stdout:Running transaction 2024-04-14T09:56:19.586 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T09:56:19.609 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T09:56:19.700 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T09:56:19.731 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 113/198 2024-04-14T09:56:19.768 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T09:56:20.233 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T09:56:20.262 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T09:56:20.342 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T09:56:20.365 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 117/198 2024-04-14T09:56:22.601 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:22.644 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:23.186 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:23.231 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T09:56:23.330 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T09:56:23.330 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T09:56:23.330 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T09:56:23.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:23.366 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T09:56:26.756 INFO:teuthology.orchestra.run.smithi040.stdout: Preparing : 1/1 2024-04-14T09:56:26.846 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-14T09:56:26.881 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-14T09:56:26.925 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T09:56:26.935 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-14T09:56:26.967 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-14T09:56:27.042 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-14T09:56:27.080 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-14T09:56:27.104 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-14T09:56:27.160 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-14T09:56:27.507 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-14T09:56:27.572 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:56:27.696 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:56:27.723 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:56:27.815 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:56:27.844 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T09:56:27.886 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-14T09:56:28.088 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-14T09:56:28.142 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-14T09:56:28.170 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:56:28.258 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:56:28.287 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T09:56:28.353 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 17/198 2024-04-14T09:56:28.392 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-14T09:56:28.414 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T09:56:28.430 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-14T09:56:28.876 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T09:56:28.906 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-14T09:56:28.945 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-14T09:56:29.139 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-14T09:56:29.272 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T09:56:29.333 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-14T09:56:29.431 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:29.492 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:29.707 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-14T09:56:29.818 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-14T09:56:29.912 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-14T09:56:29.956 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-14T09:56:29.991 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-14T09:56:30.066 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-14T09:56:30.107 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-14T09:56:30.150 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-14T09:56:30.183 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-14T09:56:30.210 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-14T09:56:30.282 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-14T09:56:30.342 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-14T09:56:30.372 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-14T09:56:30.416 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-14T09:56:30.493 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-14T09:56:30.526 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 39/198 2024-04-14T09:56:30.571 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 40/198 2024-04-14T09:56:30.615 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 41/198 2024-04-14T09:56:30.686 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-14T09:56:30.730 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-14T09:56:30.816 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-14T09:56:30.953 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-14T09:56:31.017 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-14T09:56:31.573 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-14T09:56:31.655 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-14T09:56:31.746 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-14T09:56:31.799 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T09:56:31.809 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-14T09:56:31.848 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-14T09:56:31.897 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-14T09:56:31.935 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 53/198 2024-04-14T09:56:31.965 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-14T09:56:32.270 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-14T09:56:32.474 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-14T09:56:32.567 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-14T09:56:32.613 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-14T09:56:32.975 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-14T09:56:33.031 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-14T09:56:33.088 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-14T09:56:33.161 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-14T09:56:33.198 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-14T09:56:33.235 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-14T09:56:33.283 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-14T09:56:33.318 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-14T09:56:33.361 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-14T09:56:33.404 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-14T09:56:33.544 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-14T09:56:33.592 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-14T09:56:33.622 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-14T09:56:33.665 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-14T09:56:33.761 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-14T09:56:33.796 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-14T09:56:33.837 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-14T09:56:33.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-14T09:56:33.887 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-14T09:56:33.980 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-14T09:56:34.109 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-14T09:56:34.153 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-14T09:56:34.198 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-14T09:56:34.240 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-14T09:56:34.279 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-14T09:56:34.311 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-14T09:56:34.341 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-14T09:56:34.375 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-14T09:56:34.408 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-14T09:56:34.450 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-14T09:56:34.484 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-14T09:56:34.574 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-14T09:56:34.624 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-14T09:56:34.655 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-14T09:56:34.702 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-14T09:56:34.803 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-14T09:56:34.858 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-04-14T09:56:34.900 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-04-14T09:56:34.901 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:35.072 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T09:56:35.087 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T09:56:35.087 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:35.087 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T09:56:35.087 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:35.621 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-14T09:56:35.670 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-14T09:56:35.703 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-14T09:56:35.806 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-14T09:56:35.862 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-14T09:56:35.953 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-14T09:56:35.997 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-14T09:56:36.183 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-14T09:56:36.211 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-14T09:56:36.297 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-14T09:56:36.566 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T09:56:36.591 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T09:56:36.592 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:36.592 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T09:56:36.592 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T09:56:36.592 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T09:56:36.592 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:36.817 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T09:56:36.840 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:36.975 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-14T09:56:37.089 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-14T09:56:37.284 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T09:56:37.307 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T09:56:37.308 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:37.308 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T09:56:37.308 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T09:56:37.308 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T09:56:37.308 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:37.423 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T09:56:37.481 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T09:56:37.536 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T09:56:37.724 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T09:56:37.777 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T09:56:37.856 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T09:56:37.944 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T09:56:38.086 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T09:56:38.135 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T09:56:38.169 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T09:56:38.200 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T09:56:38.237 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T09:56:38.263 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T09:56:38.387 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-14T09:56:38.467 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-14T09:56:38.494 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-14T09:56:38.645 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T09:56:38.662 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T09:56:38.694 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 139/198 2024-04-14T09:56:38.756 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 140/198 2024-04-14T09:56:38.785 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T09:56:38.822 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-14T09:56:38.857 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T09:56:38.948 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 112/198 2024-04-14T09:56:38.979 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 113/198 2024-04-14T09:56:39.015 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-14T09:56:39.501 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T09:56:39.535 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T09:56:39.590 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 116/198 2024-04-14T09:56:39.614 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 117/198 2024-04-14T09:56:39.825 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T09:56:39.862 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T09:56:40.830 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T09:56:40.863 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T09:56:40.964 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T09:56:41.134 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 144/198 2024-04-14T09:56:41.165 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T09:56:41.189 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T09:56:41.189 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:41.190 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T09:56:41.190 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T09:56:41.190 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T09:56:41.190 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:41.241 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T09:56:41.252 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T09:56:41.349 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 147/198 2024-04-14T09:56:41.989 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:42.033 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:42.603 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 118/198 2024-04-14T09:56:42.645 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T09:56:42.722 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 119/198 2024-04-14T09:56:42.722 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-14T09:56:42.723 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-14T09:56:42.723 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:42.754 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T09:56:45.785 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 148/198 2024-04-14T09:56:45.859 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 149/198 2024-04-14T09:56:46.750 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T09:56:46.781 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:56:46.804 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:56:46.804 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:46.804 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T09:56:46.804 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T09:56:46.804 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T09:56:46.805 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:46.848 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T09:56:46.871 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T09:56:46.871 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:46.871 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T09:56:46.871 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:46.916 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:56:46.938 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:56:46.938 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:46.938 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T09:56:46.939 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T09:56:46.939 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T09:56:46.939 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:47.241 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T09:56:47.264 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T09:56:47.264 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:47.264 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T09:56:47.265 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T09:56:47.265 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T09:56:47.265 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:47.316 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 155/198 2024-04-14T09:56:47.346 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 156/198 2024-04-14T09:56:47.376 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T09:56:47.578 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 158/198 2024-04-14T09:56:47.623 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T09:56:47.677 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T09:56:47.740 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T09:56:47.812 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T09:56:47.841 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 163/198 2024-04-14T09:56:47.882 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T09:56:47.911 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T09:56:47.978 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T09:56:48.060 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T09:56:48.094 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T09:56:48.696 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:56:48.742 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:56:48.762 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:56:49.576 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 170/198 2024-04-14T09:56:49.671 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T09:56:49.758 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T09:56:49.791 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T09:56:49.816 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T09:56:49.842 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T09:56:49.867 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T09:56:49.894 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T09:56:49.894 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T09:56:49.981 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T09:56:50.011 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T09:56:50.012 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T09:56:50.104 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T09:56:50.130 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T09:56:50.164 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T09:56:50.190 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T09:56:50.214 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T09:56:50.249 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T09:56:50.296 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T09:56:50.328 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T09:56:50.353 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T09:56:50.378 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T09:56:50.404 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T09:56:50.429 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T09:56:50.436 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:56:50.436 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:56:50.624 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:56:50.624 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T09:56:50.706 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T09:56:50.731 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T09:56:50.764 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T09:56:50.791 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T09:56:50.816 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T09:56:50.891 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T09:56:54.842 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 120/198 2024-04-14T09:56:54.842 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /sys 2024-04-14T09:56:54.842 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /proc 2024-04-14T09:56:54.842 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /mnt 2024-04-14T09:56:54.843 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /var/tmp 2024-04-14T09:56:54.843 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /home 2024-04-14T09:56:54.843 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /root 2024-04-14T09:56:54.843 INFO:teuthology.orchestra.run.smithi040.stdout:skipping the directory /tmp 2024-04-14T09:56:54.843 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:55.017 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T09:56:55.035 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 121/198 2024-04-14T09:56:55.035 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:55.035 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-14T09:56:55.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:56.553 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T09:56:56.553 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 1/198 2024-04-14T09:56:56.553 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2/198 2024-04-14T09:56:56.553 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 3/198 2024-04-14T09:56:56.553 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 4/198 2024-04-14T09:56:56.575 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 5/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 6/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 7/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 8/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 9/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 13/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 14/198 2024-04-14T09:56:56.577 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 15/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 17/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 18/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 19/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 20/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 21/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 22/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 23/198 2024-04-14T09:56:56.578 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 24/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 25/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 26/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 27/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 28/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 29/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 30/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 31/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 32/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 33/198 2024-04-14T09:56:56.579 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 34/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 35/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 36/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 37/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 38/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 39/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T09:56:56.580 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T09:56:56.581 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T09:56:56.582 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T09:56:56.583 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T09:56:56.584 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T09:56:56.585 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T09:56:56.586 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T09:56:56.587 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T09:56:56.588 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T09:56:56.589 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T09:56:56.590 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T09:56:56.591 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T09:56:56.592 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T09:56:56.593 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T09:56:56.594 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 122/198 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-14T09:56:56.595 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:56.837 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T09:56:56.859 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 123/198 2024-04-14T09:56:56.859 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:56.860 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-14T09:56:56.860 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T09:56:56.860 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-14T09:56:56.860 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:57.321 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T09:56:57.343 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 124/198 2024-04-14T09:56:57.343 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:56:57.343 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-14T09:56:57.343 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T09:56:57.344 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-14T09:56:57.344 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:56:57.452 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-14T09:56:57.510 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-14T09:56:57.575 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-14T09:56:57.775 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-14T09:56:57.826 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-14T09:56:57.904 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-14T09:56:57.992 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-14T09:56:58.143 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-14T09:56:58.196 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-14T09:56:58.230 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-14T09:56:58.261 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-14T09:56:58.297 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-14T09:56:58.324 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-14T09:56:58.751 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T09:56:58.781 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 138/198 2024-04-14T09:56:58.814 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 139/198 2024-04-14T09:56:58.877 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 140/198 2024-04-14T09:56:58.904 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T09:56:59.758 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T09:56:59.758 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:59.758 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.759 INFO:teuthology.orchestra.run.smithi136.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-04-14T09:56:59.760 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.761 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.762 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-16.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T09:56:59.763 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T09:56:59.764 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T09:56:59.765 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T09:56:59.766 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T09:56:59.767 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T09:56:59.768 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.769 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T09:56:59.770 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T09:56:59.771 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T09:56:59.772 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T09:56:59.772 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T09:56:59.772 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T09:56:59.772 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:56:59.772 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-04-14T09:57:00.002 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 141/198 2024-04-14T09:57:00.039 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T09:57:00.279 DEBUG:teuthology.parallel:result is None 2024-04-14T09:57:01.057 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 142/198 2024-04-14T09:57:01.081 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T09:57:01.189 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 143/198 2024-04-14T09:57:01.360 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 144/198 2024-04-14T09:57:01.392 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T09:57:01.415 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 145/198 2024-04-14T09:57:01.415 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:57:01.416 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-14T09:57:01.416 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T09:57:01.416 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-14T09:57:01.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:01.459 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T09:57:01.470 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 146/198 2024-04-14T09:57:01.572 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 147/198 2024-04-14T09:57:06.262 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 148/198 2024-04-14T09:57:06.328 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 149/198 2024-04-14T09:57:07.249 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-14T09:57:07.275 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-14T09:57:07.298 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:07.342 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T09:57:07.364 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 152/198 2024-04-14T09:57:07.364 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:57:07.364 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-14T09:57:07.364 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:07.409 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:57:07.431 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:57:07.431 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:57:07.432 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-14T09:57:07.432 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T09:57:07.432 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-14T09:57:07.432 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:07.752 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 154/198 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-14T09:57:07.774 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:07.827 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 155/198 2024-04-14T09:57:07.857 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 156/198 2024-04-14T09:57:07.884 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-14T09:57:08.087 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 158/198 2024-04-14T09:57:08.141 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-14T09:57:08.193 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-14T09:57:08.256 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-14T09:57:08.300 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-14T09:57:08.324 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 163/198 2024-04-14T09:57:08.356 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-14T09:57:08.386 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-14T09:57:08.444 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-14T09:57:08.516 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-14T09:57:08.551 INFO:teuthology.orchestra.run.smithi040.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-14T09:57:09.156 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:57:09.199 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:57:09.219 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-14T09:57:10.088 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 170/198 2024-04-14T09:57:10.179 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-14T09:57:10.288 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-14T09:57:10.322 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-14T09:57:10.348 INFO:teuthology.orchestra.run.smithi040.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-14T09:57:10.373 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-14T09:57:10.398 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-14T09:57:10.425 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-14T09:57:10.425 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T09:57:10.531 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-14T09:57:10.559 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-14T09:57:10.559 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T09:57:10.627 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-14T09:57:10.653 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-14T09:57:10.687 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-14T09:57:10.712 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-14T09:57:10.737 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-14T09:57:10.771 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-14T09:57:10.818 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-14T09:57:10.850 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-14T09:57:10.877 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-14T09:57:10.903 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-14T09:57:10.928 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-14T09:57:10.953 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-14T09:57:10.960 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:57:10.960 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:57:11.147 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-14T09:57:11.147 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T09:57:11.230 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-14T09:57:11.255 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-14T09:57:11.288 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-14T09:57:11.315 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-14T09:57:11.342 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-14T09:57:11.409 INFO:teuthology.orchestra.run.smithi040.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T09:57:16.944 INFO:teuthology.orchestra.run.smithi040.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 1/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 3/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 4/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2592.gd7e17 5/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 6/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 7/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 8/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 9/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 10/198 2024-04-14T09:57:16.945 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 11/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 12/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 13/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 14/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_ 15/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 16/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 17/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_6 18/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86 19/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 20/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el 21/198 2024-04-14T09:57:16.946 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9. 22/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_6 23/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 24/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 25/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 26/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 27/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 28/198 2024-04-14T09:57:16.947 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 29/198 2024-04-14T09:57:16.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4. 30/198 2024-04-14T09:57:16.963 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noa 31/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.n 32/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e 33/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el 34/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 35/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.e 36/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 37/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 38/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 39/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-14T09:57:16.964 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-14T09:57:16.965 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-14T09:57:16.966 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-14T09:57:16.967 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-14T09:57:16.968 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-14T09:57:16.969 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-14T09:57:16.970 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-14T09:57:16.971 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-14T09:57:16.972 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-14T09:57:16.973 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 151/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 153/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-14T09:57:16.974 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-14T09:57:16.975 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-14T09:57:16.976 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-14T09:57:16.977 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-14T09:57:20.116 INFO:teuthology.orchestra.run.smithi040.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-14T09:57:20.117 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:20.117 INFO:teuthology.orchestra.run.smithi040.stdout:Upgraded: 2024-04-14T09:57:20.117 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-14T09:57:20.117 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-14T09:57:20.117 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: acl-2.3.1-4.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-14T09:57:20.118 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: librados2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.119 INFO:teuthology.orchestra.run.smithi040.stdout: librbd1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout:Installed: 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: automake-1.16.2-8.el9.noarch 2024-04-14T09:57:20.120 INFO:teuthology.orchestra.run.smithi040.stdout: bison-3.7.4-5.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-base-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-grafana-dashboards-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-immutable-object-cache-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mds-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-dashboard-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.121 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-modules-core-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mgr-rook-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-mon-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-osd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-prometheus-alerts-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-radosgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-selinux-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-test-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: ceph-volume-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: cephadm-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-shell-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: cephfs-top-2:19.0.0-2592.gd7e176b4.el9.noarch 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-14T09:57:20.122 INFO:teuthology.orchestra.run.smithi040.stdout: flex-2.6.4-9.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: jq-1.6-16.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libcephfs2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libcephsqlite-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-14T09:57:20.123 INFO:teuthology.orchestra.run.smithi040.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: librados-devel-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libradosstriper1-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: librgw2-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: lua-5.4.4-4.el9.x86_64 2024-04-14T09:57:20.124 INFO:teuthology.orchestra.run.smithi040.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-13.14-1.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-14T09:57:20.125 INFO:teuthology.orchestra.run.smithi040.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-argparse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ceph-common-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cephfs-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-14T09:57:20.126 INFO:teuthology.orchestra.run.smithi040.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-14T09:57:20.127 INFO:teuthology.orchestra.run.smithi040.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-ply-3.11-14.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-14T09:57:20.128 INFO:teuthology.orchestra.run.smithi040.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rados-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rgw-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-14T09:57:20.129 INFO:teuthology.orchestra.run.smithi040.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-14T09:57:20.130 INFO:teuthology.orchestra.run.smithi040.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-fuse-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-mirror-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: rbd-nbd-2:19.0.0-2592.gd7e176b4.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: re2-1:20211101-3.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-14T09:57:20.131 INFO:teuthology.orchestra.run.smithi040.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-14T09:57:20.132 INFO:teuthology.orchestra.run.smithi040.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-14T09:57:20.132 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:20.132 INFO:teuthology.orchestra.run.smithi040.stdout:Complete! 2024-04-14T09:57:20.673 DEBUG:teuthology.parallel:result is None 2024-04-14T09:57:20.674 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:57:20.821 DEBUG:teuthology.orchestra.run.smithi040:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T09:57:20.843 INFO:teuthology.orchestra.run.smithi040.stdout:19.0.0-2592.gd7e176b4.el9 2024-04-14T09:57:20.843 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2592.gd7e176b4.el9 2024-04-14T09:57:20.844 INFO:teuthology.task.install:The correct ceph version 19.0.0-2592.gd7e176b4 is installed. 2024-04-14T09:57:20.845 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d7e176b41636f150fe82aaedea82def3e9af0203 2024-04-14T09:57:20.983 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-14T09:57:21.009 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-2592.gd7e176b4.el9 2024-04-14T09:57:21.009 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2592.gd7e176b4.el9 2024-04-14T09:57:21.009 INFO:teuthology.task.install:The correct ceph version 19.0.0-2592.gd7e176b4 is installed. 2024-04-14T09:57:21.011 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-14T09:57:21.011 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:21.011 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T09:57:21.042 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:21.042 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-14T09:57:21.083 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-14T09:57:21.083 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:21.083 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T09:57:21.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T09:57:21.180 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:21.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-04-14T09:57:21.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-14T09:57:21.279 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-14T09:57:21.279 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:21.279 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T09:57:21.307 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T09:57:21.375 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:21.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-14T09:57:21.403 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-14T09:57:21.470 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-14T09:57:21.470 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:21.470 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T09:57:21.497 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T09:57:21.564 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:21.564 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-04-14T09:57:21.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-14T09:57:21.660 INFO:teuthology.run_tasks:Running task ceph... 2024-04-14T09:57:21.741 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-14T09:57:21.742 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 777 /var/log/ceph 2024-04-14T09:57:21.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-04-14T09:57:21.771 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-14T09:57:21.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T09:57:21.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-14T09:57:21.839 INFO:tasks.ceph:Creating extra log directories... 2024-04-14T09:57:21.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T09:57:21.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-14T09:57:21.914 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-14T09:57:21.914 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-14T09:57:21.914 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-14T09:57:21.914 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:21.914 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T09:57:21.961 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:22.079 DEBUG:teuthology.orchestra.run.smithi040:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:22.105 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:22.105 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-14T09:57:22.120 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:22.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:22.272 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-14T09:57:22.272 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-14T09:57:22.273 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7638509', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1489, 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'sleep_before_teardown': 0, 'subset': '22/512', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi040.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzH7cJXkvjPgH0AvDFhJfPkIoJqQaDdZOD6OC0IFwm6yFotdZmjaUcPkUxG/fSqo05knPl+wIqZamAcCiQvA9g=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5zvmtuuyG6cFSTvPJHmGvLNanQPKwdkeociGSt0ivzkIViLM/cBKcnE3qgeEXabU8rDzxsUaIVPP9e4sqiSM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': 'd7e176b41636f150fe82aaedea82def3e9af0203', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_acls']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'd7d6e60867cadf19fbfd7655a551ae7d58060757', 'timestamp': '2024-04-03_20:24:15', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-14T09:57:22.273 DEBUG:teuthology.orchestra.run.smithi040:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T09:57:22.275 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-14T09:57:22.322 DEBUG:teuthology.orchestra.run.smithi040:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T09:57:22.330 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-04-14T09:57:22.389 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:22.389 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T09:57:22.409 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T09:57:22.409 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_1 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-14 09:57:11.771403178 +0000 2024-04-14T09:57:22.464 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-14 09:54:23.797695623 +0000 2024-04-14T09:57:22.465 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-14 09:54:23.797695623 +0000 2024-04-14T09:57:22.465 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-14 09:54:23.797695623 +0000 2024-04-14T09:57:22.465 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T09:57:22.529 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-14T09:57:22.529 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-14T09:57:22.529 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.00024077 s, 2.1 MB/s 2024-04-14T09:57:22.530 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T09:57:22.586 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_2 2024-04-14T09:57:22.640 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-14 09:57:11.771403178 +0000 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-14 09:54:24.162690942 +0000 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-14 09:54:24.162690942 +0000 2024-04-14T09:57:22.641 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-14 09:54:24.162690942 +0000 2024-04-14T09:57:22.642 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T09:57:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-14T09:57:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-14T09:57:22.705 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000182849 s, 2.8 MB/s 2024-04-14T09:57:22.706 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T09:57:22.761 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_3 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-14 09:57:11.772403164 +0000 2024-04-14T09:57:22.816 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-14 09:54:24.516686402 +0000 2024-04-14T09:57:22.817 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-14 09:54:24.516686402 +0000 2024-04-14T09:57:22.817 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-14 09:54:24.516686402 +0000 2024-04-14T09:57:22.817 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T09:57:22.881 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-14T09:57:22.881 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-14T09:57:22.881 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000167407 s, 3.1 MB/s 2024-04-14T09:57:22.882 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T09:57:22.938 DEBUG:teuthology.orchestra.run.smithi040:> stat /dev/vg_nvme/lv_4 2024-04-14T09:57:22.993 INFO:teuthology.orchestra.run.smithi040.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T09:57:22.993 INFO:teuthology.orchestra.run.smithi040.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:22.993 INFO:teuthology.orchestra.run.smithi040.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-04-14T09:57:22.993 INFO:teuthology.orchestra.run.smithi040.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:22.993 INFO:teuthology.orchestra.run.smithi040.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:22.994 INFO:teuthology.orchestra.run.smithi040.stdout:Access: 2024-04-14 09:57:11.772403164 +0000 2024-04-14T09:57:22.994 INFO:teuthology.orchestra.run.smithi040.stdout:Modify: 2024-04-14 09:54:24.869681875 +0000 2024-04-14T09:57:22.994 INFO:teuthology.orchestra.run.smithi040.stdout:Change: 2024-04-14 09:54:24.869681875 +0000 2024-04-14T09:57:22.994 INFO:teuthology.orchestra.run.smithi040.stdout: Birth: 2024-04-14 09:54:24.869681875 +0000 2024-04-14T09:57:22.994 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T09:57:23.059 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records in 2024-04-14T09:57:23.059 INFO:teuthology.orchestra.run.smithi040.stderr:1+0 records out 2024-04-14T09:57:23.059 INFO:teuthology.orchestra.run.smithi040.stderr:512 bytes copied, 0.000172283 s, 3.0 MB/s 2024-04-14T09:57:23.060 DEBUG:teuthology.orchestra.run.smithi040:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T09:57:23.115 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:23.116 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:23.116 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-04-14T09:57:23.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-14T09:57:23.132 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-04-14T09:57:23.188 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-14 09:56:51.236025081 +0000 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-14 09:54:20.659914493 +0000 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-14 09:54:20.659914493 +0000 2024-04-14T09:57:23.189 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-04-14 09:54:20.659914493 +0000 2024-04-14T09:57:23.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-14T09:57:23.255 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-14T09:57:23.256 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-14T09:57:23.256 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000213824 s, 2.4 MB/s 2024-04-14T09:57:23.257 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-14T09:57:23.313 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-04-14T09:57:23.368 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-14 09:56:51.236025081 +0000 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-14 09:54:20.995906724 +0000 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-14 09:54:20.995906724 +0000 2024-04-14T09:57:23.369 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-04-14 09:54:20.995906724 +0000 2024-04-14T09:57:23.369 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-14T09:57:23.434 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-14T09:57:23.435 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-14T09:57:23.435 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000180246 s, 2.8 MB/s 2024-04-14T09:57:23.436 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-14T09:57:23.491 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-14 09:56:51.237025058 +0000 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-14 09:54:21.330898977 +0000 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-14 09:54:21.330898977 +0000 2024-04-14T09:57:23.547 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-04-14 09:54:21.330898977 +0000 2024-04-14T09:57:23.547 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-14T09:57:23.613 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-14T09:57:23.613 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-14T09:57:23.613 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000188446 s, 2.7 MB/s 2024-04-14T09:57:23.614 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-14T09:57:23.669 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-04-14T09:57:23.724 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-14T09:57:23.724 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-14T09:57:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-14T09:57:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-14T09:57:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-04-14T09:57:23.725 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-04-14 09:56:51.237025058 +0000 2024-04-14T09:57:23.725 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-04-14 09:54:21.684890792 +0000 2024-04-14T09:57:23.725 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-04-14 09:54:21.684890792 +0000 2024-04-14T09:57:23.725 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-04-14 09:54:21.684890792 +0000 2024-04-14T09:57:23.725 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-14T09:57:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-04-14T09:57:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-04-14T09:57:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000203414 s, 2.5 MB/s 2024-04-14T09:57:23.791 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-14T09:57:23.847 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:23.847 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T09:57:23.847 INFO:tasks.ceph:Generating config... 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] debug client = 20 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] debug ms = 1 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] pid file = 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-14T09:57:23.849 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-14T09:57:23.849 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-14T09:57:23.849 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-14T09:57:23.850 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-14T09:57:23.851 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-14T09:57:23.852 INFO:tasks.ceph:Setting up mon.a... 2024-04-14T09:57:23.852 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-14T09:57:23.901 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.keyring 2024-04-14T09:57:23.904 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-14T09:57:23.949 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T09:57:23.976 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.40'), ('mon.b', '172.21.15.136'), ('mon.c', '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]')] 2024-04-14T09:57:23.976 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.40,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-14T09:57:23.977 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:23.977 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T09:57:24.034 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.40 --add b 172.21.15.136 --addv c '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: generated fsid 131eb2ba-6185-454c-b8ac-0bdd05152d4d 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:setting min_mon_release = quincy 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:epoch 0 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:fsid 131eb2ba-6185-454c-b8ac-0bdd05152d4d 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:last_changed 2024-04-14T09:57:24.120186+0000 2024-04-14T09:57:24.119 INFO:teuthology.orchestra.run.smithi040.stdout:created 2024-04-14T09:57:24.120186+0000 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:min_mon_release 17 (quincy) 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:election_strategy: 1 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:0: [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] mon.a 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:2: [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] mon.c 2024-04-14T09:57:24.120 INFO:teuthology.orchestra.run.smithi040.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-14T09:57:24.121 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-14T09:57:24.135 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 131eb2ba-6185-454c-b8ac-0bdd05152d4d... 2024-04-14T09:57:24.136 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T09:57:24.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-14T09:57:24.225 INFO:teuthology.orchestra.run.smithi040.stdout:[global] 2024-04-14T09:57:24.225 INFO:teuthology.orchestra.run.smithi040.stdout: chdir = "" 2024-04-14T09:57:24.225 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T09:57:24.225 INFO:teuthology.orchestra.run.smithi040.stdout: auth supported = cephx 2024-04-14T09:57:24.225 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: filestore xattr use omap = true 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: mon clock drift allowed = 1.000 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: osd crush chooseleaf type = 0 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: auth debug = true 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on old message = true 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on bug = true 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: mon pg warn max object skew = 0 2024-04-14T09:57:24.226 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default size = 2 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow primary affinity = true 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd allow pg remap = true 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on legacy crush tunables = false 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on crush straw calc version zero = false 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on no sortbitwise = false 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on osd down out interval zero = false 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon warn on too few osds = false 2024-04-14T09:57:24.227 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon_allow_pool_size_one = true 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: osd default data pool replay window = 5 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon allow pool delete = true 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon cluster log file level = debug 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: debug asserts on shutdown = true 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon health detail to clog = false 2024-04-14T09:57:24.228 INFO:teuthology.orchestra.run.smithi040.stdout: mon host = "172.21.15.40,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: ms die on skipped message = False 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: fsid = 131eb2ba-6185-454c-b8ac-0bdd05152d4d 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout:[osd] 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: osd journal size = 100 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub load threshold = 5.0 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: osd scrub max interval = 600 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: osd mclock profile = high_recovery_ops 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.229 INFO:teuthology.orchestra.run.smithi040.stdout: osd recover clone overlap = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd recovery max chunk = 1048576 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug shutdown = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug op order = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug verify stray on activate = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug trim objects = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd open classes on start = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug pg log writeout = true 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: osd deep scrub update digest min age = 30 2024-04-14T09:57:24.230 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: osd map max advance = 10 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: journal zero on create = true 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: filestore ondisk finisher threads = 3 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: filestore apply finisher threads = 3 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: bdev debug aio = true 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: osd debug misdirected ops = true 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore block size = 96636764160 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: bluestore fsck on mount = True 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluefs = 20 2024-04-14T09:57:24.231 INFO:teuthology.orchestra.run.smithi040.stdout: debug bluestore = 20 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug osd = 20 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug rocksdb = 10 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd full ratio = 0.9 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd nearfull ratio = 0.8 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: osd failsafe full ratio = 0.95 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: osd objectstore = bluestore 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr] 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug mgr = 20 2024-04-14T09:57:24.232 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mgr/telemetry/nag = false 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout:[mon] 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug mon = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug paxos = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: debug auth = 20 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mon data avail warn = 5 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mon mgr mkfs grace = 240 2024-04-14T09:57:24.233 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min pgs per osd = 4 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd reporter subtree level = osd 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon osd prime pg temp = true 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon reweight min bytes per osd = 10 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: # 1m isn't quite enough 2024-04-14T09:57:24.234 INFO:teuthology.orchestra.run.smithi040.stdout: mon_down_mkfs_grace = 2m 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: mon_warn_on_filestore_osds = false 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: mon down mkfs grace = 300 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: mon op complaint time = 120 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout:[client] 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: rgw cache enabled = true 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable ops log = true 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: rgw enable usage log = true 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: client mount timeout = 600 2024-04-14T09:57:24.235 INFO:teuthology.orchestra.run.smithi040.stdout: debug client = 20 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout: pid file = "" 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.a] 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.b] 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout:[mon.c] 2024-04-14T09:57:24.236 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-04-14T09:57:24.237 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-04-14T09:57:24.237 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-04-14T09:57:24.237 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-04-14T09:57:24.237 INFO:teuthology.orchestra.run.smithi040.stdout:[mds] 2024-04-14T09:57:24.237 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds = 20 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: debug mds balancer = 20 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: debug ms = 1 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug frag = True 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: mds debug scatterstat = True 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: mds op complaint time = 180 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: mds verify scatter = True 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: osd op complaint time = 180 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: rados mon op timeout = 900 2024-04-14T09:57:24.238 INFO:teuthology.orchestra.run.smithi040.stdout: rados osd op timeout = 900 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-04-14T09:57:24.239 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.240 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.241 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.40,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = 131eb2ba-6185-454c-b8ac-0bdd05152d4d 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-04-14T09:57:24.242 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-04-14T09:57:24.243 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-04-14T09:57:24.244 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 20 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 20 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 10 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.245 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-04-14T09:57:24.246 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.247 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon down mkfs grace = 300 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-04-14T09:57:24.248 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-04-14T09:57:24.249 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-04-14T09:57:24.250 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-04-14T09:57:24.252 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-14T09:57:24.252 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-14T09:57:24.347 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-14T09:57:24.347 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:24.347 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-14T09:57:24.361 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:24.361 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-14T09:57:24.416 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:57:24.416 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:24.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T09:57:24.416 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T09:57:24.494 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:24.494 DEBUG:teuthology.orchestra.run.smithi040:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:24.549 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:57:24.549 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:24.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-14T09:57:24.549 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-14T09:57:24.589 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:24.589 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:24.644 INFO:tasks.ceph:Setting up mon nodes... 2024-04-14T09:57:24.644 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-14T09:57:24.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T09:57:24.698 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-14T09:57:24.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T09:57:24.765 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-14T09:57:24.767 INFO:tasks.ceph:Setting up mds nodes... 2024-04-14T09:57:24.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T09:57:24.822 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-14T09:57:24.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-14T09:57:24.851 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T09:57:24.945 INFO:teuthology.orchestra.run.smithi040.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-14T09:57:24.948 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-14T09:57:24.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T09:57:25.029 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-14T09:57:25.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-14T09:57:25.058 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T09:57:25.152 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-14T09:57:25.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-14T09:57:25.181 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-14T09:57:25.182 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-14T09:57:25.224 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-14T09:57:25.239 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-14T09:57:25.320 INFO:teuthology.orchestra.run.smithi040.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-14T09:57:25.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-14T09:57:25.378 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-14T09:57:25.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-14T09:57:25.476 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-14T09:57:25.491 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-14T09:57:25.491 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi040.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-14T09:57:25.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-14T09:57:25.518 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:25.519 INFO:tasks.ceph:role: osd.0 2024-04-14T09:57:25.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:57:25.519 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:25.593 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:25.594 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:25.594 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:25.594 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:26.104 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-14T09:57:26.106 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-14T09:57:26.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-14T09:57:26.226 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-14T09:57:26.261 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-14T09:57:26.329 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:26.330 INFO:tasks.ceph:role: osd.1 2024-04-14T09:57:26.330 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:57:26.330 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T09:57:26.404 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:26.404 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:26.404 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:26.404 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:26.405 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:26.863 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-14T09:57:26.865 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-14T09:57:26.865 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-14T09:57:26.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-14T09:57:26.990 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-14T09:57:27.057 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:27.057 INFO:tasks.ceph:role: osd.2 2024-04-14T09:57:27.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:57:27.057 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T09:57:27.131 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:27.131 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:27.131 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:27.131 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:27.131 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:27.132 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:27.132 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:27.132 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:27.132 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:27.132 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:27.617 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-14T09:57:27.619 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-14T09:57:27.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-14T09:57:27.749 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-14T09:57:27.779 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-14T09:57:27.846 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:27.846 INFO:tasks.ceph:role: osd.3 2024-04-14T09:57:27.846 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:57:27.846 DEBUG:teuthology.orchestra.run.smithi040:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T09:57:27.920 INFO:teuthology.orchestra.run.smithi040.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:27.920 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:27.921 INFO:teuthology.orchestra.run.smithi040.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:28.448 INFO:teuthology.orchestra.run.smithi040.stdout:Discarding blocks...Done. 2024-04-14T09:57:28.450 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi040.front.sepia.ceph.com -o noatime 2024-04-14T09:57:28.450 DEBUG:teuthology.orchestra.run.smithi040:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-14T09:57:28.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-14T09:57:28.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.703+0000 7fab72268640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.704+0000 7fab72268640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.704+0000 7fab72268640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.704+0000 7fab72268640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.704+0000 7fab72268640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-14T09:57:28.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:28.704+0000 7fab72268640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-14T09:57:31.549 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-14T09:57:31.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.677+0000 7ffa73771640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-14T09:57:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.677+0000 7ffa73771640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-14T09:57:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.677+0000 7ffa73771640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T09:57:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.677+0000 7ffa73771640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T09:57:31.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.677+0000 7ffa73771640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-14T09:57:31.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:31.678+0000 7ffa73771640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-14T09:57:34.525 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-14T09:57:34.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:34.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.646+0000 7f7b75211640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-14T09:57:34.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.646+0000 7f7b75211640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-14T09:57:34.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.646+0000 7f7b75211640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T09:57:34.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.646+0000 7f7b75211640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T09:57:34.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.646+0000 7f7b75211640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-14T09:57:34.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:34.647+0000 7f7b75211640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-14T09:57:37.501 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-14T09:57:37.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.628+0000 7f60fe61b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-14T09:57:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.628+0000 7f60fe61b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-14T09:57:37.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.628+0000 7f60fe61b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T09:57:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.628+0000 7f60fe61b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T09:57:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.628+0000 7f60fe61b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-14T09:57:37.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:37.629+0000 7f60fe61b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-14T09:57:40.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-14T09:57:40.511 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-14T09:57:40.543 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:40.543 INFO:tasks.ceph:role: osd.4 2024-04-14T09:57:40.543 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:57:40.543 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:40.621 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:41.143 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-14T09:57:41.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-14T09:57:41.146 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-14T09:57:41.255 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-14T09:57:41.291 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-14T09:57:41.360 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:41.361 INFO:tasks.ceph:role: osd.5 2024-04-14T09:57:41.361 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:57:41.361 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-14T09:57:41.436 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:41.437 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:41.934 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-14T09:57:41.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-14T09:57:41.936 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-14T09:57:42.032 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-14T09:57:42.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-14T09:57:42.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:42.134 INFO:tasks.ceph:role: osd.6 2024-04-14T09:57:42.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:57:42.134 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-14T09:57:42.208 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:42.208 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:42.208 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:42.208 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:42.208 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:42.209 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:42.209 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:42.209 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:42.209 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:42.209 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:42.741 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-14T09:57:42.744 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-14T09:57:42.744 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-14T09:57:42.857 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-14T09:57:42.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-14T09:57:42.957 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-14T09:57:42.957 INFO:tasks.ceph:role: osd.7 2024-04-14T09:57:42.957 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:57:42.957 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-04-14T09:57:43.033 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-14T09:57:43.034 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-14T09:57:43.034 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-14T09:57:43.034 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-14T09:57:43.553 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-04-14T09:57:43.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-04-14T09:57:43.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-14T09:57:43.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-14T09:57:43.701 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:43.808 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.808+0000 7f8c3dc11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-14T09:57:43.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.811+0000 7f8c3dc11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-14T09:57:43.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.811+0000 7f8c3dc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T09:57:43.811 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.811+0000 7f8c3dc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T09:57:43.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.811+0000 7f8c3dc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-14T09:57:43.812 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:43.812+0000 7f8c3dc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-14T09:57:46.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-14T09:57:46.694 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:46.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.784+0000 7f743520b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-14T09:57:46.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.784+0000 7f743520b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-14T09:57:46.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.784+0000 7f743520b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T09:57:46.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.784+0000 7f743520b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T09:57:46.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.784+0000 7f743520b640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-14T09:57:46.785 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:46.785+0000 7f743520b640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-14T09:57:49.636 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-14T09:57:49.667 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:49.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.759+0000 7f4bac69d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-14T09:57:49.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.759+0000 7f4bac69d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-14T09:57:49.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.759+0000 7f4bac69d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T09:57:49.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.759+0000 7f4bac69d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T09:57:49.759 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.759+0000 7f4bac69d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-14T09:57:49.760 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:49.760+0000 7f4bac69d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-14T09:57:52.275 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:52.278 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:57:52.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-14T09:57:52.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:52.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.733+0000 7f9462da8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-14T09:57:52.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.734+0000 7f9462da8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-14T09:57:52.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.734+0000 7f9462da8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T09:57:52.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.734+0000 7f9462da8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T09:57:52.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.734+0000 7f9462da8640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-14T09:57:52.735 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:52.734+0000 7f9462da8640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-14T09:57:55.586 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-14T09:57:55.617 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-14T09:57:55.617 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.617 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-14T09:57:55.649 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-14T09:57:55.720 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.721 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-14T09:57:55.790 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-14T09:57:55.859 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-14T09:57:55.928 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.928 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-14T09:57:55.996 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:55.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-14T09:57:56.063 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-14T09:57:56.095 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.095 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-14T09:57:56.164 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.164 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-14T09:57:56.234 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.234 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-14T09:57:56.303 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.303 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-14T09:57:56.372 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.372 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-14T09:57:56.439 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.440 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-14T09:57:56.507 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:56.507 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-14T09:57:56.525 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:56.525 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-14T09:57:56.582 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.582 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-14T09:57:56.597 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:56.597 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-14T09:57:56.653 INFO:tasks.ceph:Adding keys to all mons... 2024-04-14T09:57:56.653 DEBUG:teuthology.orchestra.run.smithi040:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T09:57:56.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.y] 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCEqBtmcMiyKRAATa2ZEfhGTyRWffOi9nuEBg== 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.a] 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCEqBtmG4UaMRAA3p4Yt+h2Mwk7CWqDPakyNQ== 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.c] 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCEqBtmRm1xOBAAiJy8UnSqT+7L/csCaN2oww== 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.0] 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCIqBtmYrr/KRAAzC+iGtUJgILZQ2Vv5zBA4w== 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.1] 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCLqBtmymptKBAA8Ymj8dHNqJx0HTwZn7J6FQ== 2024-04-14T09:57:56.697 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.2] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCOqBtmg46WJhAAD5GeuPYuPqfIztINUlF5GA== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.3] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCRqBtmdxiAJRAAalZLMxdpQLKt+nCmrPiVWA== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[mgr.x] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCEqBtmqqmyLRAAkN+LTSBYsEQOJB/vSQGEYg== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.b] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtm/7jSARAA7LonXwlDMBjCvq1OSsBWDw== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[mds.d] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtmovgoCRAAgq/hsRdxcBZGlzh745caDQ== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.4] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCXqBtmFtI5MBAAak2wpVF91MQN0uykonYObQ== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.5] 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCaqBtmc5XNLhAAbfvwSM8halt8/Ua/FzuWRg== 2024-04-14T09:57:56.698 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.6] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCdqBtmup5QLRAA0QaN7UZ31UKcMYu3cWhb1Q== 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:[osd.7] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCgqBtmCW7MKxAA8o9X55ng2grI8aSt73iBbA== 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtmNaVvDRAArav1w+NRz/ut7W3ZfHpvpg== 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:[client.2] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtm5AMzExAAgUJJjtck5x61/XBB2Kxwbg== 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:[client.1] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtm7eOcFhAAEfqWNmM58FG8qedsC44dIw== 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout:[client.3] 2024-04-14T09:57:56.699 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtmJ950HBAA2/7etU17Tc67TV57W/4VAg== 2024-04-14T09:57:56.719 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCEqBtmcMiyKRAATa2ZEfhGTyRWffOi9nuEBg== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCEqBtmG4UaMRAA3p4Yt+h2Mwk7CWqDPakyNQ== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCEqBtmRm1xOBAAiJy8UnSqT+7L/csCaN2oww== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCIqBtmYrr/KRAAzC+iGtUJgILZQ2Vv5zBA4w== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCLqBtmymptKBAA8Ymj8dHNqJx0HTwZn7J6FQ== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCOqBtmg46WJhAAD5GeuPYuPqfIztINUlF5GA== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCRqBtmdxiAJRAAalZLMxdpQLKt+nCmrPiVWA== 2024-04-14T09:57:56.720 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCEqBtmqqmyLRAAkN+LTSBYsEQOJB/vSQGEYg== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtm/7jSARAA7LonXwlDMBjCvq1OSsBWDw== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtmovgoCRAAgq/hsRdxcBZGlzh745caDQ== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCXqBtmFtI5MBAAak2wpVF91MQN0uykonYObQ== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCaqBtmc5XNLhAAbfvwSM8halt8/Ua/FzuWRg== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCdqBtmup5QLRAA0QaN7UZ31UKcMYu3cWhb1Q== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCgqBtmCW7MKxAA8o9X55ng2grI8aSt73iBbA== 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-04-14T09:57:56.721 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtmNaVvDRAArav1w+NRz/ut7W3ZfHpvpg== 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtm5AMzExAAgUJJjtck5x61/XBB2Kxwbg== 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtm7eOcFhAAEfqWNmM58FG8qedsC44dIw== 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2024-04-14T09:57:56.722 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQCFqBtmJ950HBAA2/7etU17Tc67TV57W/4VAg== 2024-04-14T09:57:56.723 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T09:57:56.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T09:57:56.815 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:56.817 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:56.873 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:56.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:56.929 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:56.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:56.985 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:56.987 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.038 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.092 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.094 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.147 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T09:57:57.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-14T09:57:57.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:57.203 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:57.259 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:57.261 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-14T09:57:57.316 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.319 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.370 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.372 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.426 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.477 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.480 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-14T09:57:57.531 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.533 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.588 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.591 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.650 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.705 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.708 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-14T09:57:57.763 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-14T09:57:57.763 DEBUG:teuthology.orchestra.run.smithi040:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-14T09:57:57.790 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T09:57:57.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-14T09:57:57.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-14T09:57:57.941 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T09:57:58.040 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-14T09:57:58.066 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-14T09:57:58.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-14T09:57:58.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-14T09:57:58.257 DEBUG:teuthology.orchestra.run.smithi040:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:58.260 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-14T09:57:58.312 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-14T09:57:58.312 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-14T09:57:58.312 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-14T09:57:58.315 INFO:tasks.ceph.mon.a:Started 2024-04-14T09:57:58.315 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-14T09:57:58.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-14T09:57:58.354 INFO:tasks.ceph.mon.b:Started 2024-04-14T09:57:58.354 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-14T09:57:58.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-14T09:57:58.356 INFO:tasks.ceph.mon.c:Started 2024-04-14T09:57:58.356 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-14T09:57:58.356 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-14T09:57:58.356 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-14T09:57:58.358 INFO:tasks.ceph.mgr.y:Started 2024-04-14T09:57:58.358 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-14T09:57:58.358 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-14T09:57:58.360 INFO:tasks.ceph.mgr.x:Started 2024-04-14T09:57:58.360 INFO:tasks.ceph:Setting crush tunables to default 2024-04-14T09:57:58.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph osd crush tunables default 2024-04-14T09:57:58.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.460+0000 7fd66c620640 1 Processor -- start 2024-04-14T09:57:58.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.460+0000 7fd66c620640 1 -- start start 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd66c620640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 0x7fd66406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd66c620640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6640d0960 con 0x7fd66415c720 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd66c620640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6640d0c40 con 0x7fd66415c340 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd66c620640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640d0710 con 0x7fd6640b4740 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd669bbb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd66415c720 0x7fd6640cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53166/0 (socket says 172.21.15.40:53166) 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.461+0000 7fd669bbb640 1 -- 172.21.15.40:0/4103233620 learned_addr learned my addr 172.21.15.40:0/4103233620 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.462+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 0x7fd66406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.462+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 msgr2=0x7fd66406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.462+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 msgr2=0x7fd66406f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-14T09:57:58.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.462+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 0x7fd66406f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-14T09:57:58.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.462+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 0x7fd66406f630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-14T09:57:58.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559156515 0 0) 0x7fd6640d0c40 con 0x7fd66415c340 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd650003520 con 0x7fd66415c340 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 959202875 0 0) 0x7fd650003520 con 0x7fd66415c340 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 msgr2=0x7fd66406f630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 --2- 172.21.15.40:0/4103233620 >> v2:172.21.15.136:3300/0 conn(0x7fd6640b4740 0x7fd66406f630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 >> v1:172.21.15.40:6789/0 conn(0x7fd66415c720 legacy=0x7fd6640cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640d0f20 con 0x7fd66415c340 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7fd654001670 con 0x7fd66415c340 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 >> v1:172.21.15.136:6789/0 conn(0x7fd66415c340 legacy=0x7fd6640cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500039b0 0x7fd650003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd650004800 0x7fd650004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 0x7fd65000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640d0710 con 0x7fd6500051c0 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd65000c110 con 0x7fd650004800 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd65000c310 con 0x7fd6500039b0 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 0x7fd65000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd66a3bc640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500039b0 0x7fd650003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.620+0000 7fd669bbb640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd650004800 0x7fd650004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500039b0 msgr2=0x7fd650003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500039b0 0x7fd650003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd650004800 msgr2=0x7fd650004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd650004800 0x7fd650004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd650003520 con 0x7fd6500051c0 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 -- 172.21.15.40:0/4103233620 reap_dead start 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.621+0000 7fd66abbd640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 0x7fd65000b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009fd0 tx=0x7fd650005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d129caacd95d19 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.622+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c039070 con 0x7fd6500051c0 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.622+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c02ccd0 con 0x7fd6500051c0 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.622+0000 7fd6693ba640 1 -- 172.21.15.40:0/4103233620 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c009bd0 con 0x7fd6500051c0 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 -- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 msgr2=0x7fd65000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 0x7fd65000b9c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009fd0 tx=0x7fd650005830 comp rx=0 tx=0).stop 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 -- 172.21.15.40:0/4103233620 shutdown_connections 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 --2- 172.21.15.40:0/4103233620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd6500051c0 0x7fd65000b9c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 -- 172.21.15.40:0/4103233620 >> 172.21.15.40:0/4103233620 conn(0x7fd6640b3c20 msgr2=0x7fd6640b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 -- 172.21.15.40:0/4103233620 shutdown_connections 2024-04-14T09:57:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.623+0000 7fd66c620640 1 -- 172.21.15.40:0/4103233620 wait complete. 2024-04-14T09:57:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.624+0000 7fd66c620640 1 Processor -- start 2024-04-14T09:57:58.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.624+0000 7fd66c620640 1 -- start start 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500051c0 0x7fd6640c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6640b7620 0x7fd6641f3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd66406f630 con 0x7fd664159d60 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640cd030 con 0x7fd6640b7620 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66c620640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd66406f7b0 con 0x7fd6500051c0 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58516/0 (socket says 172.21.15.40:58516) 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 -- 172.21.15.40:0/316781128 learned_addr learned my addr 172.21.15.40:0/316781128 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd669bbb640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6640b7620 0x7fd6641f3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66a3bc640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500051c0 0x7fd6640c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 -- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500051c0 msgr2=0x7fd6640c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500051c0 0x7fd6640c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 -- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6640b7620 msgr2=0x7fd6641f3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6640b7620 0x7fd6641f3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.625+0000 7fd66abbd640 1 -- 172.21.15.40:0/316781128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6641f4240 con 0x7fd664159d60 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd66abbd640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd65c007420 tx=0x7fd65c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c046070 con 0x7fd664159d60 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c03a040 con 0x7fd664159d60 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6641f44c0 con 0x7fd664159d60 2024-04-14T09:57:58.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c039050 con 0x7fd664159d60 2024-04-14T09:57:58.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6641f4a80 con 0x7fd664159d60 2024-04-14T09:57:58.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd65c049070 con 0x7fd664159d60 2024-04-14T09:57:58.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.626+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd65c04b8d0 con 0x7fd664159d60 2024-04-14T09:57:58.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.627+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd664075760 con 0x7fd664159d60 2024-04-14T09:57:58.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.629+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fd65c050080 con 0x7fd664159d60 2024-04-14T09:57:58.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.697+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd6640b80b0 con 0x7fd664159d60 2024-04-14T09:57:58.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.699+0000 7fd65affd640 1 -- 172.21.15.40:0/316781128 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd6641f4240 con 0x7fd664159d60 2024-04-14T09:57:58.699 INFO:teuthology.orchestra.run.smithi040.stderr:adjusted tunables profile to default 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 msgr2=0x7fd6640c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd65c007420 tx=0x7fd65c004ab0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 shutdown_connections 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd664159d60 0x7fd6640c8160 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6640b7620 0x7fd6641f3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 --2- 172.21.15.40:0/316781128 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6500051c0 0x7fd6640c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:58.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 >> 172.21.15.40:0/316781128 conn(0x7fd6640b3c20 msgr2=0x7fd6640ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:58.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 shutdown_connections 2024-04-14T09:57:58.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:57:58.700+0000 7fd66c620640 1 -- 172.21.15.40:0/316781128 wait complete. 2024-04-14T09:57:58.712 INFO:tasks.ceph:check_enable_crimson: False 2024-04-14T09:57:58.712 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-14T09:57:58.712 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:58.712 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-14T09:57:58.739 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:58.739 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-14T09:57:58.806 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:58.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-14T09:57:58.872 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:57:58.872 DEBUG:teuthology.orchestra.run.smithi040:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-14T09:57:58.939 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:58.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-14T09:57:58.966 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:58.966 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-14T09:57:59.033 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:59.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-14T09:57:59.081 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.082+0000 7f3eecfbb040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T09:57:59.101 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:57:59.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-14T09:57:59.137 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.137+0000 7f3eecfbb040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T09:57:59.145 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.144+0000 7fd7da673040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-14T09:57:59.163 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 891722e2-d1e9-4db3-817d-0aeb11182ec2 0 2024-04-14T09:57:59.200 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.199+0000 7fd7da673040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-14T09:57:59.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.303+0000 7fa203060640 1 Processor -- start 2024-04-14T09:57:59.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.303+0000 7fa203060640 1 -- start start 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa203060640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1fc0d2970 0x7fa1fc0d0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa203060640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0d1200 con 0x7fa1fc161d30 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa203060640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1fc0d14e0 con 0x7fa1fc0d0ca0 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa203060640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa1fc0b72a0 con 0x7fa1fc0d2970 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa200dfc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa1fc0d2970 0x7fa1fc0d0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa1fbfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa1fc0d0ca0 0x7fa1fc161620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60358/0 (socket says 172.21.15.136:60358) 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.304+0000 7fa1fbfff640 1 -- 172.21.15.136:0/397551466 learned_addr learned my addr 172.21.15.136:0/397551466 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.305+0000 7fa200dfc640 1 -- 172.21.15.136:0/397551466 >> v1:172.21.15.136:6789/0 conn(0x7fa1fc0d0ca0 legacy=0x7fa1fc161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.305+0000 7fa200dfc640 1 -- 172.21.15.136:0/397551466 >> v1:172.21.15.40:6789/0 conn(0x7fa1fc161d30 legacy=0x7fa1fc0b7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.305+0000 7fa200dfc640 1 -- 172.21.15.136:0/397551466 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc0b7580 con 0x7fa1fc0d2970 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.305+0000 7fa200dfc640 1 --2- 172.21.15.136:0/397551466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc0d0760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00097a0 tx=0x7fa1f002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796dd2e5ccac6d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.305+0000 7fa1fb7fe640 1 -- 172.21.15.136:0/397551466 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002f810 con 0x7fa1fc0d2970 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa1fb7fe640 1 -- 172.21.15.136:0/397551466 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f002f9b0 con 0x7fa1fc0d2970 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa1fb7fe640 1 -- 172.21.15.136:0/397551466 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f002fd80 con 0x7fa1fc0d2970 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 -- 172.21.15.136:0/397551466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc0d2970 msgr2=0x7fa1fc0d0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 --2- 172.21.15.136:0/397551466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc0d0760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa1f00097a0 tx=0x7fa1f002b9f0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 -- 172.21.15.136:0/397551466 shutdown_connections 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 --2- 172.21.15.136:0/397551466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc0d0760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 -- 172.21.15.136:0/397551466 >> 172.21.15.136:0/397551466 conn(0x7fa1fc09d580 msgr2=0x7fa1fc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 -- 172.21.15.136:0/397551466 shutdown_connections 2024-04-14T09:57:59.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.306+0000 7fa203060640 1 -- 172.21.15.136:0/397551466 wait complete. 2024-04-14T09:57:59.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.307+0000 7fa203060640 1 Processor -- start 2024-04-14T09:57:59.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.307+0000 7fa203060640 1 -- start start 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 0x7fa1fc0b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0d2ed0 con 0x7fa1fc0d2970 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa1fc0d2d50 con 0x7fa1fc161d30 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa203060640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa1fc0d3050 con 0x7fa1fc0d0ca0 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53020/0 (socket says 172.21.15.136:53020) 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa200dfc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 0x7fa1fc0b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 -- 172.21.15.136:0/1301679465 learned_addr learned my addr 172.21.15.136:0/1301679465 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa1fbfff640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 -- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 msgr2=0x7fa1fc0b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 0x7fa1fc0b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 -- 172.21.15.136:0/1301679465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1fc0d2970 msgr2=0x7fa1fc155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa2015fd640 1 -- 172.21.15.136:0/1301679465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1fc0b47f0 con 0x7fa1fc161d30 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.308+0000 7fa200dfc640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 0x7fa1fc0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa2015fd640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c6b0 tx=0x7fa1f400cb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003b70 con 0x7fa1fc161d30 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f4003d30 con 0x7fa1fc161d30 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1fc0b4ad0 con 0x7fa1fc161d30 2024-04-14T09:57:59.311 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4005310 con 0x7fa1fc161d30 2024-04-14T09:57:59.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1fc0b5090 con 0x7fa1fc161d30 2024-04-14T09:57:59.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa1f40054b0 con 0x7fa1fc161d30 2024-04-14T09:57:59.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.309+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa1f40128a0 con 0x7fa1fc161d30 2024-04-14T09:57:59.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.310+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1fc0756f0 con 0x7fa1fc161d30 2024-04-14T09:57:59.312 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.312+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa1f4012af0 con 0x7fa1fc161d30 2024-04-14T09:57:59.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.382+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "891722e2-d1e9-4db3-817d-0aeb11182ec2", "id": 0} v 0) -- 0x7fa1fc0cde90 con 0x7fa1fc161d30 2024-04-14T09:57:59.385 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.385+0000 7fa1f97fa640 1 -- 172.21.15.136:0/1301679465 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "891722e2-d1e9-4db3-817d-0aeb11182ec2", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa1f4012cd0 con 0x7fa1fc161d30 2024-04-14T09:57:59.385 INFO:teuthology.orchestra.run.smithi136.stdout:0 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 msgr2=0x7fa1fc155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400c6b0 tx=0x7fa1f400cb70 comp rx=0 tx=0).stop 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 shutdown_connections 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa1fc161d30 0x7fa1fc155670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa1fc0d2970 0x7fa1fc155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 --2- 172.21.15.136:0/1301679465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa1fc0d0ca0 0x7fa1fc0b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 >> 172.21.15.136:0/1301679465 conn(0x7fa1fc09d580 msgr2=0x7fa1fc0b79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 shutdown_connections 2024-04-14T09:57:59.387 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.387+0000 7fa203060640 1 -- 172.21.15.136:0/1301679465 wait complete. 2024-04-14T09:57:59.401 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 23d39ca6-9667-4783-94d7-d849a12ca05e 1 2024-04-14T09:57:59.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.502+0000 7fe903b08640 1 Processor -- start 2024-04-14T09:57:59.502 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.502+0000 7fe903b08640 1 -- start start 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe903b08640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe8fc15e390 0x7fe8fc06b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe903b08640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8fc070590 0x7fe8fc06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe903b08640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8fc0b5db0 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe903b08640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe8fc0b5ad0 con 0x7fe8fc15e390 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe903b08640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe8fc0b41c0 con 0x7fe8fc070590 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8fc070590 0x7fe8fc06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8fc070590 0x7fe8fc06ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53034/0 (socket says 172.21.15.136:53034) 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 -- 172.21.15.136:0/2686464445 learned_addr learned my addr 172.21.15.136:0/2686464445 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9018a4640 1 --2- 172.21.15.136:0/2686464445 >> v2:172.21.15.40:3300/0 conn(0x7fe8fc15e390 0x7fe8fc06b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 -- 172.21.15.136:0/2686464445 >> v2:172.21.15.40:3300/0 conn(0x7fe8fc15e390 msgr2=0x7fe8fc06b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:57:59.504 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 --2- 172.21.15.136:0/2686464445 >> v2:172.21.15.40:3300/0 conn(0x7fe8fc15e390 0x7fe8fc06b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 -- 172.21.15.136:0/2686464445 >> v1:172.21.15.40:6789/0 conn(0x7fe8fc0b4ca0 legacy=0x7fe8fc0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.503+0000 7fe9010a3640 1 -- 172.21.15.136:0/2686464445 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc0b44a0 con 0x7fe8fc070590 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe9010a3640 1 --2- 172.21.15.136:0/2686464445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc06ba60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc072200 tx=0x7fe8ec02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d21498aec4191791 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe9008a2640 1 -- 172.21.15.136:0/2686464445 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec034070 con 0x7fe8fc070590 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe9008a2640 1 -- 172.21.15.136:0/2686464445 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec030860 con 0x7fe8fc070590 2024-04-14T09:57:59.505 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe9008a2640 1 -- 172.21.15.136:0/2686464445 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec030c30 con 0x7fe8fc070590 2024-04-14T09:57:59.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe903b08640 1 -- 172.21.15.136:0/2686464445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 msgr2=0x7fe8fc06ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.504+0000 7fe903b08640 1 --2- 172.21.15.136:0/2686464445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc06ba60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc072200 tx=0x7fe8ec02b9a0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 -- 172.21.15.136:0/2686464445 shutdown_connections 2024-04-14T09:57:59.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 --2- 172.21.15.136:0/2686464445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc06ba60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.508 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 --2- 172.21.15.136:0/2686464445 >> v2:172.21.15.40:3300/0 conn(0x7fe8fc15e390 0x7fe8fc06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 -- 172.21.15.136:0/2686464445 >> 172.21.15.136:0/2686464445 conn(0x7fe8fc06e680 msgr2=0x7fe8fc06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 -- 172.21.15.136:0/2686464445 shutdown_connections 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.505+0000 7fe903b08640 1 -- 172.21.15.136:0/2686464445 wait complete. 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 Processor -- start 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 -- start start 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 0x7fe8fc14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8fc15e390 0x7fe8fc1e7240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ae5d0 con 0x7fe8fc15e390 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc0b57c0 con 0x7fe8fc070590 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.506+0000 7fe903b08640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe8fc0ae750 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9018a4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 0x7fe8fc14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.509 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9018a4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53040/0 (socket says 172.21.15.136:53040) 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9018a4640 1 -- 172.21.15.136:0/2231870655 learned_addr learned my addr 172.21.15.136:0/2231870655 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9020a5640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8fc15e390 0x7fe8fc1e7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 -- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 msgr2=0x7fe8fc1e8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 -- 172.21.15.136:0/2231870655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8fc15e390 msgr2=0x7fe8fc1e7240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8fc15e390 0x7fe8fc1e7240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 -- 172.21.15.136:0/2231870655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8fc1e7bb0 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9018a4640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe9010a3640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 0x7fe8fc14a7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b4340 tx=0x7fe8ec004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec048070 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ec030660 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8fc1e7e90 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.510 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ec034040 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc1e8450 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe8ec04b070 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.507+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fe8ec043410 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.509+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8fc0756f0 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.511+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fe8ec030830 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.582 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.583+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23d39ca6-9667-4783-94d7-d849a12ca05e", "id": 1} v 0) -- 0x7fe8fc06d640 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.590 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.588+0000 7fe8f27fc640 1 -- 172.21.15.136:0/2231870655 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23d39ca6-9667-4783-94d7-d849a12ca05e", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fe8ec04d440 con 0x7fe8fc0b4ca0 2024-04-14T09:57:59.590 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-04-14T09:57:59.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 msgr2=0x7fe8fc14a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 0x7fe8fc14a7c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc0b4340 tx=0x7fe8ec004730 comp rx=0 tx=0).stop 2024-04-14T09:57:59.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 shutdown_connections 2024-04-14T09:57:59.591 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe8fc15e390 0x7fe8fc1e7240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8fc0b4ca0 0x7fe8fc14a7c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 --2- 172.21.15.136:0/2231870655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8fc070590 0x7fe8fc1e8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 >> 172.21.15.136:0/2231870655 conn(0x7fe8fc06e680 msgr2=0x7fe8fc0b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 shutdown_connections 2024-04-14T09:57:59.592 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.589+0000 7fe903b08640 1 -- 172.21.15.136:0/2231870655 wait complete. 2024-04-14T09:57:59.599 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new dcabb454-b141-493c-a76f-cc5c9b6da94a 2 2024-04-14T09:57:59.694 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.694+0000 7f3eecfbb040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T09:57:59.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.700+0000 7fba869b4640 1 Processor -- start 2024-04-14T09:57:59.700 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.700+0000 7fba869b4640 1 -- start start 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba869b4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 0x7fba800d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba869b4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba800cdfe0 con 0x7fba8015c4c0 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba869b4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba800ccb50 con 0x7fba800d2bd0 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba869b4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fba8015c8a0 con 0x7fba8009b150 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba7f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fba800d2bd0 0x7fba8009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60364/0 (socket says 172.21.15.136:60364) 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba7f7fe640 1 -- 172.21.15.136:0/2048089870 learned_addr learned my addr 172.21.15.136:0/2048089870 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-04-14T09:57:59.701 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba84f51640 1 --2- 172.21.15.136:0/2048089870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 0x7fba800d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba7effd640 1 -- 172.21.15.136:0/2048089870 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930830654 0 0) 0x7fba800ccb50 con 0x7fba800d2bd0 2024-04-14T09:57:59.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba84f51640 1 -- 172.21.15.136:0/2048089870 >> v1:172.21.15.136:6789/0 conn(0x7fba800d2bd0 legacy=0x7fba8009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba84f51640 1 -- 172.21.15.136:0/2048089870 >> v1:172.21.15.40:6789/0 conn(0x7fba8015c4c0 legacy=0x7fba800cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.702 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.701+0000 7fba84f51640 1 -- 172.21.15.136:0/2048089870 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba800d0d20 con 0x7fba8009b150 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.702+0000 7fba84f51640 1 --2- 172.21.15.136:0/2048089870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 0x7fba800d0660 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba78009dc0 tx=0x7fba7802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fb5619d5b642efb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.702+0000 7fba7effd640 1 -- 172.21.15.136:0/2048089870 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78039070 con 0x7fba8009b150 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.702+0000 7fba7effd640 1 -- 172.21.15.136:0/2048089870 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7802ccd0 con 0x7fba8009b150 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.702+0000 7fba7effd640 1 -- 172.21.15.136:0/2048089870 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78034660 con 0x7fba8009b150 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 -- 172.21.15.136:0/2048089870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 msgr2=0x7fba800d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 --2- 172.21.15.136:0/2048089870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 0x7fba800d0660 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fba78009dc0 tx=0x7fba7802bf20 comp rx=0 tx=0).stop 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 -- 172.21.15.136:0/2048089870 shutdown_connections 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 --2- 172.21.15.136:0/2048089870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8009b150 0x7fba800d0660 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 -- 172.21.15.136:0/2048089870 >> 172.21.15.136:0/2048089870 conn(0x7fba800d20b0 msgr2=0x7fba800d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.703 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 -- 172.21.15.136:0/2048089870 shutdown_connections 2024-04-14T09:57:59.704 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.703+0000 7fba869b4640 1 -- 172.21.15.136:0/2048089870 wait complete. 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.704+0000 7fba869b4640 1 Processor -- start 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.704+0000 7fba869b4640 1 -- start start 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8009b150 0x7fba8015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba8009b930 con 0x7fba8009b150 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba800cd0d0 con 0x7fba800d2bd0 2024-04-14T09:57:59.706 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba869b4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fba800cd3b0 con 0x7fba8015c4c0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba7f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:44964/0 (socket says 172.21.15.136:44964) 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 -- 172.21.15.136:0/3376062876 learned_addr learned my addr 172.21.15.136:0/3376062876 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba7f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53052/0 (socket says 172.21.15.136:53052) 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba7ffff640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8009b150 0x7fba8015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 -- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 msgr2=0x7fba80156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 -- 172.21.15.136:0/3376062876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8009b150 msgr2=0x7fba8015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8009b150 0x7fba8015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 -- 172.21.15.136:0/3376062876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8015ec40 con 0x7fba8015c4c0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba7f7fe640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.705+0000 7fba84f51640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba78037040 tx=0x7fba78004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.707 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78039050 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba78045070 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8015dba0 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7803e830 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba8015e160 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba7803e9d0 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.706+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fba78040450 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.707+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba800d14f0 con 0x7fba8015c4c0 2024-04-14T09:57:59.708 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.709+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fba800d14f0 con 0x7fba8015c4c0 2024-04-14T09:57:59.749 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.749+0000 7f3eecfbb040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T09:57:59.751 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.750+0000 7fd7da673040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-14T09:57:59.779 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.779+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dcabb454-b141-493c-a76f-cc5c9b6da94a", "id": 2} v 0) -- 0x7fba800756f0 con 0x7fba8015c4c0 2024-04-14T09:57:59.784 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.785+0000 7fba7cff9640 1 -- 172.21.15.136:0/3376062876 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dcabb454-b141-493c-a76f-cc5c9b6da94a", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fba7803ee00 con 0x7fba8015c4c0 2024-04-14T09:57:59.784 INFO:teuthology.orchestra.run.smithi136.stdout:2 2024-04-14T09:57:59.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.785+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 msgr2=0x7fba800b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fba78037040 tx=0x7fba78004a40 comp rx=0 tx=0).stop 2024-04-14T09:57:59.786 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 shutdown_connections 2024-04-14T09:57:59.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba8015c4c0 0x7fba800b0210 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba800d2bd0 0x7fba80156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 --2- 172.21.15.136:0/3376062876 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba8009b150 0x7fba8015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 >> 172.21.15.136:0/3376062876 conn(0x7fba800d20b0 msgr2=0x7fba800b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.787 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 shutdown_connections 2024-04-14T09:57:59.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.786+0000 7fba869b4640 1 -- 172.21.15.136:0/3376062876 wait complete. 2024-04-14T09:57:59.795 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.795+0000 7f3eecfbb040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T09:57:59.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 76305ea2-ea43-4f1a-9c96-9fd089df5c5a 3 2024-04-14T09:57:59.806 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.806+0000 7fd7da673040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-14T09:57:59.851 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.851+0000 7f3eecfbb040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T09:57:59.852 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.851+0000 7fd7da673040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-14T09:57:59.894 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:57:59.894+0000 7f3eecfbb040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T09:57:59.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 Processor -- start 2024-04-14T09:57:59.895 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 -- start start 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f57900d0660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57900cdfe0 con 0x7f579015c4c0 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57900ccb50 con 0x7f579009aa40 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f57964de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f579015c8a0 con 0x7f57900d2bd0 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.896+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f57900d0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f5794a7b640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f579009aa40 0x7f579006f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60370/0 (socket says 172.21.15.136:60370) 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f5794a7b640 1 -- 172.21.15.136:0/893429185 learned_addr learned my addr 172.21.15.136:0/893429185 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f578effd640 1 -- 172.21.15.136:0/893429185 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2590261677 0 0) 0x7f57900ccb50 con 0x7f579009aa40 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f578f7fe640 1 -- 172.21.15.136:0/893429185 >> v1:172.21.15.136:6789/0 conn(0x7f579009aa40 legacy=0x7f579006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f578f7fe640 1 -- 172.21.15.136:0/893429185 >> v1:172.21.15.40:6789/0 conn(0x7f579015c4c0 legacy=0x7f57900cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.897 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f578f7fe640 1 -- 172.21.15.136:0/893429185 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57900d0d20 con 0x7f57900d2bd0 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.897+0000 7f578f7fe640 1 --2- 172.21.15.136:0/893429185 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f57900d0660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57840097d0 tx=0x7f578402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccd4d6ce1f74e424 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f578effd640 1 -- 172.21.15.136:0/893429185 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784035020 con 0x7f57900d2bd0 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f578effd640 1 -- 172.21.15.136:0/893429185 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5784031890 con 0x7f57900d2bd0 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f578effd640 1 -- 172.21.15.136:0/893429185 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5784031c60 con 0x7f57900d2bd0 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 -- 172.21.15.136:0/893429185 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 msgr2=0x7f57900d0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 --2- 172.21.15.136:0/893429185 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f57900d0660 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f57840097d0 tx=0x7f578402b930 comp rx=0 tx=0).stop 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 -- 172.21.15.136:0/893429185 shutdown_connections 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 --2- 172.21.15.136:0/893429185 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f57900d0660 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 -- 172.21.15.136:0/893429185 >> 172.21.15.136:0/893429185 conn(0x7f57900d20b0 msgr2=0x7f57900d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 -- 172.21.15.136:0/893429185 shutdown_connections 2024-04-14T09:57:59.899 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.898+0000 7f57964de640 1 -- 172.21.15.136:0/893429185 wait complete. 2024-04-14T09:57:59.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.899+0000 7f57964de640 1 Processor -- start 2024-04-14T09:57:59.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 -- start start 2024-04-14T09:57:59.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f579009aa40 0x7f57900cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.902 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f579009b930 con 0x7f579009aa40 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f57900cd0d0 con 0x7f579015c4c0 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f57964de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f57900cd3b0 con 0x7f57900d2bd0 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f5794a7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f5794a7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53054/0 (socket says 172.21.15.136:53054) 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.900+0000 7f578f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:44980/0 (socket says 172.21.15.136:44980) 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 -- 172.21.15.136:0/3509670603 learned_addr learned my addr 172.21.15.136:0/3509670603 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578ffff640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f579009aa40 0x7f57900cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 -- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 msgr2=0x7f579014a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 -- 172.21.15.136:0/3509670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f579009aa40 msgr2=0x7f57900cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f579009aa40 0x7f57900cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.903 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 -- 172.21.15.136:0/3509670603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579014aaa0 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578f7fe640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f5794a7b640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f578800c700 tx=0x7f578800cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5788018070 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f578800ce10 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f578800a860 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57900c9b60 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57900ca120 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f578800aa00 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.901+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f5788012890 con 0x7f579015c4c0 2024-04-14T09:57:59.904 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.902+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57900756f0 con 0x7f579015c4c0 2024-04-14T09:57:59.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.904+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f579014aaa0 con 0x7f579015c4c0 2024-04-14T09:57:59.906 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.905+0000 7fd7da673040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-14T09:57:59.949 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:57:59.949+0000 7fd7da673040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-14T09:57:59.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.975+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "76305ea2-ea43-4f1a-9c96-9fd089df5c5a", "id": 3} v 0) -- 0x7f57900ce4e0 con 0x7f579015c4c0 2024-04-14T09:57:59.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f578cff9640 1 -- 172.21.15.136:0/3509670603 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "76305ea2-ea43-4f1a-9c96-9fd089df5c5a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f5788012400 con 0x7f579015c4c0 2024-04-14T09:57:59.982 INFO:teuthology.orchestra.run.smithi136.stdout:3 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 msgr2=0x7f57900c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f578800c700 tx=0x7f578800cbc0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 shutdown_connections 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f579015c4c0 0x7f57900c9180 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f57900d2bd0 0x7f579014a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 --2- 172.21.15.136:0/3509670603 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f579009aa40 0x7f57900cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.981+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 >> 172.21.15.136:0/3509670603 conn(0x7f57900d20b0 msgr2=0x7f57900b2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.982+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 shutdown_connections 2024-04-14T09:57:59.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:57:59.982+0000 7f57964de640 1 -- 172.21.15.136:0/3509670603 wait complete. 2024-04-14T09:57:59.992 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new b64e63ea-6a58-4752-851a-22ea09fb8379 4 2024-04-14T09:58:00.015 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.015+0000 7f3eecfbb040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T09:58:00.069 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.068+0000 7fd7da673040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-14T09:58:00.087 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.088+0000 7f3eecfbb040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T09:58:00.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.092+0000 7f4395291640 1 Processor -- start 2024-04-14T09:58:00.092 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.092+0000 7f4395291640 1 -- start start 2024-04-14T09:58:00.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f4395291640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f439006b520 0x7f4390160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f4395291640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4390072700 con 0x7f439006b900 2024-04-14T09:58:00.093 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f4395291640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f439015d190 con 0x7f439015ccc0 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f4395291640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f439015d470 con 0x7f439006b520 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f439006b520 0x7f4390160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f439006b520 0x7f4390160680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53060/0 (socket says 172.21.15.136:53060) 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f439015ccc0 0x7f439006f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60384/0 (socket says 172.21.15.136:60384) 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 -- 172.21.15.136:0/2201700590 learned_addr learned my addr 172.21.15.136:0/2201700590 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 -- 172.21.15.136:0/2201700590 >> v1:172.21.15.136:6789/0 conn(0x7f439015ccc0 legacy=0x7f439006f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 -- 172.21.15.136:0/2201700590 >> v1:172.21.15.40:6789/0 conn(0x7f439006b900 legacy=0x7f439015c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.094 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.093+0000 7f438effd640 1 -- 172.21.15.136:0/2201700590 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f439015fba0 con 0x7f439006b520 2024-04-14T09:58:00.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.094+0000 7f438effd640 1 --2- 172.21.15.136:0/2201700590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439006b520 0x7f4390160680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f43780098a0 tx=0x7f437802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1159a2bbe22f91cb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.095 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.094+0000 7f438dffb640 1 -- 172.21.15.136:0/2201700590 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4378035020 con 0x7f439006b520 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.094+0000 7f438dffb640 1 -- 172.21.15.136:0/2201700590 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4378031640 con 0x7f439006b520 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.094+0000 7f438dffb640 1 -- 172.21.15.136:0/2201700590 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437802d040 con 0x7f439006b520 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 -- 172.21.15.136:0/2201700590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439006b520 msgr2=0x7f4390160680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 --2- 172.21.15.136:0/2201700590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439006b520 0x7f4390160680 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f43780098a0 tx=0x7f437802b8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 -- 172.21.15.136:0/2201700590 shutdown_connections 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 --2- 172.21.15.136:0/2201700590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439006b520 0x7f4390160680 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 -- 172.21.15.136:0/2201700590 >> 172.21.15.136:0/2201700590 conn(0x7f439006e680 msgr2=0x7f439006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 -- 172.21.15.136:0/2201700590 shutdown_connections 2024-04-14T09:58:00.096 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.095+0000 7f4395291640 1 -- 172.21.15.136:0/2201700590 wait complete. 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.096+0000 7f4395291640 1 Processor -- start 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.096+0000 7f4395291640 1 -- start start 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f439006b520 0x7f43900b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 0x7f4390141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.099 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f439006bdb0 con 0x7f439006b520 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4390160160 con 0x7f439015ccc0 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f4395291640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4390145c10 con 0x7f439006b900 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438e7fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 0x7f4390141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53072/0 (socket says 172.21.15.136:53072) 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 -- 172.21.15.136:0/370943680 learned_addr learned my addr 172.21.15.136:0/370943680 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438effd640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f439006b520 0x7f43900b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 -- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 msgr2=0x7f4390141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 0x7f4390141640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 -- 172.21.15.136:0/370943680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f439006b520 msgr2=0x7f43900b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f439006b520 0x7f43900b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.100 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438f7fe640 1 -- 172.21.15.136:0/370943680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43900b0c50 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.097+0000 7f438e7fc640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 0x7f4390141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f438f7fe640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f438800c6c0 tx=0x7f438800cb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388018070 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4388004d60 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43900b0f30 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438800a840 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43900b14f0 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f438801b070 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.098+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f43880077a0 con 0x7f439015ccc0 2024-04-14T09:58:00.101 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.099+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43900756f0 con 0x7f439015ccc0 2024-04-14T09:58:00.102 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.101+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4388022070 con 0x7f439015ccc0 2024-04-14T09:58:00.136 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.136+0000 7f3eecfbb040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T09:58:00.140 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.140+0000 7fd7da673040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-14T09:58:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.172+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b64e63ea-6a58-4752-851a-22ea09fb8379", "id": 4} v 0) -- 0x7f439006c410 con 0x7f439015ccc0 2024-04-14T09:58:00.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.176+0000 7f43877fe640 1 -- 172.21.15.136:0/370943680 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b64e63ea-6a58-4752-851a-22ea09fb8379", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f438800abf0 con 0x7f439015ccc0 2024-04-14T09:58:00.176 INFO:teuthology.orchestra.run.smithi136.stdout:4 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.176+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 msgr2=0x7f4390141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.176+0000 7f4395291640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f438800c6c0 tx=0x7f438800cb80 comp rx=0 tx=0).stop 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 shutdown_connections 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f439015ccc0 0x7f4390141b80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f439006b900 0x7f4390141640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 --2- 172.21.15.136:0/370943680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f439006b520 0x7f43900b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 >> 172.21.15.136:0/370943680 conn(0x7f439006e680 msgr2=0x7f439015c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 shutdown_connections 2024-04-14T09:58:00.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.177+0000 7f4395291640 1 -- 172.21.15.136:0/370943680 wait complete. 2024-04-14T09:58:00.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new cb2f0397-51be-49d4-af87-3a665370072d 5 2024-04-14T09:58:00.188 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.187+0000 7fd7da673040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-14T09:58:00.189 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.189+0000 7f3eecfbb040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T09:58:00.238 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.239+0000 7f3eecfbb040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T09:58:00.241 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.240+0000 7fd7da673040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-14T09:58:00.289 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.288+0000 7fd7da673040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-14T09:58:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.289+0000 7f0a37b15640 1 Processor -- start 2024-04-14T09:58:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.289+0000 7f0a37b15640 1 -- start start 2024-04-14T09:58:00.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a37b15640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a37b15640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a30072980 0x7f0a300b4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a37b15640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a300cf9d0 con 0x7f0a301444b0 2024-04-14T09:58:00.300 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a37b15640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0a300cfc70 con 0x7f0a30072980 2024-04-14T09:58:00.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a37b15640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0a300cff50 con 0x7f0a30144a10 2024-04-14T09:58:00.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a350b0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a350b0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:44998/0 (socket says 172.21.15.136:44998) 2024-04-14T09:58:00.301 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a358b1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0a301444b0 0x7f0a30070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.136:42448/0 (socket says 172.21.15.136:42448) 2024-04-14T09:58:00.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a350b0640 1 -- 172.21.15.136:0/2092130935 learned_addr learned my addr 172.21.15.136:0/2092130935 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.290+0000 7f0a360b2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0a30072980 0x7f0a300b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.291+0000 7f0a348af640 1 -- 172.21.15.136:0/2092130935 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714054809 0 0) 0x7f0a300cf9d0 con 0x7f0a301444b0 2024-04-14T09:58:00.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.291+0000 7f0a350b0640 1 -- 172.21.15.136:0/2092130935 >> v2:172.21.15.40:3300/0 conn(0x7f0a30072980 msgr2=0x7f0a300b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:00.302 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.291+0000 7f0a350b0640 1 --2- 172.21.15.136:0/2092130935 >> v2:172.21.15.40:3300/0 conn(0x7f0a30072980 0x7f0a300b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.291+0000 7f0a350b0640 1 -- 172.21.15.136:0/2092130935 >> v1:172.21.15.40:6789/0 conn(0x7f0a301444b0 legacy=0x7f0a30070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.291+0000 7f0a350b0640 1 -- 172.21.15.136:0/2092130935 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a300d0230 con 0x7f0a30144a10 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.292+0000 7f0a350b0640 1 --2- 172.21.15.136:0/2092130935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00bb10 tx=0x7f0a2c02e150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f4044602b953f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.292+0000 7f0a348af640 1 -- 172.21.15.136:0/2092130935 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c03b070 con 0x7f0a30144a10 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.292+0000 7f0a348af640 1 -- 172.21.15.136:0/2092130935 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c036440 con 0x7f0a30144a10 2024-04-14T09:58:00.303 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.292+0000 7f0a348af640 1 -- 172.21.15.136:0/2092130935 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c036810 con 0x7f0a30144a10 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 -- 172.21.15.136:0/2092130935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 msgr2=0x7f0a30072440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2092130935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00bb10 tx=0x7f0a2c02e150 comp rx=0 tx=0).stop 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 -- 172.21.15.136:0/2092130935 shutdown_connections 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2092130935 >> v2:172.21.15.40:3300/0 conn(0x7f0a30072980 0x7f0a300b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2092130935 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a30072440 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.304 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 -- 172.21.15.136:0/2092130935 >> 172.21.15.136:0/2092130935 conn(0x7f0a3006e680 msgr2=0x7f0a3006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 -- 172.21.15.136:0/2092130935 shutdown_connections 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.293+0000 7f0a37b15640 1 -- 172.21.15.136:0/2092130935 wait complete. 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.294+0000 7f0a37b15640 1 Processor -- start 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.294+0000 7f0a37b15640 1 -- start start 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a30072980 0x7f0a3006b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.305 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a301444b0 0x7f0a300afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0a300b4960 con 0x7f0a30072980 2024-04-14T09:58:00.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0a300d0d10 con 0x7f0a301444b0 2024-04-14T09:58:00.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a37b15640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0a300b4ae0 con 0x7f0a30144a10 2024-04-14T09:58:00.306 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:45006/0 (socket says 172.21.15.136:45006) 2024-04-14T09:58:00.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 -- 172.21.15.136:0/2035932941 learned_addr learned my addr 172.21.15.136:0/2035932941 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a350b0640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a301444b0 0x7f0a300afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a358b1640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a30072980 0x7f0a3006b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.307 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 -- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a301444b0 msgr2=0x7f0a300afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a301444b0 0x7f0a300afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 -- 172.21.15.136:0/2035932941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a30072980 msgr2=0x7f0a3006b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a30072980 0x7f0a3006b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 -- 172.21.15.136:0/2035932941 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a300aef20 con 0x7f0a30144a10 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a360b2640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800efc0 tx=0x7f0a2800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.308 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28018020 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.295+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28014480 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a30140610 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28014870 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a300af480 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a28005d10 con 0x7f0a30144a10 2024-04-14T09:58:00.309 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f0a28013960 con 0x7f0a30144a10 2024-04-14T09:58:00.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.296+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a300756f0 con 0x7f0a30144a10 2024-04-14T09:58:00.310 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.299+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0a28022070 con 0x7f0a30144a10 2024-04-14T09:58:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.371+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cb2f0397-51be-49d4-af87-3a665370072d", "id": 5} v 0) -- 0x7f0a3006eda0 con 0x7f0a30144a10 2024-04-14T09:58:00.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.376+0000 7f0a267fc640 1 -- 172.21.15.136:0/2035932941 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb2f0397-51be-49d4-af87-3a665370072d", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f0a300aef20 con 0x7f0a30144a10 2024-04-14T09:58:00.376 INFO:teuthology.orchestra.run.smithi136.stdout:5 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 msgr2=0x7f0a3015a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800efc0 tx=0x7f0a2800c490 comp rx=0 tx=0).stop 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 shutdown_connections 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a30144a10 0x7f0a3015a590 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a301444b0 0x7f0a300afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 --2- 172.21.15.136:0/2035932941 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0a30072980 0x7f0a3006b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 >> 172.21.15.136:0/2035932941 conn(0x7f0a3006e680 msgr2=0x7f0a30143700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 shutdown_connections 2024-04-14T09:58:00.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.377+0000 7f0a37b15640 1 -- 172.21.15.136:0/2035932941 wait complete. 2024-04-14T09:58:00.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 33c94f4e-a2d5-485a-b064-587043313130 6 2024-04-14T09:58:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.489+0000 7fc0b7436640 1 Processor -- start 2024-04-14T09:58:00.489 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.489+0000 7fc0b7436640 1 -- start start 2024-04-14T09:58:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc0b015e390 0x7fc0b006b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00b5db0 con 0x7fc0b015e390 2024-04-14T09:58:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc0b00b5ad0 con 0x7fc0b00b4ca0 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b7436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b00b41c0 con 0x7fc0b0070590 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b59d3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:45010/0 (socket says 172.21.15.136:45010) 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b59d3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53090/0 (socket says 172.21.15.136:53090) 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 -- 172.21.15.136:0/1828150299 learned_addr learned my addr 172.21.15.136:0/1828150299 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b51d2640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.40:3300/0 conn(0x7fc0b015e390 0x7fc0b006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 -- 172.21.15.136:0/1828150299 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 msgr2=0x7fc0b00b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 -- 172.21.15.136:0/1828150299 >> v2:172.21.15.40:3300/0 conn(0x7fc0b015e390 msgr2=0x7fc0b006b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.40:3300/0 conn(0x7fc0b015e390 0x7fc0b006b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b49d1640 1 -- 172.21.15.136:0/1828150299 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b00b44a0 con 0x7fc0b0070590 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.490+0000 7fc0b59d3640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.491+0000 7fc0b49d1640 1 --2- 172.21.15.136:0/1828150299 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0070c20 tx=0x7fc0a002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d266fba784b17bd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.491+0000 7fc0a7fff640 1 -- 172.21.15.136:0/1828150299 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0035020 con 0x7fc0b0070590 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.491+0000 7fc0a7fff640 1 -- 172.21.15.136:0/1828150299 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0a0031870 con 0x7fc0b0070590 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.491+0000 7fc0a7fff640 1 -- 172.21.15.136:0/1828150299 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0031c40 con 0x7fc0b0070590 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 -- 172.21.15.136:0/1828150299 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 msgr2=0x7fc0b006ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 --2- 172.21.15.136:0/1828150299 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc0b0070c20 tx=0x7fc0a002b910 comp rx=0 tx=0).stop 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 -- 172.21.15.136:0/1828150299 shutdown_connections 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.136:3300/0 conn(0x7fc0b00b4ca0 0x7fc0b00b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 --2- 172.21.15.136:0/1828150299 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b006ba60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.494 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 --2- 172.21.15.136:0/1828150299 >> v2:172.21.15.40:3300/0 conn(0x7fc0b015e390 0x7fc0b006b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 -- 172.21.15.136:0/1828150299 >> 172.21.15.136:0/1828150299 conn(0x7fc0b006e680 msgr2=0x7fc0b006ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 -- 172.21.15.136:0/1828150299 shutdown_connections 2024-04-14T09:58:00.495 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.492+0000 7fc0b7436640 1 -- 172.21.15.136:0/1828150299 wait complete. 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.493+0000 7fc0b7436640 1 Processor -- start 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.493+0000 7fc0b7436640 1 -- start start 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b00b4ca0 0x7fc0b01611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b015e390 0x7fc0b014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00b57f0 con 0x7fc0b00b4ca0 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b00b5670 con 0x7fc0b015e390 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b7436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc0b0072440 con 0x7fc0b0070590 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:45018/0 (socket says 172.21.15.136:45018) 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b59d3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b015e390 0x7fc0b014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 -- 172.21.15.136:0/254190823 learned_addr learned my addr 172.21.15.136:0/254190823 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b49d1640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b00b4ca0 0x7fc0b01611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 -- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b015e390 msgr2=0x7fc0b014dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b015e390 0x7fc0b014dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 -- 172.21.15.136:0/254190823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b00b4ca0 msgr2=0x7fc0b01611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b00b4ca0 0x7fc0b01611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.494+0000 7fc0b51d2640 1 -- 172.21.15.136:0/254190823 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b015ee60 con 0x7fc0b0070590 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0b51d2640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00e8a0 tx=0x7fc0ac00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac017070 con 0x7fc0b0070590 2024-04-14T09:58:00.499 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0ac00ee90 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b015e8a0 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00cb80 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b015b7f0 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc0ac01a070 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.495+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fc0ac013470 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.496+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b00756f0 con 0x7fc0b0070590 2024-04-14T09:58:00.500 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.498+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fc0ac00cd20 con 0x7fc0b0070590 2024-04-14T09:58:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.570+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "33c94f4e-a2d5-485a-b064-587043313130", "id": 6} v 0) -- 0x7fc0b00b3320 con 0x7fc0b0070590 2024-04-14T09:58:00.575 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.575+0000 7fc0a5ffb640 1 -- 172.21.15.136:0/254190823 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "33c94f4e-a2d5-485a-b064-587043313130", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fc0ac006390 con 0x7fc0b0070590 2024-04-14T09:58:00.575 INFO:teuthology.orchestra.run.smithi136.stdout:6 2024-04-14T09:58:00.576 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 msgr2=0x7fc0b0155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00e8a0 tx=0x7fc0ac00eca0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 shutdown_connections 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0b015e390 0x7fc0b014dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc0b00b4ca0 0x7fc0b01611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 --2- 172.21.15.136:0/254190823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0b0070590 0x7fc0b0155c30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 >> 172.21.15.136:0/254190823 conn(0x7fc0b006e680 msgr2=0x7fc0b00b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 shutdown_connections 2024-04-14T09:58:00.577 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.576+0000 7fc0b7436640 1 -- 172.21.15.136:0/254190823 wait complete. 2024-04-14T09:58:00.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new be6b3d90-9d7a-4bc8-a101-1a0bb50b1226 7 2024-04-14T09:58:00.641 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.642+0000 7f3eecfbb040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T09:58:00.682 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.681+0000 7fd7da673040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-14T09:58:00.689 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.689+0000 7f6720355640 1 Processor -- start 2024-04-14T09:58:00.689 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.689+0000 7f6720355640 1 -- start start 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.690+0000 7f6720355640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6718072340 0x7f67180aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.690+0000 7f6720355640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f67180aefa0 0x7f671806e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.690+0000 7f6720355640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67180af7c0 con 0x7f671815f5a0 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.690+0000 7f6720355640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f67180afaa0 con 0x7f67180aefa0 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.690+0000 7f6720355640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f67180afd80 con 0x7f6718072340 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d8f0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6718072340 0x7f67180aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671e0f1640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f671815f5a0 0x7f6718071c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:60396/0 (socket says 172.21.15.136:60396) 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671e0f1640 1 -- 172.21.15.136:0/2900246470 learned_addr learned my addr 172.21.15.136:0/2900246470 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671e8f2640 1 --2- 172.21.15.136:0/2900246470 >> v2:172.21.15.40:3300/0 conn(0x7f67180aefa0 0x7f671806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.691 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d8f0640 1 -- 172.21.15.136:0/2900246470 >> v2:172.21.15.40:3300/0 conn(0x7f67180aefa0 msgr2=0x7f671806e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d8f0640 1 --2- 172.21.15.136:0/2900246470 >> v2:172.21.15.40:3300/0 conn(0x7f67180aefa0 0x7f671806e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d8f0640 1 -- 172.21.15.136:0/2900246470 >> v1:172.21.15.136:6789/0 conn(0x7f671815f5a0 legacy=0x7f6718071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d8f0640 1 -- 172.21.15.136:0/2900246470 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67180b0060 con 0x7f6718072340 2024-04-14T09:58:00.692 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.691+0000 7f671d0ef640 1 -- 172.21.15.136:0/2900246470 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2522512960 0 0) 0x7f67180af7c0 con 0x7f671815f5a0 2024-04-14T09:58:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f671d8f0640 1 --2- 172.21.15.136:0/2900246470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67180aea60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67180b5ee0 tx=0x7f670802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52020ed0422e547d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f671d0ef640 1 -- 172.21.15.136:0/2900246470 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708035020 con 0x7f6718072340 2024-04-14T09:58:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f671d0ef640 1 -- 172.21.15.136:0/2900246470 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6708031830 con 0x7f6718072340 2024-04-14T09:58:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f671d0ef640 1 -- 172.21.15.136:0/2900246470 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6708031c00 con 0x7f6718072340 2024-04-14T09:58:00.693 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 -- 172.21.15.136:0/2900246470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 msgr2=0x7f67180aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 --2- 172.21.15.136:0/2900246470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67180aea60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f67180b5ee0 tx=0x7f670802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 -- 172.21.15.136:0/2900246470 shutdown_connections 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 --2- 172.21.15.136:0/2900246470 >> v2:172.21.15.40:3300/0 conn(0x7f67180aefa0 0x7f671806e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 --2- 172.21.15.136:0/2900246470 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67180aea60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 -- 172.21.15.136:0/2900246470 >> 172.21.15.136:0/2900246470 conn(0x7f671806b520 msgr2=0x7f671806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 -- 172.21.15.136:0/2900246470 shutdown_connections 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.692+0000 7f6720355640 1 -- 172.21.15.136:0/2900246470 wait complete. 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 Processor -- start 2024-04-14T09:58:00.694 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 -- start start 2024-04-14T09:58:00.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.696 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67180aefa0 0x7f671815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f671815f5a0 0x7f6718134a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f671806e750 con 0x7f67180aefa0 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f671806e5d0 con 0x7f6718072340 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f6720355640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f671806e8d0 con 0x7f671815f5a0 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f671e0f1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f671e0f1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:53126/0 (socket says 172.21.15.136:53126) 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f671e0f1640 1 -- 172.21.15.136:0/2453589851 learned_addr learned my addr 172.21.15.136:0/2453589851 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f671e8f2640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f671815f5a0 0x7f6718134a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.694+0000 7f671d8f0640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67180aefa0 0x7f671815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 -- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f671815f5a0 msgr2=0x7f6718134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f671815f5a0 0x7f6718134a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 -- 172.21.15.136:0/2453589851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67180aefa0 msgr2=0x7f671815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67180aefa0 0x7f671815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.697 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 -- 172.21.15.136:0/2453589851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6718154900 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f671e0f1640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f671400c460 tx=0x7f671400c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714018070 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6714007500 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6718158fb0 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6714004a20 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6718159570 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f671401b070 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.695+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f6714012a60 con 0x7f6718072340 2024-04-14T09:58:00.698 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.696+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67180756f0 con 0x7f6718072340 2024-04-14T09:58:00.699 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.698+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6718154900 con 0x7f6718072340 2024-04-14T09:58:00.770 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.770+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be6b3d90-9d7a-4bc8-a101-1a0bb50b1226", "id": 7} v 0) -- 0x7f6718072c40 con 0x7f6718072340 2024-04-14T09:58:00.775 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.775+0000 7f670effd640 1 -- 172.21.15.136:0/2453589851 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be6b3d90-9d7a-4bc8-a101-1a0bb50b1226", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f671401d440 con 0x7f6718072340 2024-04-14T09:58:00.775 INFO:teuthology.orchestra.run.smithi136.stdout:7 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 msgr2=0x7f67181543c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f671400c460 tx=0x7f671400c920 comp rx=0 tx=0).stop 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 shutdown_connections 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f671815f5a0 0x7f6718134a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f67180aefa0 0x7f671815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.776 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 --2- 172.21.15.136:0/2453589851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6718072340 0x7f67181543c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 >> 172.21.15.136:0/2453589851 conn(0x7f671806b520 msgr2=0x7f6718157960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 shutdown_connections 2024-04-14T09:58:00.777 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:58:00.776+0000 7f6720355640 1 -- 172.21.15.136:0/2453589851 wait complete. 2024-04-14T09:58:00.780 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.780+0000 7f3eecfbb040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T09:58:00.786 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-14T09:58:00.786 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-14T09:58:00.788 INFO:tasks.ceph.osd.0:Started 2024-04-14T09:58:00.789 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-14T09:58:00.789 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-14T09:58:00.792 INFO:tasks.ceph.osd.1:Started 2024-04-14T09:58:00.792 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-14T09:58:00.793 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-14T09:58:00.794 INFO:tasks.ceph.osd.2:Started 2024-04-14T09:58:00.795 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-14T09:58:00.795 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-14T09:58:00.797 INFO:tasks.ceph.osd.3:Started 2024-04-14T09:58:00.797 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-14T09:58:00.797 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-14T09:58:00.799 INFO:tasks.ceph.osd.4:Started 2024-04-14T09:58:00.799 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-14T09:58:00.799 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-14T09:58:00.801 INFO:tasks.ceph.osd.5:Started 2024-04-14T09:58:00.802 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-14T09:58:00.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-14T09:58:00.804 INFO:tasks.ceph.osd.6:Started 2024-04-14T09:58:00.804 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-14T09:58:00.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-14T09:58:00.806 INFO:tasks.ceph.osd.7:Started 2024-04-14T09:58:00.806 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:00.832 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.831+0000 7fd7da673040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-14T09:58:00.934 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.934+0000 7f3eecfbb040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T09:58:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.940+0000 7f05cf460640 1 Processor -- start 2024-04-14T09:58:00.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.940+0000 7f05cf460640 1 -- start start 2024-04-14T09:58:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cf460640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cf460640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f05c80b4760 0x7f05c80d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cf460640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05c80b4c70 con 0x7f05c80d2cb0 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cf460640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f05c80b5880 con 0x7f05c80b4760 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cf460640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f05c80b4f50 con 0x7f05c815e650 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cd9fd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f05c80d2cb0 0x7f05c81622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53182/0 (socket says 172.21.15.40:53182) 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cd9fd640 1 -- 172.21.15.40:0/3355083124 learned_addr learned my addr 172.21.15.40:0/3355083124 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cc9fb640 1 --2- 172.21.15.40:0/3355083124 >> v2:172.21.15.136:3300/0 conn(0x7f05c80b4760 0x7f05c80d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3355083124 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05bffff640 1 -- 172.21.15.40:0/3355083124 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3446223013 0 0) 0x7f05c80b4c70 con 0x7f05c80d2cb0 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.941+0000 7f05bffff640 1 -- 172.21.15.40:0/3355083124 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05b4003520 con 0x7f05c80d2cb0 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.942+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3355083124 >> v2:172.21.15.136:3300/0 conn(0x7f05c80b4760 msgr2=0x7f05c80d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.942+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3355083124 >> v2:172.21.15.136:3300/0 conn(0x7f05c80b4760 0x7f05c80d2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.942+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3355083124 >> v1:172.21.15.40:6789/0 conn(0x7f05c80d2cb0 legacy=0x7f05c81622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.942+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3355083124 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c80b5230 con 0x7f05c815e650 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.942+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3355083124 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b4220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=424662012c8021de server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05bffff640 1 -- 172.21.15.40:0/3355083124 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8035020 con 0x7f05c815e650 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05bffff640 1 -- 172.21.15.40:0/3355083124 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b8031830 con 0x7f05c815e650 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05bffff640 1 -- 172.21.15.40:0/3355083124 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8031c00 con 0x7f05c815e650 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 -- 172.21.15.40:0/3355083124 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 msgr2=0x7f05c80b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 --2- 172.21.15.40:0/3355083124 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b4220 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 -- 172.21.15.40:0/3355083124 shutdown_connections 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 --2- 172.21.15.40:0/3355083124 >> v2:172.21.15.136:3300/0 conn(0x7f05c80b4760 0x7f05c80d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 --2- 172.21.15.40:0/3355083124 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b4220 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 -- 172.21.15.40:0/3355083124 >> 172.21.15.40:0/3355083124 conn(0x7f05c809d580 msgr2=0x7f05c80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 -- 172.21.15.40:0/3355083124 shutdown_connections 2024-04-14T09:58:00.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.943+0000 7f05cf460640 1 -- 172.21.15.40:0/3355083124 wait complete. 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.944+0000 7f05cf460640 1 Processor -- start 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 -- start start 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c80d2cb0 0x7f05c815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05c815ea30 con 0x7f05c80b4760 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05c80d2270 con 0x7f05c80d2cb0 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cf460640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f05c815ebb0 con 0x7f05c815e650 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cd1fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cd1fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58554/0 (socket says 172.21.15.40:58554) 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3290588607 learned_addr learned my addr 172.21.15.40:0/3290588607 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:00.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cd9fd640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.945+0000 7f05cc9fb640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c80d2cb0 0x7f05c815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 msgr2=0x7f05c80b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c80d2cb0 msgr2=0x7f05c815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c80d2cb0 0x7f05c815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 -- 172.21.15.40:0/3290588607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05c80c8940 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cd1fc640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05b80098c0 tx=0x7f05b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b8048070 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05b803a6f0 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05c815b080 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05b803aae0 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05c80a19b0 con 0x7f05c80b4760 2024-04-14T09:58:00.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f05b804b070 con 0x7f05c80b4760 2024-04-14T09:58:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.946+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f05b8043ae0 con 0x7f05c80b4760 2024-04-14T09:58:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.948+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05c80756f0 con 0x7f05c80b4760 2024-04-14T09:58:00.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:00.950+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f05b80317b0 con 0x7f05c80b4760 2024-04-14T09:58:00.966 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:00.965+0000 7fd7da673040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-14T09:58:00.979 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:00.980+0000 7f3eecfbb040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T09:58:01.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.012+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05c80d1aa0 con 0x7f05c80b4760 2024-04-14T09:58:01.013 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.012+0000 7fd7da673040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-14T09:58:01.013 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.012+0000 7f05bdffb640 1 -- 172.21.15.40:0/3290588607 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f05b804d440 con 0x7f05c80b4760 2024-04-14T09:58:01.014 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:01.014 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":10,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:00.771862+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 msgr2=0x7f05c80c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f05b80098c0 tx=0x7f05b80046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 shutdown_connections 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05c815e650 0x7f05c80b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05c80d2cb0 0x7f05c815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 --2- 172.21.15.40:0/3290588607 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f05c80b4760 0x7f05c80c8240 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 >> 172.21.15.40:0/3290588607 conn(0x7f05c809d580 msgr2=0x7f05c80d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 shutdown_connections 2024-04-14T09:58:01.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:01.013+0000 7f05cf460640 1 -- 172.21.15.40:0/3290588607 wait complete. 2024-04-14T09:58:01.024 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-14T09:58:01.024 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-14T09:58:01.090 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:01.090+0000 7f3eecfbb040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T09:58:01.129 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.128+0000 7fd7da673040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-14T09:58:01.183 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:01.183+0000 7f3eecfbb040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T09:58:01.226 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.225+0000 7fd7da673040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-14T09:58:01.334 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:01.334+0000 7f3eecfbb040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T09:58:01.375 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:01.375+0000 7f3eecfbb040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T09:58:01.385 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.384+0000 7fd7da673040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-14T09:58:01.396 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-14T09:58:01.396+0000 7fbb7e2f5640 -1 Falling back to public interface 2024-04-14T09:58:01.399 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-04-14T09:58:01.399+0000 7f4733a24640 -1 Falling back to public interface 2024-04-14T09:58:01.408 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-04-14T09:58:01.408+0000 7f445c61a640 -1 Falling back to public interface 2024-04-14T09:58:01.416 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-14T09:58:01.415+0000 7f0f3c69d640 -1 Falling back to public interface 2024-04-14T09:58:01.427 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-14T09:58:01.423+0000 7f4ed0011640 -1 Falling back to public interface 2024-04-14T09:58:01.427 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-14T09:58:01.423+0000 7f5d36b49640 -1 Falling back to public interface 2024-04-14T09:58:01.431 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.431+0000 7fd7da673040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-14T09:58:01.432 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-14T09:58:01.432+0000 7f345c00f640 -1 Falling back to public interface 2024-04-14T09:58:01.437 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-04-14T09:58:01.437+0000 7fdf2ea0d640 -1 Falling back to public interface 2024-04-14T09:58:01.531 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:01.531+0000 7f3eecfbb040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T09:58:01.592 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:01.591+0000 7fd7da673040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-14T09:58:01.830 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:01.920 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.919+0000 7f1c8e19c640 1 Processor -- start 2024-04-14T09:58:01.920 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 -- start start 2024-04-14T09:58:01.921 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c8806b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c8806ba00 0x7f1c8806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c8806e390 con 0x7f1c8815e410 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1c8806be70 con 0x7f1c8806ba00 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c8e19c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1c88162830 con 0x7f1c880708e0 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c87fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1c8806ba00 0x7f1c8806eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c877fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1c8815e410 0x7f1c88162000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:53186/0 (socket says 172.21.15.40:53186) 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.920+0000 7f1c877fe640 1 -- 172.21.15.40:0/3106113490 learned_addr learned my addr 172.21.15.40:0/3106113490 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c86ffd640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c8806b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c87fff640 1 -- 172.21.15.40:0/3106113490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 msgr2=0x7f1c8806b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c87fff640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c8806b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.922 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c87fff640 1 -- 172.21.15.40:0/3106113490 >> v1:172.21.15.40:6789/0 conn(0x7f1c8815e410 legacy=0x7f1c88162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.923 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c87fff640 1 -- 172.21.15.40:0/3106113490 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c88162b10 con 0x7f1c8806ba00 2024-04-14T09:58:01.924 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.921+0000 7f1c87fff640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c8806eb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009d90 tx=0x7f1c8002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8d6b60d4d61824 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:01.924 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c867fc640 1 -- 172.21.15.40:0/3106113490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80039070 con 0x7f1c8806ba00 2024-04-14T09:58:01.924 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c867fc640 1 -- 172.21.15.40:0/3106113490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c8002cc50 con 0x7f1c8806ba00 2024-04-14T09:58:01.924 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c867fc640 1 -- 172.21.15.40:0/3106113490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c80034440 con 0x7f1c8806ba00 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3106113490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 msgr2=0x7f1c8806eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c8806eb70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009d90 tx=0x7f1c8002bea0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3106113490 shutdown_connections 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c8806eb70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3106113490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c8806b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3106113490 >> 172.21.15.40:0/3106113490 conn(0x7f1c880b2a20 msgr2=0x7f1c880b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3106113490 shutdown_connections 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.922+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3106113490 wait complete. 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.923+0000 7f1c8e19c640 1 Processor -- start 2024-04-14T09:58:01.925 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 -- start start 2024-04-14T09:58:01.927 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:01.927 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c880b61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c8815e410 0x7f1c880c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8815e7f0 con 0x7f1c8806ba00 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8806e650 con 0x7f1c8815e410 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c8e19c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1c880c5a90 con 0x7f1c880708e0 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c877fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58580/0 (socket says 172.21.15.40:58580) 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c877fe640 1 -- 172.21.15.40:0/3881178575 learned_addr learned my addr 172.21.15.40:0/3881178575 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.924+0000 7f1c86ffd640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c880b61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c87fff640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c8815e410 0x7f1c880c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 -- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 msgr2=0x7f1c880b61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c880b61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 -- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c8815e410 msgr2=0x7f1c880c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.928 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c8815e410 0x7f1c880c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 -- 172.21.15.40:0/3881178575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880c5d70 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c877fe640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c400 tx=0x7f1c7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c78017070 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c78005ce0 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c880c6050 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c780072f0 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c880c6610 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c7801a070 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.925+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f1c78007490 con 0x7f1c8806ba00 2024-04-14T09:58:01.929 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.926+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c880750e0 con 0x7f1c8806ba00 2024-04-14T09:58:01.930 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.928+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f1c78021020 con 0x7f1c8806ba00 2024-04-14T09:58:01.991 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.991+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1c880b6eb0 con 0x7f1c8806ba00 2024-04-14T09:58:01.992 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.991+0000 7f1c7ffff640 1 -- 172.21.15.40:0/3881178575 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f1c7801c440 con 0x7f1c8806ba00 2024-04-14T09:58:01.992 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-14T09:58:01.992 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":10,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:00.771862+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:01.993 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 msgr2=0x7f1c880c6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:01.993 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c7800c400 tx=0x7f1c7800c8c0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.993 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 shutdown_connections 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1c8815e410 0x7f1c880c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1c880708e0 0x7f1c880b61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 --2- 172.21.15.40:0/3881178575 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1c8806ba00 0x7f1c880c6df0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 >> 172.21.15.40:0/3881178575 conn(0x7f1c880b2a20 msgr2=0x7f1c880722e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 shutdown_connections 2024-04-14T09:58:01.994 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:01.992+0000 7f1c8e19c640 1 -- 172.21.15.40:0/3881178575 wait complete. 2024-04-14T09:58:02.002 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T09:58:02.351 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:02.351+0000 7f3eecfbb040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T09:58:02.436 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:02.437+0000 7fd7da673040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-14T09:58:02.629 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:02.629+0000 7f3eecfbb040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T09:58:02.679 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:02.679+0000 7f3eecfbb040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T09:58:02.722 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:02.723+0000 7fd7da673040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-14T09:58:02.775 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:02.775+0000 7fd7da673040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-14T09:58:02.791 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:02.791+0000 7f3eecfbb040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T09:58:02.894 INFO:tasks.ceph.mgr.y.smithi040.stderr:2024-04-14T09:58:02.895+0000 7fd7da673040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-14T09:58:03.805 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:03.805+0000 7f3e8c637640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-14T09:58:03.808 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-04-14T09:58:03.809+0000 7f3e8c637640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-14T09:58:04.858 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-14T09:58:04.859+0000 7fbb7e2f5640 -1 osd.0 0 log_to_monitors true 2024-04-14T09:58:04.902 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-14T09:58:04.902+0000 7f0f3c69d640 -1 osd.1 0 log_to_monitors true 2024-04-14T09:58:04.910 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-04-14T09:58:04.910+0000 7f4733a24640 -1 osd.4 0 log_to_monitors true 2024-04-14T09:58:04.932 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-14T09:58:04.933+0000 7f5d36b49640 -1 osd.3 0 log_to_monitors true 2024-04-14T09:58:04.938 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-14T09:58:04.939+0000 7f4ed0011640 -1 osd.2 0 log_to_monitors true 2024-04-14T09:58:04.957 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-04-14T09:58:04.958+0000 7f445c61a640 -1 osd.6 0 log_to_monitors true 2024-04-14T09:58:04.972 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-04-14T09:58:04.972+0000 7fdf2ea0d640 -1 osd.7 0 log_to_monitors true 2024-04-14T09:58:04.981 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-14T09:58:04.982+0000 7f345c00f640 -1 osd.5 0 log_to_monitors true 2024-04-14T09:58:08.302 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-14T09:58:08.301+0000 7f34575f7640 -1 osd.5 0 waiting for initial osdmap 2024-04-14T09:58:08.324 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-04-14T09:58:08.325+0000 7f344f480640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.326 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-04-14T09:58:08.327+0000 7f44585f8640 -1 osd.6 0 waiting for initial osdmap 2024-04-14T09:58:08.333 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-04-14T09:58:08.333+0000 7f472f5f7640 -1 osd.4 0 waiting for initial osdmap 2024-04-14T09:58:08.335 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-04-14T09:58:08.335+0000 7fdf2a5f7640 -1 osd.7 0 waiting for initial osdmap 2024-04-14T09:58:08.339 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-04-14T09:58:08.340+0000 7f444fc28640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.348 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-04-14T09:58:08.349+0000 7fdf22480640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.349 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-04-14T09:58:08.349+0000 7f47275d6640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.810 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:08.885 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-14T09:58:08.885+0000 7fbb7a7f8640 -1 osd.0 0 waiting for initial osdmap 2024-04-14T09:58:08.901 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-14T09:58:08.901+0000 7f4ecb5f7640 -1 osd.2 0 waiting for initial osdmap 2024-04-14T09:58:08.905 INFO:tasks.ceph.osd.0.smithi040.stderr:2024-04-14T09:58:08.905+0000 7fbb71e80640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.913 INFO:tasks.ceph.osd.2.smithi040.stderr:2024-04-14T09:58:08.914+0000 7f4ec3480640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.922 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-14T09:58:08.922+0000 7f0f383f7640 -1 osd.1 0 waiting for initial osdmap 2024-04-14T09:58:08.930 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-14T09:58:08.930+0000 7f5d327f7640 -1 osd.3 0 waiting for initial osdmap 2024-04-14T09:58:08.935 INFO:tasks.ceph.osd.1.smithi040.stderr:2024-04-14T09:58:08.936+0000 7f0f30228640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.939 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.939+0000 7f5032dfe640 1 Processor -- start 2024-04-14T09:58:08.939 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.939+0000 7f5032dfe640 1 -- start start 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f5032dfe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f502c06fbe0 0x7f502c06e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f5032dfe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f502c0afb40 0x7f502c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f5032dfe640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f502c15e9e0 con 0x7f502c15e600 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f5032dfe640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f502c06ec50 con 0x7f502c06fbe0 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f5032dfe640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f502c06ef30 con 0x7f502c0afb40 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f502c06fbe0 0x7f502c06e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f502c06fbe0 0x7f502c06e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39496/0 (socket says 172.21.15.40:39496) 2024-04-14T09:58:08.942 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 -- 172.21.15.40:0/1381128221 learned_addr learned my addr 172.21.15.40:0/1381128221 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f503139b640 1 --2- 172.21.15.40:0/1381128221 >> v2:172.21.15.136:3300/0 conn(0x7f502c0afb40 0x7f502c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 -- 172.21.15.40:0/1381128221 >> v2:172.21.15.136:3300/0 conn(0x7f502c0afb40 msgr2=0x7f502c0b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 --2- 172.21.15.40:0/1381128221 >> v2:172.21.15.136:3300/0 conn(0x7f502c0afb40 0x7f502c0b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 -- 172.21.15.40:0/1381128221 >> v1:172.21.15.136:6789/0 conn(0x7f502c15e600 legacy=0x7f502c06f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.940+0000 7f502bfff640 1 -- 172.21.15.40:0/1381128221 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c06f210 con 0x7f502c06fbe0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.941+0000 7f502bfff640 1 --2- 172.21.15.40:0/1381128221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c06e5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f502c0676d0 tx=0x7f501802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48689c66f6473ba5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.941+0000 7f502b7fe640 1 -- 172.21.15.40:0/1381128221 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f501803b070 con 0x7f502c06fbe0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.941+0000 7f502b7fe640 1 -- 172.21.15.40:0/1381128221 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5018036440 con 0x7f502c06fbe0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.941+0000 7f502b7fe640 1 -- 172.21.15.40:0/1381128221 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018036810 con 0x7f502c06fbe0 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 -- 172.21.15.40:0/1381128221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 msgr2=0x7f502c06e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:08.943 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 --2- 172.21.15.40:0/1381128221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c06e5e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f502c0676d0 tx=0x7f501802e0e0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 -- 172.21.15.40:0/1381128221 shutdown_connections 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 --2- 172.21.15.40:0/1381128221 >> v2:172.21.15.136:3300/0 conn(0x7f502c0afb40 0x7f502c0b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 --2- 172.21.15.40:0/1381128221 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c06e5e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 -- 172.21.15.40:0/1381128221 >> 172.21.15.40:0/1381128221 conn(0x7f502c0d0850 msgr2=0x7f502c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 -- 172.21.15.40:0/1381128221 shutdown_connections 2024-04-14T09:58:08.944 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.942+0000 7f5032dfe640 1 -- 172.21.15.40:0/1381128221 wait complete. 2024-04-14T09:58:08.945 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.943+0000 7f5032dfe640 1 Processor -- start 2024-04-14T09:58:08.945 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.943+0000 7f5032dfe640 1 -- start start 2024-04-14T09:58:08.945 INFO:tasks.ceph.osd.3.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5d2a680640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-14T09:58:08.948 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.948 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f502c0afb40 0x7f502c153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.948 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f502c15e600 0x7f502c153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.948 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0affb0 con 0x7f502c06fbe0 2024-04-14T09:58:08.948 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f502c0b3940 con 0x7f502c15e600 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5032dfe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f502c0b43a0 con 0x7f502c0afb40 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39500/0 (socket says 172.21.15.40:39500) 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 -- 172.21.15.40:0/3755131677 learned_addr learned my addr 172.21.15.40:0/3755131677 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f502bfff640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f502c0afb40 0x7f502c153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f503139b640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f502c15e600 0x7f502c153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 -- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f502c0afb40 msgr2=0x7f502c153340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f502c0afb40 0x7f502c153340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 -- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f502c15e600 msgr2=0x7f502c153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f502c15e600 0x7f502c153880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 -- 172.21.15.40:0/3755131677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f502c1f35f0 con 0x7f502c06fbe0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f5030b9a640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f502000c3c0 tx=0x7f502000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.944+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50200052d0 con 0x7f502c06fbe0 2024-04-14T09:58:08.949 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.945+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5020005490 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.945+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f502c156680 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.945+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5020007260 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.945+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f502c1f3b70 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.945+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f502c0750e0 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.946+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f5020007400 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.946+0000 7f50297fa640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 0x7f501006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.946+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f502008a0f0 con 0x7f502c06fbe0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.946+0000 7f502bfff640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 0x7f501006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:08.950 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.947+0000 7f502bfff640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 0x7f501006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5018038000 tx=0x7f5018032000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:08.951 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:08.951+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5020058d40 con 0x7f502c06fbe0 2024-04-14T09:58:09.136 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.136+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f502c06e4b0 con 0x7f502c06fbe0 2024-04-14T09:58:09.137 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.137+0000 7f50297fa640 1 -- 172.21.15.40:0/3755131677 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f502005d040 con 0x7f502c06fbe0 2024-04-14T09:58:09.137 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-14T09:58:09.137 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":12,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:06.812954+0000","last_up_change":"0.000000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 msgr2=0x7f501006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 0x7f501006ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5018038000 tx=0x7f5018032000 comp rx=0 tx=0).stop 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 msgr2=0x7f502c14dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f502000c3c0 tx=0x7f502000c880 comp rx=0 tx=0).stop 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 shutdown_connections 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f501006c860 0x7f501006ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:09.139 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f502c15e600 0x7f502c153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:09.140 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f502c0afb40 0x7f502c153340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:09.140 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 --2- 172.21.15.40:0/3755131677 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f502c06fbe0 0x7f502c14dab0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:09.140 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 >> 172.21.15.40:0/3755131677 conn(0x7f502c0d0850 msgr2=0x7f502c0b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:09.140 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 shutdown_connections 2024-04-14T09:58:09.140 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:09.139+0000 7f5032dfe640 1 -- 172.21.15.40:0/3755131677 wait complete. 2024-04-14T09:58:09.148 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-14T09:58:15.954 DEBUG:teuthology.orchestra.run.smithi040:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:16.056 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.056+0000 7f97663e0640 1 Processor -- start 2024-04-14T09:58:16.056 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.056+0000 7f97663e0640 1 -- start start 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f97663e0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9760072a80 0x7f97600cc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f97663e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f976015ec00 con 0x7f976015b240 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f97663e0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f976015eee0 con 0x7f976015b620 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f97663e0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f976015f810 con 0x7f9760072a80 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f975ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f976015b240 0x7f9760072370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33976/0 (socket says 172.21.15.40:33976) 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f975ffff640 1 -- 172.21.15.40:0/114591428 learned_addr learned my addr 172.21.15.40:0/114591428 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.057+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375560368 0 0) 0x7f976015ec00 con 0x7f976015b240 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f974c003520 con 0x7f976015b240 2024-04-14T09:58:16.059 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975f7fe640 1 --2- 172.21.15.40:0/114591428 >> v2:172.21.15.136:3300/0 conn(0x7f9760072a80 0x7f97600cc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281338697 0 0) 0x7f974c003520 con 0x7f976015b240 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 >> v2:172.21.15.136:3300/0 conn(0x7f9760072a80 msgr2=0x7f97600cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 --2- 172.21.15.40:0/114591428 >> v2:172.21.15.136:3300/0 conn(0x7f9760072a80 0x7f97600cc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 >> v1:172.21.15.136:6789/0 conn(0x7f976015b620 legacy=0x7f97600ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f976015f1c0 con 0x7f976015b240 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f9750001670 con 0x7f976015b240 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 >> v1:172.21.15.40:6789/0 conn(0x7f976015b240 legacy=0x7f9760072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 0x7f974c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f974c004800 0x7f974c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0051c0 0x7f974c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f976015f810 con 0x7f974c0039b0 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f974c00c060 con 0x7f974c0051c0 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f974c00c260 con 0x7f974c004800 2024-04-14T09:58:16.060 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 0x7f974c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f976497d640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0051c0 0x7f974c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975f7fe640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f974c004800 0x7f974c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 -- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f974c004800 msgr2=0x7f974c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f974c004800 0x7f974c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 -- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0051c0 msgr2=0x7f974c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0051c0 0x7f974c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f976497d640 1 -- 172.21.15.40:0/114591428 reap_dead start 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975ffff640 1 -- 172.21.15.40:0/114591428 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c003520 con 0x7f974c0039b0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.058+0000 7f975f7fe640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f974c004800 0x7f974c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.059+0000 7f975ffff640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 0x7f974c003dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9750007fc0 tx=0x7f974c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c533beb4fb8f1a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.059+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9750007d10 con 0x7f974c0039b0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.059+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9750032070 con 0x7f974c0039b0 2024-04-14T09:58:16.061 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.059+0000 7f975effd640 1 -- 172.21.15.40:0/114591428 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97500058d0 con 0x7f974c0039b0 2024-04-14T09:58:16.064 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 -- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 msgr2=0x7f974c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.064 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 0x7f974c003dd0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9750007fc0 tx=0x7f974c005830 comp rx=0 tx=0).stop 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 -- 172.21.15.40:0/114591428 shutdown_connections 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 --2- 172.21.15.40:0/114591428 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f974c0039b0 0x7f974c003dd0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 -- 172.21.15.40:0/114591428 >> 172.21.15.40:0/114591428 conn(0x7f97600b2a20 msgr2=0x7f97600b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 -- 172.21.15.40:0/114591428 shutdown_connections 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.060+0000 7f97663e0640 1 -- 172.21.15.40:0/114591428 wait complete. 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.061+0000 7f97663e0640 1 Processor -- start 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.061+0000 7f97663e0640 1 -- start start 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 0x7f976015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97601587a0 0x7f976006f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f97600724f0 con 0x7f9760153680 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9760072370 con 0x7f974c0039b0 2024-04-14T09:58:16.065 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f97663e0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9760072670 con 0x7f97601587a0 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39524/0 (socket says 172.21.15.40:39524) 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 -- 172.21.15.40:0/255816057 learned_addr learned my addr 172.21.15.40:0/255816057 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f976497d640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97601587a0 0x7f976006f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 -- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97601587a0 msgr2=0x7f976006f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97601587a0 0x7f976006f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 -- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 msgr2=0x7f976015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975ffff640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 0x7f976015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 0x7f976015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975f7fe640 1 -- 172.21.15.40:0/255816057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9760153b00 con 0x7f9760153680 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.062+0000 7f975ffff640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 0x7f976015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f975f7fe640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97480114f0 tx=0x7f97480119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748015870 con 0x7f9760153680 2024-04-14T09:58:16.066 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9748015a10 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f976006ee40 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748015e20 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.063+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f976006f400 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.064+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97600750e0 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.064+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f974801d400 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.065+0000 7f975cff9640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.065+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f974808bf80 con 0x7f9760153680 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.065+0000 7f975ffff640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.067 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.065+0000 7f975ffff640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 0x7f974006ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9750036000 tx=0x7f9750009030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.069 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.070+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9748019030 con 0x7f9760153680 2024-04-14T09:58:16.254 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.254+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97600cc590 con 0x7f9760153680 2024-04-14T09:58:16.255 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.255+0000 7f975cff9640 1 -- 172.21.15.40:0/255816057 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f974805a790 con 0x7f9760153680 2024-04-14T09:58:16.255 INFO:teuthology.misc.health.smithi040.stdout: 2024-04-14T09:58:16.255 INFO:teuthology.misc.health.smithi040.stdout:{"epoch":17,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:13.323560+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 msgr2=0x7f974006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 0x7f974006ede0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9750036000 tx=0x7f9750009030 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 msgr2=0x7f9760158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f97480114f0 tx=0x7f97480119b0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 shutdown_connections 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f974006c920 0x7f974006ede0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97601587a0 0x7f976006f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9760153680 0x7f9760158260 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 --2- 172.21.15.40:0/255816057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f974c0039b0 0x7f976015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 >> 172.21.15.40:0/255816057 conn(0x7f97600b2a20 msgr2=0x7f97600b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 shutdown_connections 2024-04-14T09:58:16.257 INFO:teuthology.misc.health.smithi040.stderr:2024-04-14T09:58:16.257+0000 7f97663e0640 1 -- 172.21.15.40:0/255816057 wait complete. 2024-04-14T09:58:16.266 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-14T09:58:16.266 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-14T09:58:16.267 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T09:58:16.267 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T09:58:16.269 INFO:tasks.ceph.mds.a:Started 2024-04-14T09:58:16.269 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T09:58:16.269 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T09:58:16.271 INFO:tasks.ceph.mds.c:Started 2024-04-14T09:58:16.271 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T09:58:16.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T09:58:16.273 INFO:tasks.ceph.mds.b:Started 2024-04-14T09:58:16.273 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-14T09:58:16.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-14T09:58:16.275 INFO:tasks.ceph.mds.d:Started 2024-04-14T09:58:16.276 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-14T09:58:16.276 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:16.345 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-04-14T09:58:16.346 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-04-14T09:58:16.360 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-04-14T09:58:16.361 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-04-14T09:58:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.382+0000 7f399691e640 1 Processor -- start 2024-04-14T09:58:16.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.382+0000 7f399691e640 1 -- start start 2024-04-14T09:58:16.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f399691e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cf1c0 0x7f39900cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f399691e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39900cdb30 0x7f399006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f399691e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39900cf7c0 con 0x7f399015ebf0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f399691e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f39900cfaa0 con 0x7f39900cdb30 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f399691e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f39900cfd80 con 0x7f39900cf1c0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f398ffff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f399015ebf0 0x7f399015efd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:35730/0 (socket says 172.21.15.40:35730) 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f3994ebb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f39900cdb30 0x7f399006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f398ffff640 1 -- 172.21.15.40:0/2737533929 learned_addr learned my addr 172.21.15.40:0/2737533929 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f398f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cf1c0 0x7f39900cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f398effd640 1 -- 172.21.15.40:0/2737533929 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414774474 0 0) 0x7f39900cf7c0 con 0x7f399015ebf0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f398effd640 1 -- 172.21.15.40:0/2737533929 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f397c003520 con 0x7f399015ebf0 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f3994ebb640 1 -- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cf1c0 msgr2=0x7f39900cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.383+0000 7f3994ebb640 1 --2- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cf1c0 0x7f39900cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f3994ebb640 1 -- 172.21.15.40:0/2737533929 >> v1:172.21.15.136:6789/0 conn(0x7f399015ebf0 legacy=0x7f399015efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f3994ebb640 1 -- 172.21.15.40:0/2737533929 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39900d0060 con 0x7f39900cdb30 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f3994ebb640 1 --2- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39900cdb30 0x7f399006ddc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3988009d90 tx=0x7f398802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be06a6645534e81 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f398effd640 1 -- 172.21.15.40:0/2737533929 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988039070 con 0x7f39900cdb30 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f398effd640 1 -- 172.21.15.40:0/2737533929 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398802cc50 con 0x7f39900cdb30 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.384+0000 7f398effd640 1 -- 172.21.15.40:0/2737533929 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3988034440 con 0x7f39900cdb30 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 -- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39900cdb30 msgr2=0x7f399006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 --2- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39900cdb30 0x7f399006ddc0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3988009d90 tx=0x7f398802bea0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 -- 172.21.15.40:0/2737533929 shutdown_connections 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 --2- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f39900cdb30 0x7f399006ddc0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 --2- 172.21.15.40:0/2737533929 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cf1c0 0x7f39900cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 -- 172.21.15.40:0/2737533929 >> 172.21.15.40:0/2737533929 conn(0x7f399006b520 msgr2=0x7f399006b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 -- 172.21.15.40:0/2737533929 shutdown_connections 2024-04-14T09:58:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.385+0000 7f399691e640 1 -- 172.21.15.40:0/2737533929 wait complete. 2024-04-14T09:58:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.386+0000 7f399691e640 1 Processor -- start 2024-04-14T09:58:16.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.386+0000 7f399691e640 1 -- start start 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cdb30 0x7f39901f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 0x7f39900ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f399006e300 con 0x7f39900cf1c0 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f39900aff10 con 0x7f399015ebf0 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f399691e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f399006e480 con 0x7f39900cdb30 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39566/0 (socket says 172.21.15.40:39566) 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 -- 172.21.15.40:0/1950448347 learned_addr learned my addr 172.21.15.40:0/1950448347 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398ffff640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cdb30 0x7f39901f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f3994ebb640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 0x7f39900ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 -- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cdb30 msgr2=0x7f39901f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cdb30 0x7f39901f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 -- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 msgr2=0x7f39900ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 0x7f39900ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f398f7fe640 1 -- 172.21.15.40:0/1950448347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3990155b20 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.387+0000 7f3994ebb640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 0x7f39900ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f398f7fe640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f398000e9b0 tx=0x7f398000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980017070 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398000c9a0 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398000cd90 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3990155e00 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.388+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39900adb60 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.389+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39900756f0 con 0x7f39900cf1c0 2024-04-14T09:58:16.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.389+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f398001a070 con 0x7f39900cf1c0 2024-04-14T09:58:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.390+0000 7f398cff9640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 0x7f397006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.390+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f398008b850 con 0x7f39900cf1c0 2024-04-14T09:58:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.390+0000 7f398ffff640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 0x7f397006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.390+0000 7f398ffff640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 0x7f397006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39780011e0 tx=0x7f3978007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.394+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3980059900 con 0x7f39900cf1c0 2024-04-14T09:58:16.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.578+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f39900b3960 con 0x7f39900cf1c0 2024-04-14T09:58:16.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.579+0000 7f398cff9640 1 -- 172.21.15.40:0/1950448347 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f398005dc00 con 0x7f39900cf1c0 2024-04-14T09:58:16.578 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:16.578 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:13.323560+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 msgr2=0x7f397006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 0x7f397006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f39780011e0 tx=0x7f3978007d30 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 msgr2=0x7f39901404b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f398000e9b0 tx=0x7f398000ee70 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 shutdown_connections 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f397006c8f0 0x7f397006edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f399015ebf0 0x7f39900ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f39900cf1c0 0x7f39901404b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 --2- 172.21.15.40:0/1950448347 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f39900cdb30 0x7f39901f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 >> 172.21.15.40:0/1950448347 conn(0x7f399006b520 msgr2=0x7f399015a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 shutdown_connections 2024-04-14T09:58:16.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.581+0000 7f399691e640 1 -- 172.21.15.40:0/1950448347 wait complete. 2024-04-14T09:58:16.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T09:58:16.591 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.695+0000 7f4cd91a3640 1 Processor -- start 2024-04-14T09:58:16.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.695+0000 7f4cd91a3640 1 -- start start 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd91a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd40c7e30 0x7f4cd40d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd91a3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4cd415e7b0 0x7f4cd40d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd91a3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd40d2f30 con 0x7f4cd415e3d0 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd91a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd40cf000 con 0x7f4cd40c7e30 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd91a3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd40cf2e0 con 0x7f4cd415e7b0 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd40c7e30 0x7f4cd40d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd40c7e30 0x7f4cd40d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57670/0 (socket says 172.21.15.40:57670) 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 -- 172.21.15.40:0/2511531825 learned_addr learned my addr 172.21.15.40:0/2511531825 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd359e640 1 --2- 172.21.15.40:0/2511531825 >> v2:172.21.15.136:3300/0 conn(0x7f4cd415e7b0 0x7f4cd40d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 -- 172.21.15.40:0/2511531825 >> v2:172.21.15.136:3300/0 conn(0x7f4cd415e7b0 msgr2=0x7f4cd40d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 --2- 172.21.15.40:0/2511531825 >> v2:172.21.15.136:3300/0 conn(0x7f4cd415e7b0 0x7f4cd40d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 -- 172.21.15.40:0/2511531825 >> v1:172.21.15.136:6789/0 conn(0x7f4cd415e3d0 legacy=0x7f4cd40d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.696+0000 7f4cd259c640 1 -- 172.21.15.40:0/2511531825 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd40cf5c0 con 0x7f4cd40c7e30 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.697+0000 7f4cd259c640 1 --2- 172.21.15.40:0/2511531825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd40c7e30 0x7f4cd40d2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40ba340 tx=0x7f4cbc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0ae58382996573 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.697+0000 7f4cd1d9b640 1 -- 172.21.15.40:0/2511531825 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc034070 con 0x7f4cd40c7e30 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.697+0000 7f4cd1d9b640 1 -- 172.21.15.40:0/2511531825 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc030860 con 0x7f4cd40c7e30 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.697+0000 7f4cd1d9b640 1 -- 172.21.15.40:0/2511531825 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc030c30 con 0x7f4cd40c7e30 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 -- 172.21.15.40:0/2511531825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd40c7e30 msgr2=0x7f4cd40d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/2511531825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd40c7e30 0x7f4cd40d2170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4cd40ba340 tx=0x7f4cbc02b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 -- 172.21.15.40:0/2511531825 shutdown_connections 2024-04-14T09:58:16.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/2511531825 >> v2:172.21.15.136:3300/0 conn(0x7f4cd415e7b0 0x7f4cd40d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/2511531825 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd40c7e30 0x7f4cd40d2170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 -- 172.21.15.40:0/2511531825 >> 172.21.15.40:0/2511531825 conn(0x7f4cd408dc90 msgr2=0x7f4cd409d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 -- 172.21.15.40:0/2511531825 shutdown_connections 2024-04-14T09:58:16.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.698+0000 7f4cd91a3640 1 -- 172.21.15.40:0/2511531825 wait complete. 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.699+0000 7f4cd91a3640 1 Processor -- start 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.699+0000 7f4cd91a3640 1 -- start start 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd40c7e30 0x7f4cd4160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd415e7b0 0x7f4cd414cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40d3390 con 0x7f4cd415e3d0 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd40d3210 con 0x7f4cd415e7b0 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd91a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd40d4740 con 0x7f4cd40c7e30 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57684/0 (socket says 172.21.15.40:57684) 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 -- 172.21.15.40:0/3313497596 learned_addr learned my addr 172.21.15.40:0/3313497596 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd2d9d640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd40c7e30 0x7f4cd4160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd359e640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd415e7b0 0x7f4cd414cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 -- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd40c7e30 msgr2=0x7f4cd4160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd40c7e30 0x7f4cd4160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 -- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd415e7b0 msgr2=0x7f4cd414cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd415e7b0 0x7f4cd414cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 -- 172.21.15.40:0/3313497596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd4160fe0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.700+0000 7f4cd259c640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000c00 tx=0x7f4cbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.701+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc048070 con 0x7f4cd415e3d0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.701+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cbc030660 con 0x7f4cd415e3d0 2024-04-14T09:58:16.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.701+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd41612c0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.701+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cbc034040 con 0x7f4cd415e3d0 2024-04-14T09:58:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.701+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd414a6a0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.702+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd4075760 con 0x7f4cd415e3d0 2024-04-14T09:58:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.702+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cbc04b070 con 0x7f4cd415e3d0 2024-04-14T09:58:16.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.702+0000 7f4ccb7fe640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 0x7f4cb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.702+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4cbc0ad710 con 0x7f4cd415e3d0 2024-04-14T09:58:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.703+0000 7f4cd2d9d640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 0x7f4cb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:16.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.703+0000 7f4cd2d9d640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 0x7f4cb406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc001780 tx=0x7f4ccc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:16.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.707+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4cbc07b8d0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.889+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cd4161ea0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.889+0000 7f4ccb7fe640 1 -- 172.21.15.40:0/3313497596 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f4cbc0820f0 con 0x7f4cd415e3d0 2024-04-14T09:58:16.889 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:16.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 msgr2=0x7f4cb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 0x7f4cb406edb0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc001780 tx=0x7f4ccc009040 comp rx=0 tx=0).stop 2024-04-14T09:58:16.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 msgr2=0x7f4cd414c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:16.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc000c00 tx=0x7f4cbc004730 comp rx=0 tx=0).stop 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 shutdown_connections 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb406c8f0 0x7f4cb406edb0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd415e7b0 0x7f4cd414cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd415e3d0 0x7f4cd414c690 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 --2- 172.21.15.40:0/3313497596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd40c7e30 0x7f4cd4160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 >> 172.21.15.40:0/3313497596 conn(0x7f4cd408dc90 msgr2=0x7f4cd40cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 shutdown_connections 2024-04-14T09:58:16.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:16.891+0000 7f4cd91a3640 1 -- 172.21.15.40:0/3313497596 wait complete. 2024-04-14T09:58:16.902 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.003+0000 7f4eb5e80640 1 Processor -- start 2024-04-14T09:58:17.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.003+0000 7f4eb5e80640 1 -- start start 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eb5e80640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4eb015e650 0x7f4eb00b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eb5e80640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb00b4c70 con 0x7f4eb00d2e80 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eb5e80640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb00b4f50 con 0x7f4eb00b4760 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eb5e80640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4eb00b5880 con 0x7f4eb015e650 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4eb015e650 0x7f4eb00b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4eb00d2e80 0x7f4eb00cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44862/0 (socket says 172.21.15.40:44862) 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaffff640 1 -- 172.21.15.40:0/3482096187 learned_addr learned my addr 172.21.15.40:0/3482096187 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:17.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/3482096187 >> v1:172.21.15.136:6789/0 conn(0x7f4eb00b4760 legacy=0x7f4eb00d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/3482096187 >> v1:172.21.15.40:6789/0 conn(0x7f4eb00d2e80 legacy=0x7f4eb00cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eae7fc640 1 -- 172.21.15.40:0/3482096187 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3152940735 0 0) 0x7f4eb00b4c70 con 0x7f4eb00d2e80 2024-04-14T09:58:17.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.004+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/3482096187 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00b5230 con 0x7f4eb015e650 2024-04-14T09:58:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.005+0000 7f4eaf7fe640 1 --2- 172.21.15.40:0/3482096187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb015e650 0x7f4eb00b4220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097a0 tx=0x7f4ea002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c2c24bffbabc8b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.005+0000 7f4eae7fc640 1 -- 172.21.15.40:0/3482096187 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0035020 con 0x7f4eb015e650 2024-04-14T09:58:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.005+0000 7f4eae7fc640 1 -- 172.21.15.40:0/3482096187 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea0031830 con 0x7f4eb015e650 2024-04-14T09:58:17.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.005+0000 7f4eae7fc640 1 -- 172.21.15.40:0/3482096187 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0031c00 con 0x7f4eb015e650 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 -- 172.21.15.40:0/3482096187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb015e650 msgr2=0x7f4eb00b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/3482096187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb015e650 0x7f4eb00b4220 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097a0 tx=0x7f4ea002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 -- 172.21.15.40:0/3482096187 shutdown_connections 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/3482096187 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb015e650 0x7f4eb00b4220 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 -- 172.21.15.40:0/3482096187 >> 172.21.15.40:0/3482096187 conn(0x7f4eb009d580 msgr2=0x7f4eb00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 -- 172.21.15.40:0/3482096187 shutdown_connections 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.006+0000 7f4eb5e80640 1 -- 172.21.15.40:0/3482096187 wait complete. 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.007+0000 7f4eb5e80640 1 Processor -- start 2024-04-14T09:58:17.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.007+0000 7f4eb5e80640 1 -- start start 2024-04-14T09:58:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 0x7f4eb014c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4eb015e650 0x7f4eb00b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:17.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb015ea30 con 0x7f4eb00b4760 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb00d2270 con 0x7f4eb015e650 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb015ebb0 con 0x7f4eb00d2e80 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57704/0 (socket says 172.21.15.40:57704) 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/880528859 learned_addr learned my addr 172.21.15.40:0/880528859 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaffff640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4eb015e650 0x7f4eb00b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaeffd640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 0x7f4eb014c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 msgr2=0x7f4eb014c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 0x7f4eb014c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4eb015e650 msgr2=0x7f4eb00b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4eb015e650 0x7f4eb00b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 -- 172.21.15.40:0/880528859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb00c8bd0 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaeffd640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 0x7f4eb014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eaf7fe640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097a0 tx=0x7f4ea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0004230 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea00043d0 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb00c8eb0 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.008+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea003cad0 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.009+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb00c9470 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.009+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb015d6e0 con 0x7f4eb00b4760 2024-04-14T09:58:17.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.010+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ea0038020 con 0x7f4eb00b4760 2024-04-14T09:58:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.010+0000 7f4e97fff640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 0x7f4e9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.010+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4ea00ada00 con 0x7f4eb00b4760 2024-04-14T09:58:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.010+0000 7f4eaeffd640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 0x7f4e9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:17.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.011+0000 7f4eaeffd640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 0x7f4e9c06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:17.014 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.015+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4ea0041070 con 0x7f4eb00b4760 2024-04-14T09:58:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.237+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4eb00756f0 con 0x7f4eb00b4760 2024-04-14T09:58:17.237 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.238+0000 7f4e97fff640 1 -- 172.21.15.40:0/880528859 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f4ea007c2a0 con 0x7f4eb00b4760 2024-04-14T09:58:17.238 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:17.238 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-14T09:58:17.238 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 2 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 msgr2=0x7f4e9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 0x7f4e9c06edb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4ea4006fd0 tx=0x7f4ea4008040 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 msgr2=0x7f4eb00ca6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097a0 tx=0x7f4ea00046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 shutdown_connections 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4e9c06c8f0 0x7f4e9c06edb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4eb015e650 0x7f4eb00b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4eb00d2e80 0x7f4eb014c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 --2- 172.21.15.40:0/880528859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4eb00b4760 0x7f4eb00ca6b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:17.240 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 >> 172.21.15.40:0/880528859 conn(0x7f4eb009d580 msgr2=0x7f4eb006d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 shutdown_connections 2024-04-14T09:58:17.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:17.240+0000 7f4eb5e80640 1 -- 172.21.15.40:0/880528859 wait complete. 2024-04-14T09:58:19.251 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:19.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.367+0000 7f6e6e1a3640 1 Processor -- start 2024-04-14T09:58:19.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.367+0000 7f6e6e1a3640 1 -- start start 2024-04-14T09:58:19.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e6e1a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e680d2770 0x7f6e680d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e6e1a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e680cf0a0 0x7f6e680cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e6e1a3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e680b4c70 con 0x7f6e6815e650 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e6e1a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6e680d3110 con 0x7f6e680cf0a0 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e6e1a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e680b5880 con 0x7f6e680d2770 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e67fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e680cf0a0 0x7f6e680cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e67fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e680cf0a0 0x7f6e680cf530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57710/0 (socket says 172.21.15.40:57710) 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.368+0000 7f6e67fff640 1 -- 172.21.15.40:0/3813568992 learned_addr learned my addr 172.21.15.40:0/3813568992 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e66ffd640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e680d2770 0x7f6e680d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e67fff640 1 -- 172.21.15.40:0/3813568992 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e680d2770 msgr2=0x7f6e680d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e67fff640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e680d2770 0x7f6e680d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e67fff640 1 -- 172.21.15.40:0/3813568992 >> v1:172.21.15.136:6789/0 conn(0x7f6e6815e650 legacy=0x7f6e680b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:19.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e67fff640 1 -- 172.21.15.40:0/3813568992 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e680b4f50 con 0x7f6e680cf0a0 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.369+0000 7f6e67fff640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680cf0a0 0x7f6e680cf530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009e50 tx=0x7f6e6002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc344c592a3a1c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e667fc640 1 -- 172.21.15.40:0/3813568992 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e6002cb00 con 0x7f6e680cf0a0 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e667fc640 1 -- 172.21.15.40:0/3813568992 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e6002cca0 con 0x7f6e680cf0a0 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e667fc640 1 -- 172.21.15.40:0/3813568992 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e60034610 con 0x7f6e680cf0a0 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/3813568992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680cf0a0 msgr2=0x7f6e680cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680cf0a0 0x7f6e680cf530 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009e50 tx=0x7f6e6002bf60 comp rx=0 tx=0).stop 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/3813568992 shutdown_connections 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680cf0a0 0x7f6e680cf530 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/3813568992 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e680d2770 0x7f6e680d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/3813568992 >> 172.21.15.40:0/3813568992 conn(0x7f6e6809d580 msgr2=0x7f6e680d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/3813568992 shutdown_connections 2024-04-14T09:58:19.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.370+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/3813568992 wait complete. 2024-04-14T09:58:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.371+0000 7f6e6e1a3640 1 Processor -- start 2024-04-14T09:58:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 -- start start 2024-04-14T09:58:19.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 0x7f6e681f7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e6815e650 0x7f6e680d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6e680b4930 con 0x7f6e680d2770 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6e680b5510 con 0x7f6e680cf0a0 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e6e1a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e680d2270 con 0x7f6e6815e650 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57718/0 (socket says 172.21.15.40:57718) 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e66ffd640 1 -- 172.21.15.40:0/1339838324 learned_addr learned my addr 172.21.15.40:0/1339838324 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.372+0000 7f6e67fff640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e6815e650 0x7f6e680d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e677fe640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 0x7f6e681f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 -- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e6815e650 msgr2=0x7f6e680d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e6815e650 0x7f6e680d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 -- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 msgr2=0x7f6e681f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 0x7f6e681f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 -- 172.21.15.40:0/1339838324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e681f7d90 con 0x7f6e680d2770 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e677fe640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 0x7f6e681f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e66ffd640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00d5f0 tx=0x7f6e5c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0125f0 con 0x7f6e680d2770 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e5c019070 con 0x7f6e680d2770 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e6809fc50 con 0x7f6e680d2770 2024-04-14T09:58:19.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c0129d0 con 0x7f6e680d2770 2024-04-14T09:58:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.373+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e680a0210 con 0x7f6e680d2770 2024-04-14T09:58:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.374+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e680756f0 con 0x7f6e680d2770 2024-04-14T09:58:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.374+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e5c012b70 con 0x7f6e680d2770 2024-04-14T09:58:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.375+0000 7f6e4ffff640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.376 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.375+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6e5c08bb30 con 0x7f6e680d2770 2024-04-14T09:58:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.375+0000 7f6e677fe640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.377 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.376+0000 7f6e677fe640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 0x7f6e5406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e580015e0 tx=0x7f6e58009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.379 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.379+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6e5c05a340 con 0x7f6e680d2770 2024-04-14T09:58:19.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.603+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e680d3760 con 0x7f6e680d2770 2024-04-14T09:58:19.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.603+0000 7f6e4ffff640 1 -- 172.21.15.40:0/1339838324 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3867 (secure 0 0 0) 0x7f6e5c059c40 con 0x7f6e680d2770 2024-04-14T09:58:19.603 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:19.603 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-14T09:58:19.603 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 3 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 msgr2=0x7f6e5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 0x7f6e5406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6e580015e0 tx=0x7f6e58009040 comp rx=0 tx=0).stop 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 msgr2=0x7f6e680cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00d5f0 tx=0x7f6e5c00dab0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 shutdown_connections 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e5406c920 0x7f6e5406ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e6815e650 0x7f6e680d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e680d2770 0x7f6e680cfb80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 --2- 172.21.15.40:0/1339838324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e680cf0a0 0x7f6e681f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 >> 172.21.15.40:0/1339838324 conn(0x7f6e6809d580 msgr2=0x7f6e680d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:19.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 shutdown_connections 2024-04-14T09:58:19.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.605+0000 7f6e6e1a3640 1 -- 172.21.15.40:0/1339838324 wait complete. 2024-04-14T09:58:19.615 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.718+0000 7fdf2aa80640 1 Processor -- start 2024-04-14T09:58:19.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.718+0000 7fdf2aa80640 1 -- start start 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdf2415e510 0x7fdf240cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf240d2800 0x7fdf240d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf240d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240d31c0 con 0x7fdf240d2800 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdf240ceda0 con 0x7fdf2415e510 2024-04-14T09:58:19.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2aa80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdf240cf040 con 0x7fdf240d0e90 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf240d2800 0x7fdf240d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf240d2800 0x7fdf240d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57720/0 (socket says 172.21.15.40:57720) 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 -- 172.21.15.40:0/1812189534 learned_addr learned my addr 172.21.15.40:0/1812189534 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2881c640 1 --2- 172.21.15.40:0/1812189534 >> v2:172.21.15.136:3300/0 conn(0x7fdf2415e510 0x7fdf240cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 -- 172.21.15.40:0/1812189534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 msgr2=0x7fdf240d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf2901d640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf240d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf240d12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 -- 172.21.15.40:0/1812189534 >> v2:172.21.15.136:3300/0 conn(0x7fdf2415e510 msgr2=0x7fdf240cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 --2- 172.21.15.40:0/1812189534 >> v2:172.21.15.136:3300/0 conn(0x7fdf2415e510 0x7fdf240cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.719+0000 7fdf23fff640 1 -- 172.21.15.40:0/1812189534 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf240cf320 con 0x7fdf240d2800 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf23fff640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf240d2800 0x7fdf240d2c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf2408e0f0 tx=0x7fdf1002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8227142ba2a0a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf237fe640 1 -- 172.21.15.40:0/1812189534 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1002e070 con 0x7fdf240d2800 2024-04-14T09:58:19.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf237fe640 1 -- 172.21.15.40:0/1812189534 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf10037070 con 0x7fdf240d2800 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf237fe640 1 -- 172.21.15.40:0/1812189534 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10031a00 con 0x7fdf240d2800 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 -- 172.21.15.40:0/1812189534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf240d2800 msgr2=0x7fdf240d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf240d2800 0x7fdf240d2c80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdf2408e0f0 tx=0x7fdf1002b880 comp rx=0 tx=0).stop 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 -- 172.21.15.40:0/1812189534 shutdown_connections 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf240d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/1812189534 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf240d2800 0x7fdf240d2c80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/1812189534 >> v2:172.21.15.136:3300/0 conn(0x7fdf2415e510 0x7fdf240cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 -- 172.21.15.40:0/1812189534 >> 172.21.15.40:0/1812189534 conn(0x7fdf2409d570 msgr2=0x7fdf240d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 -- 172.21.15.40:0/1812189534 shutdown_connections 2024-04-14T09:58:19.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.720+0000 7fdf2aa80640 1 -- 172.21.15.40:0/1812189534 wait complete. 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 Processor -- start 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 -- start start 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf241f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 0x7fdf240ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf240d1820 con 0x7fdf2415e510 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2415e8f0 con 0x7fdf240d2800 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.722+0000 7fdf2aa80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdf240d19a0 con 0x7fdf240d0e90 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57734/0 (socket says 172.21.15.40:57734) 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 -- 172.21.15.40:0/2588418909 learned_addr learned my addr 172.21.15.40:0/2588418909 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf23fff640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 0x7fdf240ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2881c640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf241f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 -- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 msgr2=0x7fdf241f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf241f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 -- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 msgr2=0x7fdf240ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 0x7fdf240ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 -- 172.21.15.40:0/2588418909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf240b9d10 con 0x7fdf2415e510 2024-04-14T09:58:19.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2881c640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf241f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf23fff640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 0x7fdf240ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2901d640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00cbb0 tx=0x7fdf1c00a4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c015070 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf1c00abd0 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf240c96b0 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c00d040 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.723+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf240c9c70 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.724+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf240cd060 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.725+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf1c018070 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.725+0000 7fdf217fa640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 0x7fdf0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.725+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdf1c08b6b0 con 0x7fdf2415e510 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.725+0000 7fdf2881c640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 0x7fdf0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:19.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.726+0000 7fdf2881c640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 0x7fdf0806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf240cd3a0 tx=0x7fdf18008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:19.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.729+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdf1c059ec0 con 0x7fdf2415e510 2024-04-14T09:58:19.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.916+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf2406c4a0 con 0x7fdf2415e510 2024-04-14T09:58:19.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.917+0000 7fdf217fa640 1 -- 172.21.15.40:0/2588418909 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7fdf1c0597c0 con 0x7fdf2415e510 2024-04-14T09:58:19.917 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:19.917 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:13.323560+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 msgr2=0x7fdf0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 0x7fdf0806edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fdf240cd3a0 tx=0x7fdf18008040 comp rx=0 tx=0).stop 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 msgr2=0x7fdf240b97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00cbb0 tx=0x7fdf1c00a4c0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 shutdown_connections 2024-04-14T09:58:19.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf0806c8f0 0x7fdf0806edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf2415e510 0x7fdf240b97d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf240d2800 0x7fdf240ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 --2- 172.21.15.40:0/2588418909 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf240d0e90 0x7fdf241f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 >> 172.21.15.40:0/2588418909 conn(0x7fdf2409d570 msgr2=0x7fdf2415eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 shutdown_connections 2024-04-14T09:58:19.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:19.919+0000 7fdf2aa80640 1 -- 172.21.15.40:0/2588418909 wait complete. 2024-04-14T09:58:19.930 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T09:58:19.930 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:20.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.035+0000 7f4cdd5dc640 1 Processor -- start 2024-04-14T09:58:20.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.035+0000 7f4cdd5dc640 1 -- start start 2024-04-14T09:58:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cdd5dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 0x7f4cd80d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cdd5dc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd815e7b0 0x7f4cd80d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cdd5dc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cd80d2f30 con 0x7f4cd815e3d0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cdd5dc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4cd80cf000 con 0x7f4cd815e7b0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cdd5dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd80cf2e0 con 0x7f4cd80c7e30 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd815e7b0 0x7f4cd80d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cd815e7b0 0x7f4cd80d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57736/0 (socket says 172.21.15.40:57736) 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 -- 172.21.15.40:0/2973938369 learned_addr learned my addr 172.21.15.40:0/2973938369 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 0x7f4cd80d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 -- 172.21.15.40:0/2973938369 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 msgr2=0x7f4cd80d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 0x7f4cd80d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 -- 172.21.15.40:0/2973938369 >> v1:172.21.15.136:6789/0 conn(0x7f4cd815e3d0 legacy=0x7f4cd80d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4cd77fe640 1 -- 172.21.15.40:0/2973938369 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd80cf5c0 con 0x7f4cd815e7b0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.036+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 0x7f4cd80d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cd77fe640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd815e7b0 0x7f4cd80d26b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009e50 tx=0x7f4cd002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a49c49a79225fe server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cd67fc640 1 -- 172.21.15.40:0/2973938369 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd002ca70 con 0x7f4cd815e7b0 2024-04-14T09:58:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cd67fc640 1 -- 172.21.15.40:0/2973938369 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cd002cc10 con 0x7f4cd815e7b0 2024-04-14T09:58:20.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cd67fc640 1 -- 172.21.15.40:0/2973938369 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd00343f0 con 0x7f4cd815e7b0 2024-04-14T09:58:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2973938369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd815e7b0 msgr2=0x7f4cd80d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd815e7b0 0x7f4cd80d26b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4cd0009e50 tx=0x7f4cd002bed0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2973938369 shutdown_connections 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd815e7b0 0x7f4cd80d26b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2973938369 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd80c7e30 0x7f4cd80d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.037+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2973938369 >> 172.21.15.40:0/2973938369 conn(0x7f4cd808dc90 msgr2=0x7f4cd809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.038+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2973938369 shutdown_connections 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.038+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2973938369 wait complete. 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 Processor -- start 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 -- start start 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 0x7f4cd81e9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 0x7f4cd81e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd80d3390 con 0x7f4cd80c7e30 2024-04-14T09:58:20.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd80d3210 con 0x7f4cd815e7b0 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cdd5dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4cd80d4740 con 0x7f4cd815e3d0 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cd6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cd6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57742/0 (socket says 172.21.15.40:57742) 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.039+0000 7f4cd6ffd640 1 -- 172.21.15.40:0/2913730844 learned_addr learned my addr 172.21.15.40:0/2913730844 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 0x7f4cd81e9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 -- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 msgr2=0x7f4cd81e9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd77fe640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 0x7f4cd81e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 0x7f4cd81e9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 -- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 msgr2=0x7f4cd81e7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 0x7f4cd81e7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 -- 172.21.15.40:0/2913730844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cd80cc6a0 con 0x7f4cd80c7e30 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 0x7f4cd81e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:20.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd77fe640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 0x7f4cd81e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cd6ffd640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c430 tx=0x7f4cc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8011790 con 0x7f4cd80c7e30 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8017070 con 0x7f4cd80c7e30 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd80cc980 con 0x7f4cd80c7e30 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8011bb0 con 0x7f4cd80c7e30 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.040+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd80b86a0 con 0x7f4cd80c7e30 2024-04-14T09:58:20.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.041+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd8068e90 con 0x7f4cd80c7e30 2024-04-14T09:58:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.041+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4cc801c460 con 0x7f4cd80c7e30 2024-04-14T09:58:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.042+0000 7f4ccf7fe640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 0x7f4cb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.042+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4cc808b580 con 0x7f4cd80c7e30 2024-04-14T09:58:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.042+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 0x7f4cb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.042+0000 7f4ccffff640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 0x7f4cb806ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006fd0 tx=0x7f4cc0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.046+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4cd8068e90 con 0x7f4cd80c7e30 2024-04-14T09:58:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.231+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4cd8075760 con 0x7f4cd80c7e30 2024-04-14T09:58:20.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.232+0000 7f4ccf7fe640 1 -- 172.21.15.40:0/2913730844 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f4cc8059d90 con 0x7f4cd80c7e30 2024-04-14T09:58:20.231 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:20.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 msgr2=0x7f4cb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 0x7f4cb806ede0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0006fd0 tx=0x7f4cc0008040 comp rx=0 tx=0).stop 2024-04-14T09:58:20.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 msgr2=0x7f4cd8159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800c430 tx=0x7f4cc800c8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 shutdown_connections 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cb806c920 0x7f4cb806ede0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cd815e7b0 0x7f4cd81e7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cd815e3d0 0x7f4cd81e9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 --2- 172.21.15.40:0/2913730844 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cd80c7e30 0x7f4cd8159480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.233+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 >> 172.21.15.40:0/2913730844 conn(0x7f4cd808dc90 msgr2=0x7f4cd815c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.234+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 shutdown_connections 2024-04-14T09:58:20.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.234+0000 7f4cdd5dc640 1 -- 172.21.15.40:0/2913730844 wait complete. 2024-04-14T09:58:20.244 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T09:58:20.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 Processor -- start 2024-04-14T09:58:20.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 -- start start 2024-04-14T09:58:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80340b22d0 0x7f803415b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803415be10 0x7f80340ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f803415faf0 con 0x7f803413deb0 2024-04-14T09:58:20.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f803415ed30 con 0x7f80340b22d0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.345+0000 7f803a95e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f803415f010 con 0x7f803415be10 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f80337fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f80340b22d0 0x7f803415b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f8033fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f803413deb0 0x7f80340b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44866/0 (socket says 172.21.15.40:44866) 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f8033fff640 1 -- 172.21.15.40:0/1034164901 learned_addr learned my addr 172.21.15.40:0/1034164901 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f8038efb640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803415be10 0x7f80340ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f80337fe640 1 -- 172.21.15.40:0/1034164901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803415be10 msgr2=0x7f80340ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f80337fe640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803415be10 0x7f80340ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f80337fe640 1 -- 172.21.15.40:0/1034164901 >> v1:172.21.15.40:6789/0 conn(0x7f803413deb0 legacy=0x7f80340b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f80337fe640 1 -- 172.21.15.40:0/1034164901 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803415f2f0 con 0x7f80340b22d0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.346+0000 7f8032ffd640 1 -- 172.21.15.40:0/1034164901 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 319603711 0 0) 0x7f803415faf0 con 0x7f803413deb0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f80337fe640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f803415b8d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80280097a0 tx=0x7f802802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa7bbe5fba67863 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f8032ffd640 1 -- 172.21.15.40:0/1034164901 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028035020 con 0x7f80340b22d0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f8032ffd640 1 -- 172.21.15.40:0/1034164901 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8028031830 con 0x7f80340b22d0 2024-04-14T09:58:20.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f8032ffd640 1 -- 172.21.15.40:0/1034164901 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8028031c00 con 0x7f80340b22d0 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 -- 172.21.15.40:0/1034164901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 msgr2=0x7f803415b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f803415b8d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f80280097a0 tx=0x7f802802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 -- 172.21.15.40:0/1034164901 shutdown_connections 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803415be10 0x7f80340ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 --2- 172.21.15.40:0/1034164901 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f803415b8d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 -- 172.21.15.40:0/1034164901 >> 172.21.15.40:0/1034164901 conn(0x7f803406ebf0 msgr2=0x7f803406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 -- 172.21.15.40:0/1034164901 shutdown_connections 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.347+0000 7f803a95e640 1 -- 172.21.15.40:0/1034164901 wait complete. 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.348+0000 7f803a95e640 1 Processor -- start 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 -- start start 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803413deb0 0x7f80341f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 0x7f8034138f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f803415c420 con 0x7f80340b22d0 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f803415c2a0 con 0x7f803415be10 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f803a95e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f803413e290 con 0x7f803413deb0 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f8033fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f8033fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57762/0 (socket says 172.21.15.40:57762) 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f8033fff640 1 -- 172.21.15.40:0/1383892438 learned_addr learned my addr 172.21.15.40:0/1383892438 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:20.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.349+0000 7f80337fe640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803413deb0 0x7f80341f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8038efb640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 0x7f8034138f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 -- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803413deb0 msgr2=0x7f80341f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803413deb0 0x7f80341f3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 -- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 msgr2=0x7f8034138f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 0x7f8034138f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 -- 172.21.15.40:0/1383892438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80341f4680 con 0x7f80340b22d0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8038efb640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 0x7f8034138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8033fff640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f802400c4d0 tx=0x7f802400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024018070 con 0x7f80340b22d0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8024007500 con 0x7f80340b22d0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8024004a20 con 0x7f80340b22d0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80341f4960 con 0x7f80340b22d0 2024-04-14T09:58:20.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.350+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803413b820 con 0x7f80340b22d0 2024-04-14T09:58:20.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.351+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80340756f0 con 0x7f80340b22d0 2024-04-14T09:58:20.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.351+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f802401b070 con 0x7f80340b22d0 2024-04-14T09:58:20.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.352+0000 7f8030ff9640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 0x7f802006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.352+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f802408aa00 con 0x7f80340b22d0 2024-04-14T09:58:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.352+0000 7f80337fe640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 0x7f802006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.354 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.352+0000 7f80337fe640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 0x7f802006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8028036000 tx=0x7f8028008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.356+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8024058bc0 con 0x7f80340b22d0 2024-04-14T09:58:20.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.543+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f803406c210 con 0x7f80340b22d0 2024-04-14T09:58:20.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.543+0000 7f8030ff9640 1 -- 172.21.15.40:0/1383892438 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f802405cec0 con 0x7f80340b22d0 2024-04-14T09:58:20.543 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:20.543 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-04-14T09:58:20.543 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:58:20.544 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-04-14T09:58:20.544 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-04-14T09:58:20.544 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:58:20.544 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-04-14T09:58:20.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 msgr2=0x7f802006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 0x7f802006edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8028036000 tx=0x7f8028008030 comp rx=0 tx=0).stop 2024-04-14T09:58:20.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 msgr2=0x7f80340727b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f802400c4d0 tx=0x7f802400c990 comp rx=0 tx=0).stop 2024-04-14T09:58:20.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 shutdown_connections 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802006c8f0 0x7f802006edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803415be10 0x7f8034138f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803413deb0 0x7f80341f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 --2- 172.21.15.40:0/1383892438 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80340b22d0 0x7f80340727b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 >> 172.21.15.40:0/1383892438 conn(0x7f803406ebf0 msgr2=0x7f80340ced20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 shutdown_connections 2024-04-14T09:58:20.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.545+0000 7f803a95e640 1 -- 172.21.15.40:0/1383892438 wait complete. 2024-04-14T09:58:20.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T09:58:20.556 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T09:58:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.661+0000 7f541811e640 1 Processor -- start 2024-04-14T09:58:20.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 -- start start 2024-04-14T09:58:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54101414d0 0x7f541006b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5410162910 0x7f541006e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f541015ec60 con 0x7f541006ba60 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f541015f590 con 0x7f54101414d0 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f541811e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f541015ea00 con 0x7f5410162910 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f5415eba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54101414d0 0x7f541006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.662+0000 7f5415eba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54101414d0 0x7f541006b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57772/0 (socket says 172.21.15.40:57772) 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 -- 172.21.15.40:0/3637197164 learned_addr learned my addr 172.21.15.40:0/3637197164 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 -- 172.21.15.40:0/3637197164 >> v2:172.21.15.136:3300/0 conn(0x7f5410162910 msgr2=0x7f541006e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 --2- 172.21.15.40:0/3637197164 >> v2:172.21.15.136:3300/0 conn(0x7f5410162910 0x7f541006e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 -- 172.21.15.40:0/3637197164 >> v1:172.21.15.136:6789/0 conn(0x7f541006ba60 legacy=0x7f5410162200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:20.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 -- 172.21.15.40:0/3637197164 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541015ef40 con 0x7f54101414d0 2024-04-14T09:58:20.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.663+0000 7f5415eba640 1 --2- 172.21.15.40:0/3637197164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54101414d0 0x7f541006b520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f541015f710 tx=0x7f540c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b14334bca1f18f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f5414eb8640 1 -- 172.21.15.40:0/3637197164 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c035020 con 0x7f54101414d0 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f5414eb8640 1 -- 172.21.15.40:0/3637197164 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c031870 con 0x7f54101414d0 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f5414eb8640 1 -- 172.21.15.40:0/3637197164 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c031c40 con 0x7f54101414d0 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 -- 172.21.15.40:0/3637197164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54101414d0 msgr2=0x7f541006b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 --2- 172.21.15.40:0/3637197164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54101414d0 0x7f541006b520 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f541015f710 tx=0x7f540c02b910 comp rx=0 tx=0).stop 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 -- 172.21.15.40:0/3637197164 shutdown_connections 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 --2- 172.21.15.40:0/3637197164 >> v2:172.21.15.136:3300/0 conn(0x7f5410162910 0x7f541006e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 --2- 172.21.15.40:0/3637197164 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54101414d0 0x7f541006b520 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 -- 172.21.15.40:0/3637197164 >> 172.21.15.40:0/3637197164 conn(0x7f54100d0f10 msgr2=0x7f54100d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 -- 172.21.15.40:0/3637197164 shutdown_connections 2024-04-14T09:58:20.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.664+0000 7f541811e640 1 -- 172.21.15.40:0/3637197164 wait complete. 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.665+0000 7f541811e640 1 Processor -- start 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.665+0000 7f541811e640 1 -- start start 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54101414d0 0x7f54100aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5410162910 0x7f54100af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54100cec60 con 0x7f541006ba60 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f54100ceae0 con 0x7f5410162910 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f541811e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f541006ec00 con 0x7f54101414d0 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57784/0 (socket says 172.21.15.40:57784) 2024-04-14T09:58:20.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 -- 172.21.15.40:0/1459048850 learned_addr learned my addr 172.21.15.40:0/1459048850 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 -- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54101414d0 msgr2=0x7f54100aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54101414d0 0x7f54100aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 -- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5410162910 msgr2=0x7f54100af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f54166bb640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5410162910 0x7f54100af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5410162910 0x7f54100af1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.666+0000 7f5415eba640 1 -- 172.21.15.40:0/1459048850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54100b5c50 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f5415eba640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f540c02b950 tx=0x7f540c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c03ad60 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f540c0443f0 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54100b5f30 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f540c0447e0 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.667+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54100b64f0 con 0x7f541006ba60 2024-04-14T09:58:20.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.668+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54100705c0 con 0x7f541006ba60 2024-04-14T09:58:20.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.668+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f540c038020 con 0x7f541006ba60 2024-04-14T09:58:20.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.669+0000 7f54067fc640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 0x7f53f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:20.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.669+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f540c0adae0 con 0x7f541006ba60 2024-04-14T09:58:20.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.669+0000 7f54156b9640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 0x7f53f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:20.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.669+0000 7f54156b9640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 0x7f53f406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54101619b0 tx=0x7f5400007990 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:20.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.673+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f54100705c0 con 0x7f541006ba60 2024-04-14T09:58:20.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:20.859+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f54100757d0 con 0x7f541006ba60 2024-04-14T09:58:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.365+0000 7f54067fc640 1 -- 172.21.15.40:0/1459048850 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f540c03f070 con 0x7f541006ba60 2024-04-14T09:58:21.365 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 msgr2=0x7f53f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 0x7f53f406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f54101619b0 tx=0x7f5400007990 comp rx=0 tx=0).stop 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 msgr2=0x7f54100ae290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f540c02b950 tx=0x7f540c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 shutdown_connections 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f53f406c8f0 0x7f53f406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5410162910 0x7f54100af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54101414d0 0x7f54100aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 --2- 172.21.15.40:0/1459048850 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f541006ba60 0x7f54100ae290 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 >> 172.21.15.40:0/1459048850 conn(0x7f54100d0f10 msgr2=0x7f541015bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 shutdown_connections 2024-04-14T09:58:21.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.368+0000 7f541811e640 1 -- 172.21.15.40:0/1459048850 wait complete. 2024-04-14T09:58:21.383 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-14T09:58:21.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 Processor -- start 2024-04-14T09:58:21.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 -- start start 2024-04-14T09:58:21.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2e0c15e7b0 0x7f2e0c0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0c0d2f30 con 0x7f2e0c15e3d0 2024-04-14T09:58:21.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c0cf000 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.496+0000 7f2e121dc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2e0c0cf2e0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57792/0 (socket says 172.21.15.40:57792) 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 -- 172.21.15.40:0/2157138014 learned_addr learned my addr 172.21.15.40:0/2157138014 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0bfff640 1 --2- 172.21.15.40:0/2157138014 >> v2:172.21.15.136:3300/0 conn(0x7f2e0c15e7b0 0x7f2e0c0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 -- 172.21.15.40:0/2157138014 >> v2:172.21.15.136:3300/0 conn(0x7f2e0c15e7b0 msgr2=0x7f2e0c0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 --2- 172.21.15.40:0/2157138014 >> v2:172.21.15.136:3300/0 conn(0x7f2e0c15e7b0 0x7f2e0c0d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 -- 172.21.15.40:0/2157138014 >> v1:172.21.15.136:6789/0 conn(0x7f2e0c15e3d0 legacy=0x7f2e0c0d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.497+0000 7f2e0affd640 1 -- 172.21.15.40:0/2157138014 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c0cf5c0 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e0affd640 1 --2- 172.21.15.40:0/2157138014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ba340 tx=0x7f2e0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fcf304ad7d582e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e0a7fc640 1 -- 172.21.15.40:0/2157138014 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00035020 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e0a7fc640 1 -- 172.21.15.40:0/2157138014 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e00031870 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e0a7fc640 1 -- 172.21.15.40:0/2157138014 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e00031c40 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 -- 172.21.15.40:0/2157138014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c0c7e30 msgr2=0x7f2e0c0d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 --2- 172.21.15.40:0/2157138014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c0ba340 tx=0x7f2e0002b910 comp rx=0 tx=0).stop 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 -- 172.21.15.40:0/2157138014 shutdown_connections 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 --2- 172.21.15.40:0/2157138014 >> v2:172.21.15.136:3300/0 conn(0x7f2e0c15e7b0 0x7f2e0c0d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 --2- 172.21.15.40:0/2157138014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c0d2170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 -- 172.21.15.40:0/2157138014 >> 172.21.15.40:0/2157138014 conn(0x7f2e0c08dc90 msgr2=0x7f2e0c09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 -- 172.21.15.40:0/2157138014 shutdown_connections 2024-04-14T09:58:21.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.498+0000 7f2e121dc640 1 -- 172.21.15.40:0/2157138014 wait complete. 2024-04-14T09:58:21.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.499+0000 7f2e121dc640 1 Processor -- start 2024-04-14T09:58:21.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 -- start start 2024-04-14T09:58:21.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c161680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e0c15e3d0 0x7f2e0c1f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d3390 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d3210 con 0x7f2e0c0c7e30 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e121dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2e0c0d4740 con 0x7f2e0c15e3d0 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e0bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57808/0 (socket says 172.21.15.40:57808) 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.500+0000 7f2e0bfff640 1 -- 172.21.15.40:0/3240874066 learned_addr learned my addr 172.21.15.40:0/3240874066 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0b7fe640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c161680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0affd640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e0c15e3d0 0x7f2e0c1f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 -- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e0c15e3d0 msgr2=0x7f2e0c1f7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e0c15e3d0 0x7f2e0c1f7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 -- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e0c0c7e30 msgr2=0x7f2e0c161680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c161680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 -- 172.21.15.40:0/3240874066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e0c0cc750 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e0bfff640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007e60 tx=0x7f2e0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04014420 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e04019070 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e0c0cca30 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e04014820 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.501+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0c0ccff0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.502+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e0c0ce6a0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.503+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e040149c0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.503+0000 7f2df3fff640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 0x7f2df806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:21.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.503+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f2e0408bfa0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.503+0000 7f2e0b7fe640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 0x7f2df806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:21.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.504+0000 7f2e0b7fe640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 0x7f2df806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc004f60 tx=0x7f2dfc007e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:21.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.508+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2e0c0ce6a0 con 0x7f2e0c15e7b0 2024-04-14T09:58:21.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:21.692+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f2e0c161ce0 con 0x7f2e0c15e7b0 2024-04-14T09:58:22.357 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:58:22.360 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:58:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.368+0000 7f2df3fff640 1 -- 172.21.15.40:0/3240874066 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f2e04059ff0 con 0x7f2e0c15e7b0 2024-04-14T09:58:22.367 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.370+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 msgr2=0x7f2df806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.370+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 0x7f2df806edb0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc004f60 tx=0x7f2dfc007e30 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 msgr2=0x7f2e0c1f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e04007e60 tx=0x7f2e0400e4b0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 shutdown_connections 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2df806c8f0 0x7f2df806edb0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e0c15e7b0 0x7f2e0c1f8510 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e0c15e3d0 0x7f2e0c1f7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 --2- 172.21.15.40:0/3240874066 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e0c0c7e30 0x7f2e0c161680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 >> 172.21.15.40:0/3240874066 conn(0x7f2e0c08dc90 msgr2=0x7f2e0c15c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:22.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 shutdown_connections 2024-04-14T09:58:22.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.371+0000 7f2e121dc640 1 -- 172.21.15.40:0/3240874066 wait complete. 2024-04-14T09:58:22.400 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T09:58:22.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.582+0000 7f1dd0bbb640 1 Processor -- start 2024-04-14T09:58:22.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dd0bbb640 1 -- start start 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dd0bbb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dcc0d1860 0x7f1dcc169360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dd0bbb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc0cf7b0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dd0bbb640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc0cfa90 con 0x7f1dcc15e5d0 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dd0bbb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc15e9b0 con 0x7f1dcc0d1860 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dcad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dcc0d1860 0x7f1dcc169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dc3fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1dcc0d4170 0x7f1dcc0d4600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44872/0 (socket says 172.21.15.40:44872) 2024-04-14T09:58:22.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dcad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f1dcc0d1860 0x7f1dcc169360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57820/0 (socket says 172.21.15.40:57820) 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.583+0000 7f1dc3fff640 1 -- 172.21.15.40:0/2084167252 learned_addr learned my addr 172.21.15.40:0/2084167252 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.584+0000 7f1dcad9d640 1 -- 172.21.15.40:0/2084167252 >> v1:172.21.15.136:6789/0 conn(0x7f1dcc15e5d0 legacy=0x7f1dcc0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.584+0000 7f1dcad9d640 1 -- 172.21.15.40:0/2084167252 >> v1:172.21.15.40:6789/0 conn(0x7f1dcc0d4170 legacy=0x7f1dcc0d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.584+0000 7f1dc9d9b640 1 -- 172.21.15.40:0/2084167252 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1631711738 0 0) 0x7f1dcc0cf7b0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.584+0000 7f1dcad9d640 1 -- 172.21.15.40:0/2084167252 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0cfd70 con 0x7f1dcc0d1860 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.584+0000 7f1dcad9d640 1 --2- 172.21.15.40:0/2084167252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc169360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009d90 tx=0x7f1dc402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ddcb627d30ea79 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dc9d9b640 1 -- 172.21.15.40:0/2084167252 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4039070 con 0x7f1dcc0d1860 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dc9d9b640 1 -- 172.21.15.40:0/2084167252 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc402cd00 con 0x7f1dcc0d1860 2024-04-14T09:58:22.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dc9d9b640 1 -- 172.21.15.40:0/2084167252 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4034660 con 0x7f1dcc0d1860 2024-04-14T09:58:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2084167252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d1860 msgr2=0x7f1dcc169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2084167252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc169360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4009d90 tx=0x7f1dc402bf50 comp rx=0 tx=0).stop 2024-04-14T09:58:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2084167252 shutdown_connections 2024-04-14T09:58:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2084167252 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc169360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2084167252 >> 172.21.15.40:0/2084167252 conn(0x7f1dcc08dce0 msgr2=0x7f1dcc09d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2084167252 shutdown_connections 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.585+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2084167252 wait complete. 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 Processor -- start 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 -- start start 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc150f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 0x7f1dcc0b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cf3e0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d03c0 con 0x7f1dcc0d1860 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dd0bbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc0cf560 con 0x7f1dcc15e5d0 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dc3fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57828/0 (socket says 172.21.15.40:57828) 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.587+0000 7f1dc3fff640 1 -- 172.21.15.40:0/2957777553 learned_addr learned my addr 172.21.15.40:0/2957777553 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:22.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dca59c640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc150f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dcad9d640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 0x7f1dcc0b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 -- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 msgr2=0x7f1dcc0b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 0x7f1dcc0b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 -- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dcc0d1860 msgr2=0x7f1dcc150f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc150f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 -- 172.21.15.40:0/2957777553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc1514d0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dcad9d640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 0x7f1dcc0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc3fff640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c460 tx=0x7f1db400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4018070 con 0x7f1dcc0d4170 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db4007520 con 0x7f1dcc0d4170 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc14e940 con 0x7f1dcc0d4170 2024-04-14T09:58:22.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db4004a20 con 0x7f1dcc0d4170 2024-04-14T09:58:22.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.588+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc14f1e0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.589+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc14ed30 con 0x7f1dcc0d4170 2024-04-14T09:58:22.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.590+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1db401b070 con 0x7f1dcc0d4170 2024-04-14T09:58:22.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.590+0000 7f1dc2ffd640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 0x7f1dac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:22.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.590+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f1db408ae20 con 0x7f1dcc0d4170 2024-04-14T09:58:22.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.590+0000 7f1dca59c640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 0x7f1dac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:22.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.591+0000 7f1dca59c640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 0x7f1dac06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc000f60 tx=0x7f1dbc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:22.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.594+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1dcc1514d0 con 0x7f1dcc0d4170 2024-04-14T09:58:22.818 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:22.819+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1dcc075760 con 0x7f1dcc0d4170 2024-04-14T09:58:23.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.389+0000 7f1dc2ffd640 1 -- 172.21.15.40:0/2957777553 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1db4059340 con 0x7f1dcc0d4170 2024-04-14T09:58:23.389 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 2 and data pool 3 2024-04-14T09:58:23.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 msgr2=0x7f1dac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 0x7f1dac06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc000f60 tx=0x7f1dbc009040 comp rx=0 tx=0).stop 2024-04-14T09:58:23.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 msgr2=0x7f1dcc0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c460 tx=0x7f1db400c920 comp rx=0 tx=0).stop 2024-04-14T09:58:23.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 shutdown_connections 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1dac06c8f0 0x7f1dac06edb0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc000f60 tx=0x7f1dbc009040 comp rx=0 tx=0).stop 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dcc15e5d0 0x7f1dcc0b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1dcc0d4170 0x7f1dcc0b3230 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1db400c460 tx=0x7f1db400c920 comp rx=0 tx=0).stop 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 --2- 172.21.15.40:0/2957777553 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dcc0d1860 0x7f1dcc150f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.397+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 >> 172.21.15.40:0/2957777553 conn(0x7f1dcc08dce0 msgr2=0x7f1dcc0d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:23.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.399+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 shutdown_connections 2024-04-14T09:58:23.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.399+0000 7f1dd0bbb640 1 -- 172.21.15.40:0/2957777553 wait complete. 2024-04-14T09:58:23.423 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-14T09:58:23.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-14T09:58:23.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.535+0000 7ff601cf7640 1 Processor -- start 2024-04-14T09:58:23.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.535+0000 7ff601cf7640 1 -- start start 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15d3c0 0x7ff5fc06b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff601cf7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5fc06ba60 0x7ff5fc0b5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff601cf7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5fc15d820 con 0x7ff5fc15cfe0 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff601cf7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff5fc06bed0 con 0x7ff5fc06ba60 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff601cf7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc072420 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff5fc06ba60 0x7ff5fc0b5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff5fc15cfe0 0x7ff5fc0b3f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44884/0 (socket says 172.21.15.40:44884) 2024-04-14T09:58:23.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fb7fe640 1 -- 172.21.15.40:0/1836718913 learned_addr learned my addr 172.21.15.40:0/1836718913 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5faffd640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15d3c0 0x7ff5fc06b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fbfff640 1 -- 172.21.15.40:0/1836718913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15d3c0 msgr2=0x7ff5fc06b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fbfff640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15d3c0 0x7ff5fc06b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fbfff640 1 -- 172.21.15.40:0/1836718913 >> v1:172.21.15.40:6789/0 conn(0x7ff5fc15cfe0 legacy=0x7ff5fc0b3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fbfff640 1 -- 172.21.15.40:0/1836718913 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc0726c0 con 0x7ff5fc06ba60 2024-04-14T09:58:23.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.536+0000 7ff5fa7fc640 1 -- 172.21.15.40:0/1836718913 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793936714 0 0) 0x7ff5ec001110 con 0x7ff5fc15cfe0 2024-04-14T09:58:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.537+0000 7ff5fbfff640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc0b5ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009d90 tx=0x7ff5f402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2caca312c15a4bf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.537+0000 7ff5fa7fc640 1 -- 172.21.15.40:0/1836718913 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4039070 con 0x7ff5fc06ba60 2024-04-14T09:58:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.537+0000 7ff5fa7fc640 1 -- 172.21.15.40:0/1836718913 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f402cc50 con 0x7ff5fc06ba60 2024-04-14T09:58:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.537+0000 7ff5fa7fc640 1 -- 172.21.15.40:0/1836718913 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4034440 con 0x7ff5fc06ba60 2024-04-14T09:58:23.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 -- 172.21.15.40:0/1836718913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc06ba60 msgr2=0x7ff5fc0b5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc0b5ba0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009d90 tx=0x7ff5f402bea0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 -- 172.21.15.40:0/1836718913 shutdown_connections 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc0b5ba0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 --2- 172.21.15.40:0/1836718913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15d3c0 0x7ff5fc06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 -- 172.21.15.40:0/1836718913 >> 172.21.15.40:0/1836718913 conn(0x7ff5fc0d0f10 msgr2=0x7ff5fc0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 -- 172.21.15.40:0/1836718913 shutdown_connections 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.538+0000 7ff601cf7640 1 -- 172.21.15.40:0/1836718913 wait complete. 2024-04-14T09:58:23.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.539+0000 7ff601cf7640 1 Processor -- start 2024-04-14T09:58:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.539+0000 7ff601cf7640 1 -- start start 2024-04-14T09:58:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc13ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15cfe0 0x7ff5fc1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc072f60 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff5fc072c80 con 0x7ff5fc06ba60 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff601cf7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff5fc0b60e0 con 0x7ff5fc15cfe0 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57848/0 (socket says 172.21.15.40:57848) 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 -- 172.21.15.40:0/3661451829 learned_addr learned my addr 172.21.15.40:0/3661451829 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fb7fe640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc13ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5faffd640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15cfe0 0x7ff5fc1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 -- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15cfe0 msgr2=0x7ff5fc1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15cfe0 0x7ff5fc1537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 -- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5fc06ba60 msgr2=0x7ff5fc13ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:23.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc13ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 -- 172.21.15.40:0/3661451829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5fc153f40 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5fbfff640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009eb0 tx=0x7ff5f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.540+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4039050 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.541+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f4045070 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.541+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5fc154220 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.541+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f403e610 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.541+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5fc1547e0 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.542+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc0b3b50 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.542+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5f403e7b0 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.542+0000 7ff5e3fff640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 0x7ff5e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.543+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff5f40ae500 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.543+0000 7ff5fb7fe640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 0x7ff5e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:23.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.543+0000 7ff5fb7fe640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 0x7ff5e806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000f60 tx=0x7ff5ec007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:23.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.547+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff5fc0b3b50 con 0x7ff5fc15d3c0 2024-04-14T09:58:23.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:23.740+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff5fc0b4840 con 0x7ff5fc15d3c0 2024-04-14T09:58:24.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.393+0000 7ff5e3fff640 1 -- 172.21.15.40:0/3661451829 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7ff5f407c370 con 0x7ff5fc15d3c0 2024-04-14T09:58:24.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.395+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 msgr2=0x7ff5e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.395+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 0x7ff5e806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec000f60 tx=0x7ff5ec007b50 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.395+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 msgr2=0x7ff5fc06ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.395+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4009eb0 tx=0x7ff5f4004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 shutdown_connections 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5e806c8f0 0x7ff5e806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff5fc15d3c0 0x7ff5fc06ec40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff5fc15cfe0 0x7ff5fc1537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 --2- 172.21.15.40:0/3661451829 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff5fc06ba60 0x7ff5fc13ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 >> 172.21.15.40:0/3661451829 conn(0x7ff5fc0d0f10 msgr2=0x7ff5fc0b09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 shutdown_connections 2024-04-14T09:58:24.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.396+0000 7ff601cf7640 1 -- 172.21.15.40:0/3661451829 wait complete. 2024-04-14T09:58:24.408 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T09:58:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.523+0000 7fb689d1e640 1 Processor -- start 2024-04-14T09:58:24.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.523+0000 7fb689d1e640 1 -- start start 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb689d1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb68415e5c0 0x7fb6840cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb689d1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb6840d1e80 0x7fb6840d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb689d1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6840d2c60 con 0x7fb6840d2830 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb689d1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840cfeb0 con 0x7fb68415e5c0 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb689d1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb6840b3c40 con 0x7fb6840d1e80 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6837fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb68415e5c0 0x7fb6840cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb683fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb6840d2830 0x7fb6840d0b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:44898/0 (socket says 172.21.15.40:44898) 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb683fff640 1 -- 172.21.15.40:0/753697611 learned_addr learned my addr 172.21.15.40:0/753697611 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb682ffd640 1 --2- 172.21.15.40:0/753697611 >> v2:172.21.15.136:3300/0 conn(0x7fb6840d1e80 0x7fb6840d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6837fe640 1 -- 172.21.15.40:0/753697611 >> v2:172.21.15.136:3300/0 conn(0x7fb6840d1e80 msgr2=0x7fb6840d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6837fe640 1 --2- 172.21.15.40:0/753697611 >> v2:172.21.15.136:3300/0 conn(0x7fb6840d1e80 0x7fb6840d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6837fe640 1 -- 172.21.15.40:0/753697611 >> v1:172.21.15.40:6789/0 conn(0x7fb6840d2830 legacy=0x7fb6840d0b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6837fe640 1 -- 172.21.15.40:0/753697611 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840b3f20 con 0x7fb68415e5c0 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.524+0000 7fb6827fc640 1 -- 172.21.15.40:0/753697611 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299549430 0 0) 0x7fb6840d2c60 con 0x7fb6840d2830 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.525+0000 7fb6837fe640 1 --2- 172.21.15.40:0/753697611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68415e5c0 0x7fb6840cf8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb68408c900 tx=0x7fb67402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba6e659262236a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:24.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.525+0000 7fb6827fc640 1 -- 172.21.15.40:0/753697611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb674034070 con 0x7fb68415e5c0 2024-04-14T09:58:24.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.525+0000 7fb6827fc640 1 -- 172.21.15.40:0/753697611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb674030610 con 0x7fb68415e5c0 2024-04-14T09:58:24.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.525+0000 7fb6827fc640 1 -- 172.21.15.40:0/753697611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6740309e0 con 0x7fb68415e5c0 2024-04-14T09:58:24.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 -- 172.21.15.40:0/753697611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68415e5c0 msgr2=0x7fb6840cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 --2- 172.21.15.40:0/753697611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68415e5c0 0x7fb6840cf8d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb68408c900 tx=0x7fb67402b960 comp rx=0 tx=0).stop 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 -- 172.21.15.40:0/753697611 shutdown_connections 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 --2- 172.21.15.40:0/753697611 >> v2:172.21.15.136:3300/0 conn(0x7fb6840d1e80 0x7fb6840d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 --2- 172.21.15.40:0/753697611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb68415e5c0 0x7fb6840cf8d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 -- 172.21.15.40:0/753697611 >> 172.21.15.40:0/753697611 conn(0x7fb68409d580 msgr2=0x7fb6840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 -- 172.21.15.40:0/753697611 shutdown_connections 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.526+0000 7fb689d1e640 1 -- 172.21.15.40:0/753697611 wait complete. 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.527+0000 7fb689d1e640 1 Processor -- start 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.527+0000 7fb689d1e640 1 -- start start 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6840d1e80 0x7fb684153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb68415e5c0 0x7fb6841610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb6840d0190 con 0x7fb6840d2830 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb68415e9a0 con 0x7fb6840d1e80 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb689d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb6840b5730 con 0x7fb68415e5c0 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57874/0 (socket says 172.21.15.40:57874) 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 -- 172.21.15.40:0/3095976710 learned_addr learned my addr 172.21.15.40:0/3095976710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb6837fe640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6840d1e80 0x7fb684153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb683fff640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb68415e5c0 0x7fb6841610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 -- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb68415e5c0 msgr2=0x7fb6841610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb68415e5c0 0x7fb6841610e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 -- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6840d1e80 msgr2=0x7fb684153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6840d1e80 0x7fb684153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.528+0000 7fb682ffd640 1 -- 172.21.15.40:0/3095976710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6840cb5d0 con 0x7fb6840d2830 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb682ffd640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e9e0 tx=0x7fb67800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb678017070 con 0x7fb6840d2830 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb67800c9d0 con 0x7fb6840d2830 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb67800cdc0 con 0x7fb6840d2830 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6840cb840 con 0x7fb6840d2830 2024-04-14T09:58:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.529+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6840cbe00 con 0x7fb6840d2830 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.530+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6840756f0 con 0x7fb6840d2830 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.530+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb67801a070 con 0x7fb6840d2830 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.530+0000 7fb66bfff640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 0x7fb67006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.531+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fb67808bee0 con 0x7fb6840d2830 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.531+0000 7fb6837fe640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 0x7fb67006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:24.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.531+0000 7fb6837fe640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 0x7fb67006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb674036000 tx=0x7fb67403b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:24.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.535+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb678059c20 con 0x7fb6840d2830 2024-04-14T09:58:24.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:24.719+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb6840d4090 con 0x7fb6840d2830 2024-04-14T09:58:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.402+0000 7fb66bfff640 1 -- 172.21.15.40:0/3095976710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fb67805df20 con 0x7fb6840d2830 2024-04-14T09:58:26.402 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' created 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 msgr2=0x7fb67006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 0x7fb67006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb674036000 tx=0x7fb67403b040 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 msgr2=0x7fb6840c8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb67800e9e0 tx=0x7fb67800eea0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 shutdown_connections 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb67006c8f0 0x7fb67006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb68415e5c0 0x7fb6841610e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb6840d2830 0x7fb6840c8e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 --2- 172.21.15.40:0/3095976710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb6840d1e80 0x7fb684153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 >> 172.21.15.40:0/3095976710 conn(0x7fb68409d580 msgr2=0x7fb6840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:26.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 shutdown_connections 2024-04-14T09:58:26.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.406+0000 7fb689d1e640 1 -- 172.21.15.40:0/3095976710 wait complete. 2024-04-14T09:58:26.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-14T09:58:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.531+0000 7ff7ae236640 1 Processor -- start 2024-04-14T09:58:26.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 -- start start 2024-04-14T09:58:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7a80b0e70 0x7ff7a80d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a80d2dd0 0x7ff7a80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7a8161f20 con 0x7ff7a8161b40 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff7a80b4890 con 0x7ff7a80b0e70 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7ae236640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a80b3c80 con 0x7ff7a80d2dd0 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7a6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff7a80b0e70 0x7ff7a80d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7a77fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff7a8161b40 0x7ff7a80cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57562/0 (socket says 172.21.15.40:57562) 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.532+0000 7ff7a77fe640 1 -- 172.21.15.40:0/3105865505 learned_addr learned my addr 172.21.15.40:0/3105865505 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a7fff640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a80d2dd0 0x7ff7a80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/3105865505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a80d2dd0 msgr2=0x7ff7a80b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a80d2dd0 0x7ff7a80b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/3105865505 >> v1:172.21.15.40:6789/0 conn(0x7ff7a8161b40 legacy=0x7ff7a80cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a67fc640 1 -- 172.21.15.40:0/3105865505 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3594537723 0 0) 0x7ff7a8161f20 con 0x7ff7a8161b40 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.533+0000 7ff7a6ffd640 1 -- 172.21.15.40:0/3105865505 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a80b3f60 con 0x7ff7a80b0e70 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a80d2890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097d0 tx=0x7ff79c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106c93d9cf0b9d84 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:26.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7a67fc640 1 -- 172.21.15.40:0/3105865505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c035020 con 0x7ff7a80b0e70 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7a67fc640 1 -- 172.21.15.40:0/3105865505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff79c031800 con 0x7ff7a80b0e70 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7a67fc640 1 -- 172.21.15.40:0/3105865505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79c031bd0 con 0x7ff7a80b0e70 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 -- 172.21.15.40:0/3105865505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 msgr2=0x7ff7a80d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a80d2890 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0097d0 tx=0x7ff79c02b8a0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 -- 172.21.15.40:0/3105865505 shutdown_connections 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a80d2dd0 0x7ff7a80b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3105865505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a80d2890 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 -- 172.21.15.40:0/3105865505 >> 172.21.15.40:0/3105865505 conn(0x7ff7a809d580 msgr2=0x7ff7a80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 -- 172.21.15.40:0/3105865505 shutdown_connections 2024-04-14T09:58:26.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.534+0000 7ff7ae236640 1 -- 172.21.15.40:0/3105865505 wait complete. 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.535+0000 7ff7ae236640 1 Processor -- start 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 -- start start 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7a80d2dd0 0x7ff7a8159bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a8161b40 0x7ff7a80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80d2350 con 0x7ff7a80b0e70 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a80b4520 con 0x7ff7a80d2dd0 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7ae236640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a80d0070 con 0x7ff7a8161b40 2024-04-14T09:58:26.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7a77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42168/0 (socket says 172.21.15.40:42168) 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7a77fe640 1 -- 172.21.15.40:0/3339599082 learned_addr learned my addr 172.21.15.40:0/3339599082 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.536+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7a80d2dd0 0x7ff7a8159bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a7fff640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a8161b40 0x7ff7a80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 -- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a8161b40 msgr2=0x7ff7a80cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a8161b40 0x7ff7a80cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 -- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7a80d2dd0 msgr2=0x7ff7a8159bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7a80d2dd0 0x7ff7a8159bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 -- 172.21.15.40:0/3339599082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a815a450 con 0x7ff7a80b0e70 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7a77fe640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c500 tx=0x7ff79800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:26.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798018070 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff798007580 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a815a730 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798004a20 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.537+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a815acf0 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.538+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a80757d0 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.538+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff79801b070 con 0x7ff7a80b0e70 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.539+0000 7ff78ffff640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 0x7ff79406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:26.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.539+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7ff79808b090 con 0x7ff7a80b0e70 2024-04-14T09:58:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.539+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 0x7ff79406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.540+0000 7ff7a6ffd640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 0x7ff79406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff79c036000 tx=0x7ff79c03c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:26.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.544+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff798058be0 con 0x7ff7a80b0e70 2024-04-14T09:58:26.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:26.726+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff7a806da40 con 0x7ff7a80b0e70 2024-04-14T09:58:27.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.407+0000 7ff78ffff640 1 -- 172.21.15.40:0/3339599082 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7ff79805cee0 con 0x7ff7a80b0e70 2024-04-14T09:58:27.407 INFO:teuthology.orchestra.run.smithi040.stderr:set pool 4 allow_ec_overwrites to true 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 msgr2=0x7ff79406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 0x7ff79406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff79c036000 tx=0x7ff79c03c040 comp rx=0 tx=0).stop 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 msgr2=0x7ff7a8159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff79800c500 tx=0x7ff79800c9c0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 shutdown_connections 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff79406c8f0 0x7ff79406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7a8161b40 0x7ff7a80cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7a80d2dd0 0x7ff7a8159bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 --2- 172.21.15.40:0/3339599082 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff7a80b0e70 0x7ff7a8159690 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 >> 172.21.15.40:0/3339599082 conn(0x7ff7a809d580 msgr2=0x7ff7a815f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:27.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 shutdown_connections 2024-04-14T09:58:27.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.410+0000 7ff7ae236640 1 -- 172.21.15.40:0/3339599082 wait complete. 2024-04-14T09:58:27.437 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-14T09:58:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.545+0000 7f6297d1e640 1 Processor -- start 2024-04-14T09:58:27.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.545+0000 7f6297d1e640 1 -- start start 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6290162bb0 0x7f62900cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f62900d0c80 0x7f62900d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f62900d1610 con 0x7f6290162bb0 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f62900d5000 con 0x7f62900d0c80 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6297d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f62900cf0d0 con 0x7f6290161ca0 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62952b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6290162bb0 0x7f62900cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62952b9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6290162bb0 0x7f62900cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42172/0 (socket says 172.21.15.40:42172) 2024-04-14T09:58:27.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62952b9640 1 -- 172.21.15.40:0/528889685 learned_addr learned my addr 172.21.15.40:0/528889685 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62962bb640 1 --2- 172.21.15.40:0/528889685 >> v2:172.21.15.136:3300/0 conn(0x7f62900d0c80 0x7f62900d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f6295aba640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62952b9640 1 -- 172.21.15.40:0/528889685 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 msgr2=0x7f62900d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.546+0000 7f62952b9640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f62952b9640 1 -- 172.21.15.40:0/528889685 >> v2:172.21.15.136:3300/0 conn(0x7f62900d0c80 msgr2=0x7f62900d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f62952b9640 1 --2- 172.21.15.40:0/528889685 >> v2:172.21.15.136:3300/0 conn(0x7f62900d0c80 0x7f62900d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f62952b9640 1 -- 172.21.15.40:0/528889685 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62900cf3b0 con 0x7f6290162bb0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f62952b9640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6290162bb0 0x7f62900cfbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f629008ce10 tx=0x7f628402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f49819be8927b998 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f6294ab8640 1 -- 172.21.15.40:0/528889685 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f628402e070 con 0x7f6290162bb0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f6294ab8640 1 -- 172.21.15.40:0/528889685 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6284037070 con 0x7f6290162bb0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.547+0000 7f6294ab8640 1 -- 172.21.15.40:0/528889685 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6284031a00 con 0x7f6290162bb0 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 -- 172.21.15.40:0/528889685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6290162bb0 msgr2=0x7f62900cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6290162bb0 0x7f62900cfbb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f629008ce10 tx=0x7f628402b880 comp rx=0 tx=0).stop 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 -- 172.21.15.40:0/528889685 shutdown_connections 2024-04-14T09:58:27.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 --2- 172.21.15.40:0/528889685 >> v2:172.21.15.136:3300/0 conn(0x7f62900d0c80 0x7f62900d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6290162bb0 0x7f62900cfbb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 --2- 172.21.15.40:0/528889685 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 -- 172.21.15.40:0/528889685 >> 172.21.15.40:0/528889685 conn(0x7f629009d5c0 msgr2=0x7f62900d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 -- 172.21.15.40:0/528889685 shutdown_connections 2024-04-14T09:58:27.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.548+0000 7f6297d1e640 1 -- 172.21.15.40:0/528889685 wait complete. 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.549+0000 7f6297d1e640 1 Processor -- start 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.549+0000 7f6297d1e640 1 -- start start 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6290162bb0 0x7f62900c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f62900d00f0 con 0x7f62900d0c80 2024-04-14T09:58:27.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6290163010 con 0x7f6290162bb0 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6297d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f62900ced80 con 0x7f6290161ca0 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42184/0 (socket says 172.21.15.40:42184) 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 -- 172.21.15.40:0/4111359757 learned_addr learned my addr 172.21.15.40:0/4111359757 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f62952b9640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f62962bb640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6290162bb0 0x7f62900c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 -- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 msgr2=0x7f62900d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 -- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6290162bb0 msgr2=0x7f62900c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6290162bb0 0x7f62900c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.550+0000 7f6295aba640 1 -- 172.21.15.40:0/4111359757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f629015a9d0 con 0x7f62900d0c80 2024-04-14T09:58:27.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f6295aba640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f628000efc0 tx=0x7f628000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280018020 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6280014480 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6280014850 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f629015acb0 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.551+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f629015b270 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.552+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62900c8cd0 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.552+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f628001b020 con 0x7f62900d0c80 2024-04-14T09:58:27.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.552+0000 7f628e7fc640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 0x7f627c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.553+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f628008c800 con 0x7f62900d0c80 2024-04-14T09:58:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.553+0000 7f62952b9640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 0x7f627c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.553+0000 7f62952b9640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 0x7f627c06ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6284036000 tx=0x7f628403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:27.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.557+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6280022030 con 0x7f62900d0c80 2024-04-14T09:58:27.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:27.785+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6290075760 con 0x7f62900d0c80 2024-04-14T09:58:28.359 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-04-14T09:58:28.360+0000 7fbc8d1f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T09:58:28.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.408+0000 7f628e7fc640 1 -- 172.21.15.40:0/4111359757 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f6280010040 con 0x7f62900d0c80 2024-04-14T09:58:28.408 INFO:teuthology.orchestra.run.smithi040.stderr:added data pool 4 to fsmap 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 msgr2=0x7f627c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 0x7f627c06ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6284036000 tx=0x7f628403d040 comp rx=0 tx=0).stop 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 msgr2=0x7f62900d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f628000efc0 tx=0x7f628000c490 comp rx=0 tx=0).stop 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 shutdown_connections 2024-04-14T09:58:28.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f627c06c920 0x7f627c06ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6290162bb0 0x7f62900c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6290161ca0 0x7f62900d2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 --2- 172.21.15.40:0/4111359757 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f62900d0c80 0x7f62900d2770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 >> 172.21.15.40:0/4111359757 conn(0x7f629009d5c0 msgr2=0x7f629006da60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 shutdown_connections 2024-04-14T09:58:28.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.411+0000 7f6297d1e640 1 -- 172.21.15.40:0/4111359757 wait complete. 2024-04-14T09:58:28.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:28.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.532+0000 7fc3f6a88640 1 Processor -- start 2024-04-14T09:58:28.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.532+0000 7fc3f6a88640 1 -- start start 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.532+0000 7fc3f6a88640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3f0161b80 0x7fc3f0073050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f6a88640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc3f00b0690 0x7fc3f006e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f6a88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3f00b4bb0 con 0x7fc3f006bcf0 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f6a88640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f0072320 con 0x7fc3f0161b80 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f6a88640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc3f0072570 con 0x7fc3f00b0690 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3f0161b80 0x7fc3f0073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3effff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc3f006bcf0 0x7fc3f00ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57570/0 (socket says 172.21.15.40:57570) 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc3f0161b80 0x7fc3f0073050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42200/0 (socket says 172.21.15.40:42200) 2024-04-14T09:58:28.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3effff640 1 -- 172.21.15.40:0/3524482484 learned_addr learned my addr 172.21.15.40:0/3524482484 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f5025640 1 --2- 172.21.15.40:0/3524482484 >> v2:172.21.15.136:3300/0 conn(0x7fc3f00b0690 0x7fc3f006e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 -- 172.21.15.40:0/3524482484 >> v2:172.21.15.136:3300/0 conn(0x7fc3f00b0690 msgr2=0x7fc3f006e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 --2- 172.21.15.40:0/3524482484 >> v2:172.21.15.136:3300/0 conn(0x7fc3f00b0690 0x7fc3f006e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 -- 172.21.15.40:0/3524482484 >> v1:172.21.15.40:6789/0 conn(0x7fc3f006bcf0 legacy=0x7fc3f00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.533+0000 7fc3f4824640 1 -- 172.21.15.40:0/3524482484 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f0072850 con 0x7fc3f0161b80 2024-04-14T09:58:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f4824640 1 --2- 172.21.15.40:0/3524482484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f0161b80 0x7fc3f0073050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b6060 tx=0x7fc3e802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dfa51a5022af9c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3ef7fe640 1 -- 172.21.15.40:0/3524482484 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8039070 con 0x7fc3f0161b80 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3ef7fe640 1 -- 172.21.15.40:0/3524482484 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e802cbf0 con 0x7fc3f0161b80 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3ef7fe640 1 -- 172.21.15.40:0/3524482484 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8034440 con 0x7fc3f0161b80 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3524482484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f0161b80 msgr2=0x7fc3f0073050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3524482484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f0161b80 0x7fc3f0073050 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00b6060 tx=0x7fc3e802be40 comp rx=0 tx=0).stop 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3524482484 shutdown_connections 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3524482484 >> v2:172.21.15.136:3300/0 conn(0x7fc3f00b0690 0x7fc3f006e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3524482484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f0161b80 0x7fc3f0073050 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.534+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3524482484 >> 172.21.15.40:0/3524482484 conn(0x7fc3f00b6540 msgr2=0x7fc3f00b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.535+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3524482484 shutdown_connections 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.535+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3524482484 wait complete. 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 Processor -- start 2024-04-14T09:58:28.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 -- start start 2024-04-14T09:58:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3f006bcf0 0x7fc3f00cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3f0161b80 0x7fc3f01f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f00adfc0 con 0x7fc3f00b0690 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f00b01e0 con 0x7fc3f0161b80 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.536+0000 7fc3f6a88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc3f00ae140 con 0x7fc3f006bcf0 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42202/0 (socket says 172.21.15.40:42202) 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 -- 172.21.15.40:0/3348981873 learned_addr learned my addr 172.21.15.40:0/3348981873 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3f4824640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3f006bcf0 0x7fc3f00cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3f5025640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3f0161b80 0x7fc3f01f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 -- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3f006bcf0 msgr2=0x7fc3f00cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3f006bcf0 0x7fc3f00cf860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 -- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3f0161b80 msgr2=0x7fc3f01f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3f0161b80 0x7fc3f01f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 -- 172.21.15.40:0/3348981873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f01f8080 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3effff640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c400 tx=0x7fc3d800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8017070 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3d8005ce0 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f01f8360 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8007310 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.537+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f00cd740 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.538+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f00756f0 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.539+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3d801a070 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.539+0000 7fc3ed7fa640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.539+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3d808b1d0 con 0x7fc3f00b0690 2024-04-14T09:58:28.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.539+0000 7fc3f4824640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.540+0000 7fc3f4824640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 0x7fc3d006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.544+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc3d8058c70 con 0x7fc3f00b0690 2024-04-14T09:58:28.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.769+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3f00cd910 con 0x7fc3f00b0690 2024-04-14T09:58:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.770+0000 7fc3ed7fa640 1 -- 172.21.15.40:0/3348981873 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7fc3d805cf70 con 0x7fc3f00b0690 2024-04-14T09:58:28.770 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:28.770 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:27.787205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:28.770 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 msgr2=0x7fc3d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 0x7fc3d006edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8036000 tx=0x7fc3e8030000 comp rx=0 tx=0).stop 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 msgr2=0x7fc3f014cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc3d800c400 tx=0x7fc3d800c8c0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 shutdown_connections 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc3d006c8f0 0x7fc3d006edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc3f0161b80 0x7fc3f01f7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3f00b0690 0x7fc3f014cac0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 --2- 172.21.15.40:0/3348981873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3f006bcf0 0x7fc3f00cf860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 >> 172.21.15.40:0/3348981873 conn(0x7fc3f00b6540 msgr2=0x7fc3f006c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 shutdown_connections 2024-04-14T09:58:28.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.772+0000 7fc3f6a88640 1 -- 172.21.15.40:0/3348981873 wait complete. 2024-04-14T09:58:28.782 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.884+0000 7f09e65c8640 1 Processor -- start 2024-04-14T09:58:28.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.884+0000 7f09e65c8640 1 -- start start 2024-04-14T09:58:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e65c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09e006bcf0 0x7f09e00ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e65c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e00b4bb0 con 0x7f09e00b0690 2024-04-14T09:58:28.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e65c8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09e0072570 con 0x7f09e0161b80 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e65c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f09e0072320 con 0x7f09e006bcf0 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09df7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f09e006bcf0 0x7f09e00ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e4b65640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f09e00b0690 0x7f09e006e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57586/0 (socket says 172.21.15.40:57586) 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.885+0000 7f09e4b65640 1 -- 172.21.15.40:0/1849949922 learned_addr learned my addr 172.21.15.40:0/1849949922 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09df7fe640 1 -- 172.21.15.40:0/1849949922 >> v1:172.21.15.136:6789/0 conn(0x7f09e0161b80 legacy=0x7f09e0073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09df7fe640 1 -- 172.21.15.40:0/1849949922 >> v1:172.21.15.40:6789/0 conn(0x7f09e00b0690 legacy=0x7f09e006e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09df7fe640 1 -- 172.21.15.40:0/1849949922 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e0072850 con 0x7f09e006bcf0 2024-04-14T09:58:28.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09deffd640 1 -- 172.21.15.40:0/1849949922 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3148563101 0 0) 0x7f09e00b4bb0 con 0x7f09e00b0690 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09df7fe640 1 --2- 172.21.15.40:0/1849949922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e006bcf0 0x7f09e00ad8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d40097a0 tx=0x7f09d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ccdee8234c92db server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.886+0000 7f09deffd640 1 -- 172.21.15.40:0/1849949922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4035020 con 0x7f09e006bcf0 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09deffd640 1 -- 172.21.15.40:0/1849949922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4031830 con 0x7f09e006bcf0 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09deffd640 1 -- 172.21.15.40:0/1849949922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4031c00 con 0x7f09e006bcf0 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 -- 172.21.15.40:0/1849949922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e006bcf0 msgr2=0x7f09e00ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 --2- 172.21.15.40:0/1849949922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e006bcf0 0x7f09e00ad8b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09d40097a0 tx=0x7f09d402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 -- 172.21.15.40:0/1849949922 shutdown_connections 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 --2- 172.21.15.40:0/1849949922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e006bcf0 0x7f09e00ad8b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 -- 172.21.15.40:0/1849949922 >> 172.21.15.40:0/1849949922 conn(0x7f09e00b6540 msgr2=0x7f09e00b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 -- 172.21.15.40:0/1849949922 shutdown_connections 2024-04-14T09:58:28.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.887+0000 7f09e65c8640 1 -- 172.21.15.40:0/1849949922 wait complete. 2024-04-14T09:58:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.888+0000 7f09e65c8640 1 Processor -- start 2024-04-14T09:58:28.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.888+0000 7f09e65c8640 1 -- start start 2024-04-14T09:58:28.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 0x7f09e015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 0x7f09e015ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f09e0073760 con 0x7f09e00b0690 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f09e00b01e0 con 0x7f09e0161b80 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e65c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f09e00738e0 con 0x7f09e006bcf0 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09df7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42224/0 (socket says 172.21.15.40:42224) 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09df7fe640 1 -- 172.21.15.40:0/2794806873 learned_addr learned my addr 172.21.15.40:0/2794806873 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09dffff640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 0x7f09e015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.889+0000 7f09e4b65640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 0x7f09e015ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 -- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 msgr2=0x7f09e015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 0x7f09e015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 -- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 msgr2=0x7f09e015ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:28.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 0x7f09e015ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 -- 172.21.15.40:0/2794806873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e0159680 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09dffff640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 0x7f09e015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09e4b65640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 0x7f09e015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09df7fe640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09d40097a0 tx=0x7f09d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4035050 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4004230 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d403b740 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09e015dbd0 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.890+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09e015e190 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.891+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e00756f0 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.891+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09d4038020 con 0x7f09e00b0690 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.892+0000 7f09dcff9640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 0x7f09cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:28.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.892+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f09d40adc10 con 0x7f09e00b0690 2024-04-14T09:58:28.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.892+0000 7f09dffff640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 0x7f09cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:28.894 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.892+0000 7f09dffff640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 0x7f09cc06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09d0007fd0 tx=0x7f09d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:28.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:28.896+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f09d4040070 con 0x7f09e00b0690 2024-04-14T09:58:29.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.082+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09e0159160 con 0x7f09e00b0690 2024-04-14T09:58:29.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.083+0000 7f09dcff9640 1 -- 172.21.15.40:0/2794806873 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f09d407bd90 con 0x7f09e00b0690 2024-04-14T09:58:29.083 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:29.084 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 msgr2=0x7f09cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 0x7f09cc06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f09d0007fd0 tx=0x7f09d0009040 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 msgr2=0x7f09e014ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f09d40097a0 tx=0x7f09d40046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 shutdown_connections 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f09cc06c8f0 0x7f09cc06edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f09e0161b80 0x7f09e015ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f09e00b0690 0x7f09e014ec00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 --2- 172.21.15.40:0/2794806873 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f09e006bcf0 0x7f09e015bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 >> 172.21.15.40:0/2794806873 conn(0x7f09e00b6540 msgr2=0x7f09e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 shutdown_connections 2024-04-14T09:58:29.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.085+0000 7f09e65c8640 1 -- 172.21.15.40:0/2794806873 wait complete. 2024-04-14T09:58:29.095 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:29.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.197+0000 7f9461a88640 1 Processor -- start 2024-04-14T09:58:29.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.197+0000 7f9461a88640 1 -- start start 2024-04-14T09:58:29.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f9461a88640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f945c15e510 0x7f945c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f9461a88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c0d15a0 0x7f945c0d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f9461a88640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f945c0ceda0 con 0x7f945c0d2800 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f9461a88640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f945c0d31c0 con 0x7f945c15e510 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f9461a88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f945c0cf040 con 0x7f945c0d15a0 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f945c15e510 0x7f945c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c0d15a0 0x7f945c0d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f945c15e510 0x7f945c0cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42236/0 (socket says 172.21.15.40:42236) 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 -- 172.21.15.40:0/2643824025 learned_addr learned my addr 172.21.15.40:0/2643824025 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 -- 172.21.15.40:0/2643824025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c0d15a0 msgr2=0x7f945c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 --2- 172.21.15.40:0/2643824025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c0d15a0 0x7f945c0d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 -- 172.21.15.40:0/2643824025 >> v1:172.21.15.136:6789/0 conn(0x7f945c0d2800 legacy=0x7f945c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945b7fe640 1 -- 172.21.15.40:0/2643824025 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0cf320 con 0x7f945c15e510 2024-04-14T09:58:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.198+0000 7f945a7fc640 1 -- 172.21.15.40:0/2643824025 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223036132 0 0) 0x7f945c0ceda0 con 0x7f945c0d2800 2024-04-14T09:58:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.199+0000 7f945b7fe640 1 --2- 172.21.15.40:0/2643824025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c15e510 0x7f945c0cfe00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436a4554de3393ac server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.199+0000 7f945a7fc640 1 -- 172.21.15.40:0/2643824025 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c035020 con 0x7f945c15e510 2024-04-14T09:58:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.199+0000 7f945a7fc640 1 -- 172.21.15.40:0/2643824025 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f944c031640 con 0x7f945c15e510 2024-04-14T09:58:29.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.199+0000 7f945a7fc640 1 -- 172.21.15.40:0/2643824025 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f944c02d040 con 0x7f945c15e510 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 -- 172.21.15.40:0/2643824025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c15e510 msgr2=0x7f945c0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 --2- 172.21.15.40:0/2643824025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c15e510 0x7f945c0cfe00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f944c009870 tx=0x7f944c02b8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 -- 172.21.15.40:0/2643824025 shutdown_connections 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 --2- 172.21.15.40:0/2643824025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c0d15a0 0x7f945c0d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 --2- 172.21.15.40:0/2643824025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c15e510 0x7f945c0cfe00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 -- 172.21.15.40:0/2643824025 >> 172.21.15.40:0/2643824025 conn(0x7f945c09d570 msgr2=0x7f945c0d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 -- 172.21.15.40:0/2643824025 shutdown_connections 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.200+0000 7f9461a88640 1 -- 172.21.15.40:0/2643824025 wait complete. 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.201+0000 7f9461a88640 1 Processor -- start 2024-04-14T09:58:29.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.201+0000 7f9461a88640 1 -- start start 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f945c0d15a0 0x7f945c0c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c15e510 0x7f945c160be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f945c0b3ad0 con 0x7f945c0d2800 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f945c15e8f0 con 0x7f945c0d15a0 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f945c0b3c50 con 0x7f945c15e510 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42242/0 (socket says 172.21.15.40:42242) 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 -- 172.21.15.40:0/2083657461 learned_addr learned my addr 172.21.15.40:0/2083657461 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945bfff640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c15e510 0x7f945c160be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945b7fe640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f945c0d15a0 0x7f945c0c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 -- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c15e510 msgr2=0x7f945c160be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c15e510 0x7f945c160be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 -- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f945c0d15a0 msgr2=0x7f945c0c9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f945c0d15a0 0x7f945c0c9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 -- 172.21.15.40:0/2083657461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c0c8320 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f945affd640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f945000c520 tx=0x7f945000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450017070 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94500052d0 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c0c8600 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9450012870 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.202+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c0b6fe0 con 0x7f945c0d2800 2024-04-14T09:58:29.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.203+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945c0756f0 con 0x7f945c0d2800 2024-04-14T09:58:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.204+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f945001a070 con 0x7f945c0d2800 2024-04-14T09:58:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.204+0000 7f9443fff640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 0x7f944806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.205+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f945008b130 con 0x7f945c0d2800 2024-04-14T09:58:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.205+0000 7f945b7fe640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 0x7f944806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.205+0000 7f945b7fe640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 0x7f944806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f944c036000 tx=0x7f944c03c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.208 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.209+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9450058be0 con 0x7f945c0d2800 2024-04-14T09:58:29.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.396+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f945c15cdb0 con 0x7f945c0d2800 2024-04-14T09:58:29.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.398+0000 7f9443fff640 1 -- 172.21.15.40:0/2083657461 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f945005cee0 con 0x7f945c0d2800 2024-04-14T09:58:29.397 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:29.398 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 msgr2=0x7f944806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 0x7f944806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f944c036000 tx=0x7f944c03c040 comp rx=0 tx=0).stop 2024-04-14T09:58:29.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 msgr2=0x7f945c0c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f945000c520 tx=0x7f945000c9e0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 shutdown_connections 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f944806c920 0x7f944806ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f945c15e510 0x7f945c160be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.399+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f945c0d2800 0x7f945c0c7b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.400+0000 7f9461a88640 1 --2- 172.21.15.40:0/2083657461 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f945c0d15a0 0x7f945c0c9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.400+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 >> 172.21.15.40:0/2083657461 conn(0x7f945c09d570 msgr2=0x7f945c0b51c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.400+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 shutdown_connections 2024-04-14T09:58:29.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.400+0000 7f9461a88640 1 -- 172.21.15.40:0/2083657461 wait complete. 2024-04-14T09:58:29.424 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.526+0000 7f4ce44ad640 1 Processor -- start 2024-04-14T09:58:29.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.527+0000 7f4ce44ad640 1 -- start start 2024-04-14T09:58:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.527+0000 7f4ce44ad640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4cdc15e650 0x7f4cdc0b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.527+0000 7f4ce44ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cdc0b4760 0x7f4cdc0d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.527+0000 7f4ce44ad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cdc0b4c70 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.528 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce44ad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f4cdc0d3120 con 0x7f4cdc0b4760 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce44ad640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4cdc0b5880 con 0x7f4cdc15e650 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1a48640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4cdc0b4760 0x7f4cdc0d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce2a4a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f4cdc0d2cb0 0x7f4cdc1622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57596/0 (socket says 172.21.15.40:57596) 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce2a4a640 1 -- 172.21.15.40:0/2101665434 learned_addr learned my addr 172.21.15.40:0/2101665434 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce2249640 1 --2- 172.21.15.40:0/2101665434 >> v2:172.21.15.136:3300/0 conn(0x7f4cdc15e650 0x7f4cdc0b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1a48640 1 -- 172.21.15.40:0/2101665434 >> v2:172.21.15.136:3300/0 conn(0x7f4cdc15e650 msgr2=0x7f4cdc0b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1a48640 1 --2- 172.21.15.40:0/2101665434 >> v2:172.21.15.136:3300/0 conn(0x7f4cdc15e650 0x7f4cdc0b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1a48640 1 -- 172.21.15.40:0/2101665434 >> v1:172.21.15.40:6789/0 conn(0x7f4cdc0d2cb0 legacy=0x7f4cdc1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1247640 1 -- 172.21.15.40:0/2101665434 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1445782108 0 0) 0x7f4cdc0b4c70 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.528+0000 7f4ce1a48640 1 -- 172.21.15.40:0/2101665434 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc0b4f50 con 0x7f4cdc0b4760 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce1a48640 1 --2- 172.21.15.40:0/2101665434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0b4760 0x7f4cdc0d2770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0b6e10 tx=0x7f4ccc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169ac5fabc0d0465 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce1247640 1 -- 172.21.15.40:0/2101665434 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc035020 con 0x7f4cdc0b4760 2024-04-14T09:58:29.529 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce1247640 1 -- 172.21.15.40:0/2101665434 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc031830 con 0x7f4cdc0b4760 2024-04-14T09:58:29.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce1247640 1 -- 172.21.15.40:0/2101665434 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc031c00 con 0x7f4cdc0b4760 2024-04-14T09:58:29.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 -- 172.21.15.40:0/2101665434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0b4760 msgr2=0x7f4cdc0d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/2101665434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0b4760 0x7f4cdc0d2770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc0b6e10 tx=0x7f4ccc02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 -- 172.21.15.40:0/2101665434 shutdown_connections 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/2101665434 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0b4760 0x7f4cdc0d2770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/2101665434 >> v2:172.21.15.136:3300/0 conn(0x7f4cdc15e650 0x7f4cdc0b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 -- 172.21.15.40:0/2101665434 >> 172.21.15.40:0/2101665434 conn(0x7f4cdc09d580 msgr2=0x7f4cdc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 -- 172.21.15.40:0/2101665434 shutdown_connections 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.529+0000 7f4ce44ad640 1 -- 172.21.15.40:0/2101665434 wait complete. 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 Processor -- start 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 -- start start 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cdc0b4760 0x7f4cdc1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cdc15e650 0x7f4cdc1e96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0d2270 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b5510 con 0x7f4cdc15e650 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce44ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc15ea30 con 0x7f4cdc0b4760 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce1a48640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce1a48640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42264/0 (socket says 172.21.15.40:42264) 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.531+0000 7f4ce1a48640 1 -- 172.21.15.40:0/149581928 learned_addr learned my addr 172.21.15.40:0/149581928 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce2249640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cdc0b4760 0x7f4cdc1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce2a4a640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cdc15e650 0x7f4cdc1e96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 -- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cdc0b4760 msgr2=0x7f4cdc1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cdc0b4760 0x7f4cdc1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 -- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cdc15e650 msgr2=0x7f4cdc1e96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cdc15e650 0x7f4cdc1e96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 -- 172.21.15.40:0/149581928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc14e5b0 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce1a48640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc035040 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc004230 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc0b82d0 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc03a640 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.532+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc0b8890 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.533+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc0756f0 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.533+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ccc038020 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.534+0000 7f4cd2ffd640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 0x7f4cc006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.534+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4ccc0adaa0 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.534+0000 7f4ce2249640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 0x7f4cc006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.534+0000 7f4ce2249640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 0x7f4cc006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009b40 tx=0x7f4cd8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.538+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4ccc07b540 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.765+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cdc0b3500 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.765+0000 7f4cd2ffd640 1 -- 172.21.15.40:0/149581928 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5180 (secure 0 0 0) 0x7f4ccc07f840 con 0x7f4cdc0d2cb0 2024-04-14T09:58:29.765 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:29.765 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:27.787205+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:29.766 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 7 2024-04-14T09:58:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 msgr2=0x7f4cc006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 0x7f4cc006edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8009b40 tx=0x7f4cd8009190 comp rx=0 tx=0).stop 2024-04-14T09:58:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 msgr2=0x7f4cdc14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc000c00 tx=0x7f4ccc0046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 shutdown_connections 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f4cc006c8f0 0x7f4cc006edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4cdc15e650 0x7f4cdc1e96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4cdc0d2cb0 0x7f4cdc14e070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 --2- 172.21.15.40:0/149581928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4cdc0b4760 0x7f4cdc1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 >> 172.21.15.40:0/149581928 conn(0x7f4cdc09d580 msgr2=0x7f4cdc15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 shutdown_connections 2024-04-14T09:58:29.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.767+0000 7f4ce44ad640 1 -- 172.21.15.40:0/149581928 wait complete. 2024-04-14T09:58:29.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.879+0000 7fc005036640 1 Processor -- start 2024-04-14T09:58:29.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.879+0000 7fc005036640 1 -- start start 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fc005036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc0000d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fc005036640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b4c70 con 0x7fc0000cf0a0 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fc005036640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0000b4f50 con 0x7fc00015e650 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fc005036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000d3110 con 0x7fc0000d2770 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbfff59e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc0000cf0a0 0x7fc0000cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57612/0 (socket says 172.21.15.40:57612) 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbfff59e640 1 -- 172.21.15.40:0/1222662031 learned_addr learned my addr 172.21.15.40:0/1222662031 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffe59c640 1 --2- 172.21.15.40:0/1222662031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc0000d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081655591 0 0) 0x7fc0000b4c70 con 0x7fc0000cf0a0 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbfec003520 con 0x7fc0000cf0a0 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427930776 0 0) 0x7fc0000b4f50 con 0x7fc00015e650 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0000b4c70 con 0x7fc00015e650 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffe59c640 1 -- 172.21.15.40:0/1222662031 >> v1:172.21.15.136:6789/0 conn(0x7fc00015e650 legacy=0x7fc0000b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffe59c640 1 -- 172.21.15.40:0/1222662031 >> v1:172.21.15.40:6789/0 conn(0x7fc0000cf0a0 legacy=0x7fc0000cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.880+0000 7fbffe59c640 1 -- 172.21.15.40:0/1222662031 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000b5230 con 0x7fc0000d2770 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.881+0000 7fbffe59c640 1 --2- 172.21.15.40:0/1222662031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc0000d2bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097d0 tx=0x7fbfe802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a655edb60d80a44 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.881+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8035020 con 0x7fc0000d2770 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.881+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8031890 con 0x7fc0000d2770 2024-04-14T09:58:29.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.881+0000 7fbffdd9b640 1 -- 172.21.15.40:0/1222662031 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8031c40 con 0x7fc0000d2770 2024-04-14T09:58:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 -- 172.21.15.40:0/1222662031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 msgr2=0x7fc0000d2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 --2- 172.21.15.40:0/1222662031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc0000d2bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fbfe80097d0 tx=0x7fbfe802b930 comp rx=0 tx=0).stop 2024-04-14T09:58:29.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 -- 172.21.15.40:0/1222662031 shutdown_connections 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 --2- 172.21.15.40:0/1222662031 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc0000d2bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 -- 172.21.15.40:0/1222662031 >> 172.21.15.40:0/1222662031 conn(0x7fc00009d580 msgr2=0x7fc0000d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 -- 172.21.15.40:0/1222662031 shutdown_connections 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.882+0000 7fc005036640 1 -- 172.21.15.40:0/1222662031 wait complete. 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.883+0000 7fc005036640 1 Processor -- start 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.883+0000 7fc005036640 1 -- start start 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0000cf0a0 0x7fc0000b90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc000152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000b4930 con 0x7fc00015e650 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc0000b5880 con 0x7fc0000cf0a0 2024-04-14T09:58:29.886 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fc005036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc0000d2270 con 0x7fc0000d2770 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fbfff59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fbfff59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42280/0 (socket says 172.21.15.40:42280) 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fbfff59e640 1 -- 172.21.15.40:0/624733474 learned_addr learned my addr 172.21.15.40:0/624733474 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fbffe59c640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc000152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.884+0000 7fbffed9d640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0000cf0a0 0x7fc0000b90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 -- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 msgr2=0x7fc000152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc000152950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 -- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0000cf0a0 msgr2=0x7fc0000b90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0000cf0a0 0x7fc0000b90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 -- 172.21.15.40:0/624733474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0000cbbd0 con 0x7fc00015e650 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbfff59e640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cad0 tx=0x7fbff000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0017070 con 0x7fc00015e650 2024-04-14T09:58:29.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff000ac30 con 0x7fc00015e650 2024-04-14T09:58:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0000cbeb0 con 0x7fc00015e650 2024-04-14T09:58:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0012400 con 0x7fc00015e650 2024-04-14T09:58:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.885+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0000cc470 con 0x7fc00015e650 2024-04-14T09:58:29.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.886+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0000756f0 con 0x7fc00015e650 2024-04-14T09:58:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.886+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbff001a070 con 0x7fc00015e650 2024-04-14T09:58:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.887+0000 7fbff77fe640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 0x7fbfe006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.887+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbff008ba20 con 0x7fc00015e650 2024-04-14T09:58:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.887+0000 7fbffed9d640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 0x7fbfe006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:29.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.888+0000 7fbffed9d640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 0x7fbfe006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbff80011e0 tx=0x7fbff8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:29.891 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:29.891+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbff0059550 con 0x7fc00015e650 2024-04-14T09:58:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.076+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0000b27c0 con 0x7fc00015e650 2024-04-14T09:58:30.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.077+0000 7fbff77fe640 1 -- 172.21.15.40:0/624733474 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fbff005d850 con 0x7fc00015e650 2024-04-14T09:58:30.077 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:30.077 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 msgr2=0x7fbfe006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 0x7fbfe006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbff80011e0 tx=0x7fbff8009040 comp rx=0 tx=0).stop 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 msgr2=0x7fc0000cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbff000cad0 tx=0x7fbff000cf90 comp rx=0 tx=0).stop 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 shutdown_connections 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbfe006c8f0 0x7fbfe006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc00015e650 0x7fc0000cb380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc0000d2770 0x7fc000152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 --2- 172.21.15.40:0/624733474 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc0000cf0a0 0x7fc0000b90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 >> 172.21.15.40:0/624733474 conn(0x7fc00009d580 msgr2=0x7fc00015d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 shutdown_connections 2024-04-14T09:58:30.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.079+0000 7fc005036640 1 -- 172.21.15.40:0/624733474 wait complete. 2024-04-14T09:58:30.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T09:58:22.820415+0000', 'modified': '2024-04-14T09:58:27.787205+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6835/994538529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 994538529}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 994538529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-04-14T09:58:30.492 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T09:58:30.492 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-14T09:58:30.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.599+0000 7fa20e3dc640 1 Processor -- start 2024-04-14T09:58:30.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.599+0000 7fa20e3dc640 1 -- start start 2024-04-14T09:58:30.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa20e3dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 0x7fa20815edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa20e3dc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa208148050 con 0x7fa208147c70 2024-04-14T09:58:30.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa20e3dc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa208162330 con 0x7fa208073150 2024-04-14T09:58:30.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa20e3dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa208070030 con 0x7fa2080b33c0 2024-04-14T09:58:30.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa207fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa208147c70 0x7fa20806f920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57628/0 (socket says 172.21.15.40:57628) 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa207fff640 1 -- 172.21.15.40:0/792531761 learned_addr learned my addr 172.21.15.40:0/792531761 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.600+0000 7fa20c979640 1 --2- 172.21.15.40:0/792531761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 0x7fa20815edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651594706 0 0) 0x7fa208148050 con 0x7fa208147c70 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003520 con 0x7fa208147c70 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470209205 0 0) 0x7fa208162330 con 0x7fa208073150 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa208148050 con 0x7fa208073150 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa20c979640 1 -- 172.21.15.40:0/792531761 >> v1:172.21.15.136:6789/0 conn(0x7fa208073150 legacy=0x7fa2080b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa20c979640 1 -- 172.21.15.40:0/792531761 >> v1:172.21.15.40:6789/0 conn(0x7fa208147c70 legacy=0x7fa20806f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa20c979640 1 -- 172.21.15.40:0/792531761 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa208162610 con 0x7fa2080b33c0 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.601+0000 7fa20c979640 1 --2- 172.21.15.40:0/792531761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 0x7fa20815edb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa200009dc0 tx=0x7fa20002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc93ae88d5040159 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200039070 con 0x7fa2080b33c0 2024-04-14T09:58:30.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20002ccd0 con 0x7fa2080b33c0 2024-04-14T09:58:30.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa206ffd640 1 -- 172.21.15.40:0/792531761 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200034660 con 0x7fa2080b33c0 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 -- 172.21.15.40:0/792531761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 msgr2=0x7fa20815edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/792531761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 0x7fa20815edb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa200009dc0 tx=0x7fa20002bf20 comp rx=0 tx=0).stop 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 -- 172.21.15.40:0/792531761 shutdown_connections 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/792531761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2080b33c0 0x7fa20815edb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 -- 172.21.15.40:0/792531761 >> 172.21.15.40:0/792531761 conn(0x7fa20806e6c0 msgr2=0x7fa20806eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 -- 172.21.15.40:0/792531761 shutdown_connections 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.602+0000 7fa20e3dc640 1 -- 172.21.15.40:0/792531761 wait complete. 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.603+0000 7fa20e3dc640 1 Processor -- start 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 -- start start 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa208073150 0x7fa208141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa208147c70 0x7fa2080b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa208162bd0 con 0x7fa2080b33c0 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa20815e910 con 0x7fa208073150 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20e3dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa208161f50 con 0x7fa208147c70 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa2077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42294/0 (socket says 172.21.15.40:42294) 2024-04-14T09:58:30.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa207fff640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa208073150 0x7fa208141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa2077fe640 1 -- 172.21.15.40:0/1856707386 learned_addr learned my addr 172.21.15.40:0/1856707386 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.604+0000 7fa20c979640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa208147c70 0x7fa2080b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 -- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa208147c70 msgr2=0x7fa2080b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa208147c70 0x7fa2080b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 -- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa208073150 msgr2=0x7fa208141980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa208073150 0x7fa208141980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 -- 172.21.15.40:0/1856707386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2080b27b0 con 0x7fa2080b33c0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa2077fe640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c490 tx=0x7fa1fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa204ff9640 1 -- 172.21.15.40:0/1856707386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc0052d0 con 0x7fa2080b33c0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa204ff9640 1 -- 172.21.15.40:0/1856707386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1fc005470 con 0x7fa2080b33c0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2080b2a90 con 0x7fa2080b33c0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa204ff9640 1 -- 172.21.15.40:0/1856707386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1fc012850 con 0x7fa2080b33c0 2024-04-14T09:58:30.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.605+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2080b3050 con 0x7fa2080b33c0 2024-04-14T09:58:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.607+0000 7fa204ff9640 1 -- 172.21.15.40:0/1856707386 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1fc0129f0 con 0x7fa2080b33c0 2024-04-14T09:58:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.607+0000 7fa204ff9640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 0x7fa1f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.607+0000 7fa204ff9640 1 -- 172.21.15.40:0/1856707386 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1fc08b990 con 0x7fa2080b33c0 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.607+0000 7fa207fff640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 0x7fa1f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.608+0000 7fa207fff640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 0x7fa1f406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8000f60 tx=0x7fa1f8007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.608+0000 7fa2111bf740 1 Processor -- start 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.608+0000 7fa2111bf740 1 -- start start 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1848f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d155040 0x55be8d184e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55be8d0be030 con 0x55be8d181b60 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55be8d066620 con 0x55be8d181f40 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55be8d0b9fe0 con 0x55be8d155040 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42296/0 (socket says 172.21.15.40:42296) 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 -- 172.21.15.40:0/1971604496 learned_addr learned my addr 172.21.15.40:0/1971604496 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa2077fe640 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1848f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa20c979640 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d155040 0x55be8d184e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 -- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d155040 msgr2=0x55be8d184e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d155040 0x55be8d184e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 -- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 msgr2=0x55be8d1848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1848f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 -- 172.21.15.40:0/1971604496 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8cdd22d0 con 0x55be8d181b60 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa207fff640 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80017a0 tx=0x7fa1f8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887410e356336220 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa1edffb640 1 -- 172.21.15.40:0/1971604496 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8025070 con 0x55be8d181b60 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa1edffb640 1 -- 172.21.15.40:0/1971604496 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f801b050 con 0x55be8d181b60 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.609+0000 7fa1edffb640 1 -- 172.21.15.40:0/1971604496 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8014de0 con 0x55be8d181b60 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 -- 172.21.15.40:0/1971604496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 msgr2=0x55be8d154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80017a0 tx=0x7fa1f8012000 comp rx=0 tx=0).stop 2024-04-14T09:58:30.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 -- 172.21.15.40:0/1971604496 shutdown_connections 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d155040 0x55be8d184e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1848f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 --2- 172.21.15.40:0/1971604496 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d154b00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 -- 172.21.15.40:0/1971604496 >> 172.21.15.40:0/1971604496 conn(0x55be8d156d70 msgr2=0x55be8d19f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 -- 172.21.15.40:0/1971604496 shutdown_connections 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.610+0000 7fa2111bf740 1 -- 172.21.15.40:0/1971604496 wait complete. 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.611+0000 7fa2111bf740 1 -- start start 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.611+0000 7fa2111bf740 1 Processor -- start 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.611+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.611+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d19d860 0x55be8d19de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55be8d159410 con 0x55be8d181b60 2024-04-14T09:58:30.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55be8d0799e0 con 0x55be8d181f40 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55be8d15bc50 con 0x55be8d19d860 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 10 client.0 _ll_register_callbacks cb 0x55be8d0b6080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42310/0 (socket says 172.21.15.40:42310) 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 -- 172.21.15.40:0/2377642933 learned_addr learned my addr 172.21.15.40:0/2377642933 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 -- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d19d860 msgr2=0x55be8d19de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d19d860 0x55be8d19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 -- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 msgr2=0x55be8d1af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 -- 172.21.15.40:0/2377642933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8ce9c6b0 con 0x55be8d181b60 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa207fff640 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8020670 tx=0x7fa1f8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a592f70e10f3867 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa1e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:58:30.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8030070 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1f8010040 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1f801b050 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa1f8038050 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 10 client.4440 fetch_fsmap learned FSMap version 7 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55be8d184280 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.612+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f801b050 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fa1f8033030 con 0x55be8d181b60 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 20 client.4440 populate_metadata read hostname 'smithi040' 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d179b90 0x55be8d1b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 4 client.4440 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 --> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be8d065cc0 con 0x55be8d179b90 2024-04-14T09:58:30.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2077fe640 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d179b90 0x55be8d1b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa1e6ffd640 10 client.4440 ms_handle_connect on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.613+0000 7fa2077fe640 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d179b90 0x55be8d1b3610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b35a87be2ba43c15 server_cookie=1cf3187543c991d0 in_seq=0 out_seq=0 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2377642933 <== mds.0 v2:172.21.15.136:6834/994538529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55be8d065cc0 con 0x55be8d179b90 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa1e6ffd640 10 client.4440 handle_command_reply: tid=0 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 client.4440 shutdown 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 msgr2=0x55be8d19fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8020670 tx=0x7fa1f8000ed0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 shutdown_connections 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d19d860 0x55be8d19de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d179b90 0x55be8d1b3610 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d1af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2377642933 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d19fe00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa1e6ffd640 0 client.4440 ms_handle_reset on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:30.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 >> 172.21.15.40:0/2377642933 conn(0x55be8d155040 msgr2=0x55be8d159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 shutdown_connections 2024-04-14T09:58:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 1 -- 172.21.15.40:0/2377642933 wait complete. 2024-04-14T09:58:30.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.614+0000 7fa2111bf740 20 client.4440 trim_cache size 0 max 16384 2024-04-14T09:58:30.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.632+0000 7fa2111bf740 1 Processor -- start 2024-04-14T09:58:30.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.632+0000 7fa2111bf740 1 -- start start 2024-04-14T09:58:30.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181b60 0x55be8d1862f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d178dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa208200e30 con 0x55be8d19d860 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa2082001c0 con 0x55be8d181f40 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa2082007e0 con 0x55be8d181b60 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42326/0 (socket says 172.21.15.40:42326) 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 -- 172.21.15.40:0/3801849074 learned_addr learned my addr 172.21.15.40:0/3801849074 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa207fff640 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181b60 0x55be8d1862f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa2077fe640 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d178dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 -- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181b60 msgr2=0x55be8d1862f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181b60 0x55be8d1862f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 -- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 msgr2=0x55be8d178dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d178dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.633+0000 7fa20c979640 1 -- 172.21.15.40:0/3801849074 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be8d1afcc0 con 0x55be8d19d860 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa20c979640 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa20002c530 tx=0x7fa20002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43bc84e30cbdeda server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa1ed7fa640 1 -- 172.21.15.40:0/3801849074 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200039040 con 0x55be8d19d860 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa1ed7fa640 1 -- 172.21.15.40:0/3801849074 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20003a040 con 0x55be8d19d860 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa1ed7fa640 1 -- 172.21.15.40:0/3801849074 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200041680 con 0x55be8d19d860 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 -- 172.21.15.40:0/3801849074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 msgr2=0x55be8d188000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa20002c530 tx=0x7fa20002e070 comp rx=0 tx=0).stop 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 -- 172.21.15.40:0/3801849074 shutdown_connections 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d19d860 0x55be8d188000 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d181f40 0x55be8d178dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 --2- 172.21.15.40:0/3801849074 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181b60 0x55be8d1862f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 -- 172.21.15.40:0/3801849074 >> 172.21.15.40:0/3801849074 conn(0x55be8d155040 msgr2=0x55be8d19dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 -- 172.21.15.40:0/3801849074 shutdown_connections 2024-04-14T09:58:30.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.634+0000 7fa2111bf740 1 -- 172.21.15.40:0/3801849074 wait complete. 2024-04-14T09:58:30.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.635+0000 7fa2111bf740 1 -- start start 2024-04-14T09:58:30.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.635+0000 7fa2111bf740 1 Processor -- start 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181f40 0x55be8d1a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d19d860 0x55be8d1a3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55be8d187a10 con 0x55be8d181b60 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55be8d184560 con 0x55be8d19d860 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55be8d187200 con 0x55be8d181f40 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 10 client.0 _ll_register_callbacks cb 0x7fa1f8023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42330/0 (socket says 172.21.15.40:42330) 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 -- 172.21.15.40:0/2041947305 learned_addr learned my addr 172.21.15.40:0/2041947305 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa20c979640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d19d860 0x55be8d1a3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2077fe640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181f40 0x55be8d1a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 -- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181f40 msgr2=0x55be8d1a2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181f40 0x55be8d1a2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 -- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d19d860 msgr2=0x55be8d1a3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d19d860 0x55be8d1a3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 -- 172.21.15.40:0/2041947305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be8d17ad60 con 0x55be8d181b60 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa207fff640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8020640 tx=0x7fa1f800a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e1c7d7ca8853f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa1e6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8030040 con 0x55be8d181b60 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1f8026030 con 0x55be8d181b60 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.636+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa20003a040 con 0x55be8d181b60 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fa1f8041050 con 0x55be8d181b60 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 10 client.4446 fetch_fsmap learned FSMap version 7 2024-04-14T09:58:30.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55be8d17a850 con 0x55be8d181b60 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20003a040 con 0x55be8d181b60 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7fa1f8033070 con 0x55be8d181b60 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 10 client.4446 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 20 client.4446 populate_metadata read hostname 'smithi040' 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d1b2bf0 0x55be8d21a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 4 client.4446 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 --> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] -- command(tid 0: {"prefix": "status"}) -- 0x55be8d0cb570 con 0x55be8d1b2bf0 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.637+0000 7fa2077fe640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d1b2bf0 0x55be8d21a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.638+0000 7fa1e6ffd640 10 client.4446 ms_handle_connect on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.638+0000 7fa2077fe640 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d1b2bf0 0x55be8d21a8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c426ac08fd39af4b server_cookie=f0b8e0fc3095c5e6 in_seq=0 out_seq=0 2024-04-14T09:58:30.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.638+0000 7fa1e6ffd640 1 -- 172.21.15.40:0/2041947305 <== mds.0 v2:172.21.15.136:6834/994538529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55be8d0cb570 con 0x55be8d1b2bf0 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.638+0000 7fa1e6ffd640 10 client.4446 handle_command_reply: tid=0 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 client.4446 shutdown 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 msgr2=0x55be8d219fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8020640 tx=0x7fa1f800a000 comp rx=0 tx=0).stop 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 shutdown_connections 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55be8d1b2bf0 0x55be8d21a8f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55be8d19d860 0x55be8d1a3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55be8d181f40 0x55be8d1a2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa1e6ffd640 0 client.4446 ms_handle_reset on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 --2- 172.21.15.40:0/2041947305 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x55be8d181b60 0x55be8d219fb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 >> 172.21.15.40:0/2041947305 conn(0x55be8d155040 msgr2=0x55be8d178750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 shutdown_connections 2024-04-14T09:58:30.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 1 -- 172.21.15.40:0/2041947305 wait complete. 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa2111bf740 20 client.4446 trim_cache size 0 max 16384 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "131eb2ba-6185-454c-b8ac-0bdd05152d4d", 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4297, 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-04-14T09:58:30.645 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 7.2491731809999997, 2024-04-14T09:58:30.646 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 7, 2024-04-14T09:58:30.646 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 25, 2024-04-14T09:58:30.646 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 24, 2024-04-14T09:58:30.646 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 14.276468456 2024-04-14T09:58:30.646 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 msgr2=0x7fa1f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 0x7fa1f406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8000f60 tx=0x7fa1f8007d50 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 msgr2=0x7fa2080b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc00c490 tx=0x7fa1fc00c950 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 shutdown_connections 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa1f406c8f0 0x7fa1f406edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa208147c70 0x7fa2080b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2080b33c0 0x7fa2080b05f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 --2- 172.21.15.40:0/1856707386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa208073150 0x7fa208141980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 >> 172.21.15.40:0/1856707386 conn(0x7fa20806e6c0 msgr2=0x7fa208142440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 shutdown_connections 2024-04-14T09:58:30.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.639+0000 7fa20e3dc640 1 -- 172.21.15.40:0/1856707386 wait complete. 2024-04-14T09:58:30.650 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T09:58:30.650 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:30.650 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:58:30.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.752+0000 7f63b40c8640 1 Processor -- start 2024-04-14T09:58:30.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b40c8640 1 -- start start 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b40c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 0x7f63ac09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b40c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac09b360 con 0x7f63ac0d1320 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b40c8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63ac06f840 con 0x7f63ac0b45b0 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b40c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63ac06fb20 con 0x7f63ac09aa40 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b2665640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f63ac0d1320 0x7f63ac0cd7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57634/0 (socket says 172.21.15.40:57634) 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.753+0000 7f63b2665640 1 -- 172.21.15.40:0/530485469 learned_addr learned my addr 172.21.15.40:0/530485469 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b1e64640 1 --2- 172.21.15.40:0/530485469 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 0x7f63ac09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268846218 0 0) 0x7f63ac09b360 con 0x7f63ac0d1320 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6398003520 con 0x7f63ac0d1320 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962444203 0 0) 0x7f63ac06f840 con 0x7f63ac0b45b0 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63ac09b360 con 0x7f63ac0b45b0 2024-04-14T09:58:30.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b1e64640 1 -- 172.21.15.40:0/530485469 >> v1:172.21.15.136:6789/0 conn(0x7f63ac0b45b0 legacy=0x7f63ac0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b1e64640 1 -- 172.21.15.40:0/530485469 >> v1:172.21.15.40:6789/0 conn(0x7f63ac0d1320 legacy=0x7f63ac0cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.754+0000 7f63b1e64640 1 -- 172.21.15.40:0/530485469 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac0cc5f0 con 0x7f63ac09aa40 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b1e64640 1 --2- 172.21.15.40:0/530485469 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 0x7f63ac09ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f63a80097d0 tx=0x7f63a802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f1c8fd95bdea568 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8035020 con 0x7f63ac09aa40 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8031890 con 0x7f63ac09aa40 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b0e62640 1 -- 172.21.15.40:0/530485469 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8031c60 con 0x7f63ac09aa40 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b40c8640 1 -- 172.21.15.40:0/530485469 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 msgr2=0x7f63ac09ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b40c8640 1 --2- 172.21.15.40:0/530485469 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 0x7f63ac09ae20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f63a80097d0 tx=0x7f63a802b930 comp rx=0 tx=0).stop 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b40c8640 1 -- 172.21.15.40:0/530485469 shutdown_connections 2024-04-14T09:58:30.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b40c8640 1 --2- 172.21.15.40:0/530485469 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac09aa40 0x7f63ac09ae20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.755+0000 7f63b40c8640 1 -- 172.21.15.40:0/530485469 >> 172.21.15.40:0/530485469 conn(0x7f63ac0b3a90 msgr2=0x7f63ac0b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.756+0000 7f63b40c8640 1 -- 172.21.15.40:0/530485469 shutdown_connections 2024-04-14T09:58:30.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.756+0000 7f63b40c8640 1 -- 172.21.15.40:0/530485469 wait complete. 2024-04-14T09:58:30.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 Processor -- start 2024-04-14T09:58:30.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 -- start start 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0b45b0 0x7f63ac15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac0d1320 0x7f63ac15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac09b860 con 0x7f63ac09aa40 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac0ccbb0 con 0x7f63ac0b45b0 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b40c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63ac09b9e0 con 0x7f63ac0d1320 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b1e64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b1e64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42346/0 (socket says 172.21.15.40:42346) 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b1e64640 1 -- 172.21.15.40:0/1028121892 learned_addr learned my addr 172.21.15.40:0/1028121892 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.757+0000 7f63b2665640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac0d1320 0x7f63ac15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1663640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0b45b0 0x7f63ac15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 -- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac0d1320 msgr2=0x7f63ac15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac0d1320 0x7f63ac15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 -- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0b45b0 msgr2=0x7f63ac15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0b45b0 0x7f63ac15fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 -- 172.21.15.40:0/1028121892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ac0c7e50 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b1e64640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63a8034040 tx=0x7f63a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8040070 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8030d20 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8035040 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac0c8130 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.758+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac0c86f0 con 0x7f63ac09aa40 2024-04-14T09:58:30.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.759+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ac0c8930 con 0x7f63ac09aa40 2024-04-14T09:58:30.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.760+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f63a804b060 con 0x7f63ac09aa40 2024-04-14T09:58:30.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.760+0000 7f63a27fc640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 0x7f639006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:30.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.760+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f63a80ada60 con 0x7f63ac09aa40 2024-04-14T09:58:30.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.761+0000 7f63b1663640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 0x7f639006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:30.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.761+0000 7f63b1663640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 0x7f639006ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f639c007fd0 tx=0x7f639c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:30.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.764+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f63a802d040 con 0x7f63ac09aa40 2024-04-14T09:58:30.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.992+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f63ac0b2a20 con 0x7f63ac09aa40 2024-04-14T09:58:30.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.993+0000 7f63a27fc640 1 -- 172.21.15.40:0/1028121892 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f63a807b500 con 0x7f63ac09aa40 2024-04-14T09:58:30.993 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T09:58:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 msgr2=0x7f639006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 0x7f639006ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f639c007fd0 tx=0x7f639c009040 comp rx=0 tx=0).stop 2024-04-14T09:58:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 msgr2=0x7f63ac0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f63a8034040 tx=0x7f63a80046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 shutdown_connections 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f639006c920 0x7f639006ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63ac0d1320 0x7f63ac15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63ac0b45b0 0x7f63ac15fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 --2- 172.21.15.40:0/1028121892 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63ac09aa40 0x7f63ac0b04f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 >> 172.21.15.40:0/1028121892 conn(0x7f63ac0b3a90 msgr2=0x7f63ac06cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 shutdown_connections 2024-04-14T09:58:30.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:30.995+0000 7f63b40c8640 1 -- 172.21.15.40:0/1028121892 wait complete. 2024-04-14T09:58:31.005 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-14T09:58:31.005 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:58:31.005 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-14T09:58:31.005 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-14T09:58:31.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:31.006 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-14T09:58:31.006 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T09:58:31.006 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:58:31.006 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-14T09:58:31.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:31.006 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-14T09:58:31.021 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42680sec preferred_lft 42680sec 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:31.022 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-14T09:58:31.023 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T09:58:31.023 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:31.023 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:31.023 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-04-14T09:58:31.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-04-14T09:58:31.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-04-14T09:58:31.024 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T09:58:31.024 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:31.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:31.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:31.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:31.232 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:58:31.259 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-14T09:58:31.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:31.261 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-14T09:58:31.335 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-14T09:58:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:58:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T09:58:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T09:58:31.336 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:58:31.336 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:31.336 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:31.336 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T09:58:31.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T09:58:31.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T09:58:31.337 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:31.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:31.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:31.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:31.637 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:58:31.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:31.652 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-14T09:58:31.706 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:31.706 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:31.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:31.706 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-14T09:58:31.706 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:31.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:31.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:31.827 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-14T09:58:31.827 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:31.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:31.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:31.962 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:31.962 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:31.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-14T09:58:31.962 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T09:58:31.962 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:32.010 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:32.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:32.043 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-14T09:58:32.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:58:32.043 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:32.057 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-14T09:58:32.057 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:58:32.058 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:32.111 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-14T09:58:32.179 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-14T09:58:32.235 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T09:58:32.236 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:32.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:32.238 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-14T09:58:32.290 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-14T09:58:32.290 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-14T09:58:32.333 DEBUG:teuthology.orchestra.run.smithi040:> sudo modprobe fuse 2024-04-14T09:58:32.359 DEBUG:teuthology.orchestra.run.smithi040:> cat /proc/self/mounts | awk '{print $2}' 2024-04-14T09:58:32.414 INFO:teuthology.orchestra.run.smithi040.stdout:/proc 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/dev 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/security 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/shm 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/pts 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/run 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/cgroup 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/pstore 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/bpf 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/ 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/selinux 2024-04-14T09:58:32.415 INFO:teuthology.orchestra.run.smithi040.stdout:/proc/sys/fs/binfmt_misc 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/hugepages 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/dev/mqueue 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/debug 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/tracing 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/fs/fuse/connections 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/sys/kernel/config 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-sysctl.service 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/nfs/rpc_pipefs 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/run/user/1000 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph 2024-04-14T09:58:32.416 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-0 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-1 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-2 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/var/lib/ceph/osd/ceph-3 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run.smithi040.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:32.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:32.417 DEBUG:teuthology.orchestra.run.smithi040:> ls /sys/fs/fuse/connections 2024-04-14T09:58:32.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:2024-04-14T09:58:32.421+0000 7f30ee60b480 -1 init, newargv = 0x55af95baeb30 newargc=15 2024-04-14T09:58:32.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[44535]: starting ceph client 2024-04-14T09:58:32.426 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[44535]: starting fuse 2024-04-14T09:58:32.435 INFO:teuthology.orchestra.run.smithi040.stdout:43 2024-04-14T09:58:32.435 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-14T09:58:32.435 DEBUG:teuthology.orchestra.run.smithi040:> sudo stdin-killer -- python3 -c ' 2024-04-14T09:58:32.435 DEBUG:teuthology.orchestra.run.smithi040:> import glob 2024-04-14T09:58:32.435 DEBUG:teuthology.orchestra.run.smithi040:> import re 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> import os 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> import subprocess 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> def _find_admin_socket(client_name): 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> files = glob.glob(asok_path) 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> # Given a non-glob path, it better be there 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> if "*" not in asok_path: 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> assert(len(files) == 1) 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> return files[0] 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> for f in files: 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-14T09:58:32.436 DEBUG:teuthology.orchestra.run.smithi040:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> contents = proc_f.read() 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> if mountpoint in contents: 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> return f 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> print(_find_admin_socket("client.admin")) 2024-04-14T09:58:32.437 DEBUG:teuthology.orchestra.run.smithi040:> ' 2024-04-14T09:58:32.558 INFO:teuthology.orchestra.run.smithi040.stdout:/var/run/ceph/ceph-client.admin.44535.asok 2024-04-14T09:58:32.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:32.565 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44535.asok 2024-04-14T09:58:32.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:32.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44535.asok status 2024-04-14T09:58:32.702 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "metadata": { 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_sha1": "d7e176b41636f150fe82aaedea82def3e9af0203", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "ceph_version": "ceph version 19.0.0-2592-gd7e176b4 (d7e176b41636f150fe82aaedea82def3e9af0203) squid (dev)", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "entity_id": "admin", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "hostname": "smithi040", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "pid": "44535", 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "root": "/" 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_count": 0, 2024-04-14T09:58:32.703 INFO:teuthology.orchestra.run.smithi040.stdout: "dentry_pinned_count": 0, 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4455, 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "inst": { 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "name": { 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "client", 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "num": 4455 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1765945687 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": { 2024-04-14T09:58:32.704 INFO:teuthology.orchestra.run.smithi040.stdout: "type": "v1", 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "addr": "192.168.0.1:0", 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "nonce": 1765945687 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "inst_str": "client.4455 192.168.0.1:0/1765945687", 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "addr_str": "192.168.0.1:0/1765945687", 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "inode_count": 1, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "mds_epoch": 7, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch": 25, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "osd_epoch_barrier": 0, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "blocklisted": false, 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs" 2024-04-14T09:58:32.705 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:58:32.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:32.711 DEBUG:teuthology.orchestra.run.smithi040:> stat --file-system '--printf=%T 2024-04-14T09:58:32.711 DEBUG:teuthology.orchestra.run.smithi040:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:32.726 INFO:teuthology.orchestra.run.smithi040.stdout:fuseblk 2024-04-14T09:58:32.726 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:32.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:32.726 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:32.794 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-14T09:58:32.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:58:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:# file: . 2024-04-14T09:58:32.896 INFO:teuthology.orchestra.run.smithi040.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-14T09:58:32.896 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:32.896 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:32.902 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:58:32.902 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:58:32.917 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.059+0000 7f9e1d3ed640 1 Processor -- start 2024-04-14T09:58:33.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.059+0000 7f9e1d3ed640 1 -- start start 2024-04-14T09:58:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e1809aa40 0x7f9e180cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9e180b45b0 0x7f9e180aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e18070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f9e180b4a40 con 0x7f9e1809aa40 2024-04-14T09:58:33.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9e18070270 con 0x7f9e180b45b0 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e1d3ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9e180af1d0 con 0x7f9e1809ae20 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e1809aa40 0x7f9e180cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f9e1809aa40 0x7f9e180cfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42356/0 (socket says 172.21.15.40:42356) 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 -- 172.21.15.40:0/801412591 learned_addr learned my addr 172.21.15.40:0/801412591 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e0ffff640 1 --2- 172.21.15.40:0/801412591 >> v2:172.21.15.136:3300/0 conn(0x7f9e180b45b0 0x7f9e180aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e177fe640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e18070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 -- 172.21.15.40:0/801412591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 msgr2=0x7f9e18070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e18070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 -- 172.21.15.40:0/801412591 >> v2:172.21.15.136:3300/0 conn(0x7f9e180b45b0 msgr2=0x7f9e180aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:33.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/801412591 >> v2:172.21.15.136:3300/0 conn(0x7f9e180b45b0 0x7f9e180aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.060+0000 7f9e16ffd640 1 -- 172.21.15.40:0/801412591 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1806f6a0 con 0x7f9e1809aa40 2024-04-14T09:58:33.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.061+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180cfd80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e1806f350 tx=0x7f9e0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b7579860d516dc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.061+0000 7f9e167fc640 1 -- 172.21.15.40:0/801412591 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08035020 con 0x7f9e1809aa40 2024-04-14T09:58:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.061+0000 7f9e167fc640 1 -- 172.21.15.40:0/801412591 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08031870 con 0x7f9e1809aa40 2024-04-14T09:58:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.061+0000 7f9e167fc640 1 -- 172.21.15.40:0/801412591 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08031c40 con 0x7f9e1809aa40 2024-04-14T09:58:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/801412591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 msgr2=0x7f9e180cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180cfd80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9e1806f350 tx=0x7f9e0802b910 comp rx=0 tx=0).stop 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/801412591 shutdown_connections 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e18070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/801412591 >> v2:172.21.15.136:3300/0 conn(0x7f9e180b45b0 0x7f9e180aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/801412591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180cfd80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/801412591 >> 172.21.15.40:0/801412591 conn(0x7f9e180b3a90 msgr2=0x7f9e180b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/801412591 shutdown_connections 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.062+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/801412591 wait complete. 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.063+0000 7f9e1d3ed640 1 Processor -- start 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.063+0000 7f9e1d3ed640 1 -- start start 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e180b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 0x7f9e181577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1806ff00 con 0x7f9e1809aa40 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1806fc20 con 0x7f9e180b45b0 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1809b2b0 con 0x7f9e1809ae20 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42364/0 (socket says 172.21.15.40:42364) 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 -- 172.21.15.40:0/1598746022 learned_addr learned my addr 172.21.15.40:0/1598746022 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e0ffff640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e180b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e177fe640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 0x7f9e181577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 -- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 msgr2=0x7f9e180b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e180b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 -- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 msgr2=0x7f9e181577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 0x7f9e181577b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 -- 172.21.15.40:0/1598746022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e180ca7c0 con 0x7f9e1809aa40 2024-04-14T09:58:33.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e177fe640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 0x7f9e181577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e16ffd640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e0802b950 tx=0x7f9e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08040070 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e08031e10 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e08035040 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e180caa60 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.064+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e180cb020 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.065+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e180756f0 con 0x7f9e1809aa40 2024-04-14T09:58:33.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.066+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e0804b060 con 0x7f9e1809aa40 2024-04-14T09:58:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.066+0000 7f9e0f7fe640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 0x7f9df806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.066+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e080ad8f0 con 0x7f9e1809aa40 2024-04-14T09:58:33.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.066+0000 7f9e0ffff640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 0x7f9df806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.067+0000 7f9e0ffff640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 0x7f9df806ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e181f5b50 tx=0x7f9e00009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.071+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9e0807ba70 con 0x7f9e1809aa40 2024-04-14T09:58:33.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.259+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e1815cb50 con 0x7f9e1809aa40 2024-04-14T09:58:33.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.261+0000 7f9e0f7fe640 1 -- 172.21.15.40:0/1598746022 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f9e0807b370 con 0x7f9e1809aa40 2024-04-14T09:58:33.261 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:33.261 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:33.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 msgr2=0x7f9df806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 0x7f9df806ede0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9e181f5b50 tx=0x7f9e00009190 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 msgr2=0x7f9e180c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9e0802b950 tx=0x7f9e080046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 shutdown_connections 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9df806c920 0x7f9df806ede0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e180b45b0 0x7f9e181577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e1809ae20 0x7f9e180b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 --2- 172.21.15.40:0/1598746022 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9e1809aa40 0x7f9e180c6ba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 >> 172.21.15.40:0/1598746022 conn(0x7f9e180b3a90 msgr2=0x7f9e180b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 shutdown_connections 2024-04-14T09:58:33.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.263+0000 7f9e1d3ed640 1 -- 172.21.15.40:0/1598746022 wait complete. 2024-04-14T09:58:33.273 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:58:33.274 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.378+0000 7f9a52daa640 1 Processor -- start 2024-04-14T09:58:33.378 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.378+0000 7f9a52daa640 1 -- start start 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a52daa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9a4c162f30 0x7f9a4c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a52daa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c09b450 con 0x7f9a4c1629e0 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a52daa640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a4c09b6f0 con 0x7f9a4c162600 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a52daa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9a4c0d0aa0 con 0x7f9a4c162f30 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a51347640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9a4c1629e0 0x7f9a4c0cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57646/0 (socket says 172.21.15.40:57646) 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a51347640 1 -- 172.21.15.40:0/3673572271 learned_addr learned my addr 172.21.15.40:0/3673572271 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.379+0000 7f9a4bfff640 1 --2- 172.21.15.40:0/3673572271 >> v2:172.21.15.136:3300/0 conn(0x7f9a4c162f30 0x7f9a4c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935213089 0 0) 0x7f9a4c09b450 con 0x7f9a4c1629e0 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c003520 con 0x7f9a4c1629e0 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4bfff640 1 -- 172.21.15.40:0/3673572271 >> v1:172.21.15.136:6789/0 conn(0x7f9a4c162600 legacy=0x7f9a4c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4bfff640 1 -- 172.21.15.40:0/3673572271 >> v1:172.21.15.40:6789/0 conn(0x7f9a4c1629e0 legacy=0x7f9a4c0cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909858923 0 0) 0x7f9a4c09b6f0 con 0x7f9a4c162600 2024-04-14T09:58:33.380 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4bfff640 1 -- 172.21.15.40:0/3673572271 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c09b9d0 con 0x7f9a4c162f30 2024-04-14T09:58:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.380+0000 7f9a4bfff640 1 --2- 172.21.15.40:0/3673572271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c162f30 0x7f9a4c0b4740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a380097d0 tx=0x7f9a3802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753df06995ef3b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38035020 con 0x7f9a4c162f30 2024-04-14T09:58:33.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a38031830 con 0x7f9a4c162f30 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a4b7fe640 1 -- 172.21.15.40:0/3673572271 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a38031be0 con 0x7f9a4c162f30 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 -- 172.21.15.40:0/3673572271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c162f30 msgr2=0x7f9a4c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 --2- 172.21.15.40:0/3673572271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c162f30 0x7f9a4c0b4740 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a380097d0 tx=0x7f9a3802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 -- 172.21.15.40:0/3673572271 shutdown_connections 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 --2- 172.21.15.40:0/3673572271 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c162f30 0x7f9a4c0b4740 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 -- 172.21.15.40:0/3673572271 >> 172.21.15.40:0/3673572271 conn(0x7f9a4c0b3c20 msgr2=0x7f9a4c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 -- 172.21.15.40:0/3673572271 shutdown_connections 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.381+0000 7f9a52daa640 1 -- 172.21.15.40:0/3673572271 wait complete. 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.382+0000 7f9a52daa640 1 Processor -- start 2024-04-14T09:58:33.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.382+0000 7f9a52daa640 1 -- start start 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 0x7f9a4c0cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c1629e0 0x7f9a4c0b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c0d0350 con 0x7f9a4c162f30 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9a4c0d1640 con 0x7f9a4c1629e0 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a52daa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9a4c0d04d0 con 0x7f9a4c162600 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a51347640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a4bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c1629e0 0x7f9a4c0b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a50b46640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 0x7f9a4c0cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.383+0000 7f9a51347640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42378/0 (socket says 172.21.15.40:42378) 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a51347640 1 -- 172.21.15.40:0/2510148446 learned_addr learned my addr 172.21.15.40:0/2510148446 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 -- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c1629e0 msgr2=0x7f9a4c0b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c1629e0 0x7f9a4c0b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 -- 172.21.15.40:0/2510148446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 msgr2=0x7f9a4c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 -- 172.21.15.40:0/2510148446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a4c0b5dc0 con 0x7f9a4c162600 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a51347640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a50b46640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 0x7f9a4c0cb9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c400 tx=0x7f9a4000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a40017070 con 0x7f9a4c162600 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a400035f0 con 0x7f9a4c162600 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a400039e0 con 0x7f9a4c162600 2024-04-14T09:58:33.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a4c0b60a0 con 0x7f9a4c162600 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.384+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a4c0b6660 con 0x7f9a4c162600 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.385+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a4c075760 con 0x7f9a4c162600 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.386+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9a4001a070 con 0x7f9a4c162600 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.386+0000 7f9a497fa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 0x7f9a3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.386+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a4008b180 con 0x7f9a4c162600 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.386+0000 7f9a4bfff640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 0x7f9a3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.387+0000 7f9a4bfff640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 0x7f9a3006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a38036000 tx=0x7f9a38008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.391+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9a40058c20 con 0x7f9a4c162600 2024-04-14T09:58:33.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.576+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9a4c0d0f30 con 0x7f9a4c162600 2024-04-14T09:58:33.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.577+0000 7f9a497fa640 1 -- 172.21.15.40:0/2510148446 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9a4005cf20 con 0x7f9a4c162600 2024-04-14T09:58:33.578 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 msgr2=0x7f9a3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 0x7f9a3006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9a38036000 tx=0x7f9a38008030 comp rx=0 tx=0).stop 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 msgr2=0x7f9a4c0cb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 0x7f9a4c0cb9f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9a4000c400 tx=0x7f9a4000c8c0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 shutdown_connections 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9a3006c920 0x7f9a3006ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9a4c162f30 0x7f9a4c141fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9a4c1629e0 0x7f9a4c0b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 --2- 172.21.15.40:0/2510148446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9a4c162600 0x7f9a4c0cb9f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 >> 172.21.15.40:0/2510148446 conn(0x7f9a4c0b3c20 msgr2=0x7f9a4c0ccba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 shutdown_connections 2024-04-14T09:58:33.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.579+0000 7f9a52daa640 1 -- 172.21.15.40:0/2510148446 wait complete. 2024-04-14T09:58:33.590 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:58:33.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.695+0000 7fcfd7755640 1 Processor -- start 2024-04-14T09:58:33.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 -- start start 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd00d0cc0 0x7fcfd00d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfd00b1e60 0x7fcfd00b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfd00b10e0 con 0x7fcfd0161c80 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fcfd00d1660 con 0x7fcfd00b1e60 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.696+0000 7fcfd7755640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00b1380 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd5cf2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcfd00b1e60 0x7fcfd00b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd54f1640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcfd0161c80 0x7fcfd00d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57650/0 (socket says 172.21.15.40:57650) 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd54f1640 1 -- 172.21.15.40:0/2678772169 learned_addr learned my addr 172.21.15.40:0/2678772169 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd4cf0640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd00d0cc0 0x7fcfd00d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd5cf2640 1 -- 172.21.15.40:0/2678772169 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd00d0cc0 msgr2=0x7fcfd00d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd5cf2640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd00d0cc0 0x7fcfd00d1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd5cf2640 1 -- 172.21.15.40:0/2678772169 >> v1:172.21.15.40:6789/0 conn(0x7fcfd0161c80 legacy=0x7fcfd00d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfd5cf2640 1 -- 172.21.15.40:0/2678772169 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00b1660 con 0x7fcfd00b1e60 2024-04-14T09:58:33.698 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.697+0000 7fcfcffff640 1 -- 172.21.15.40:0/2678772169 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223009477 0 0) 0x7fcfd00b10e0 con 0x7fcfd0161c80 2024-04-14T09:58:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd5cf2640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00b22f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009dc0 tx=0x7fcfc002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f24e52be1fdbbb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfcffff640 1 -- 172.21.15.40:0/2678772169 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0039070 con 0x7fcfd00b1e60 2024-04-14T09:58:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfcffff640 1 -- 172.21.15.40:0/2678772169 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc002cbb0 con 0x7fcfd00b1e60 2024-04-14T09:58:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfcffff640 1 -- 172.21.15.40:0/2678772169 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0034440 con 0x7fcfd00b1e60 2024-04-14T09:58:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 -- 172.21.15.40:0/2678772169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00b1e60 msgr2=0x7fcfd00b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00b22f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0009dc0 tx=0x7fcfc002be00 comp rx=0 tx=0).stop 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 -- 172.21.15.40:0/2678772169 shutdown_connections 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00b22f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 --2- 172.21.15.40:0/2678772169 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd00d0cc0 0x7fcfd00d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 -- 172.21.15.40:0/2678772169 >> 172.21.15.40:0/2678772169 conn(0x7fcfd009d5e0 msgr2=0x7fcfd00d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 -- 172.21.15.40:0/2678772169 shutdown_connections 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.698+0000 7fcfd7755640 1 -- 172.21.15.40:0/2678772169 wait complete. 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 Processor -- start 2024-04-14T09:58:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 -- start start 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00c9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd0161c80 0x7fcfd00b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00d0180 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfd00d3340 con 0x7fcfd00b1e60 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd7755640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcfd00d0300 con 0x7fcfd0161c80 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd4cf0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd4cf0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42400/0 (socket says 172.21.15.40:42400) 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.700+0000 7fcfd4cf0640 1 -- 172.21.15.40:0/1095760332 learned_addr learned my addr 172.21.15.40:0/1095760332 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd5cf2640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd0161c80 0x7fcfd00b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd54f1640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00c9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 -- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd0161c80 msgr2=0x7fcfd00b6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd0161c80 0x7fcfd00b6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 -- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd00b1e60 msgr2=0x7fcfd00c9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00c9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 -- 172.21.15.40:0/1095760332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfd00cccb0 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd4cf0640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400e9b0 tx=0x7fcfc400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc4017070 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfc400c9a0 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfd00ca020 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfc400cd90 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.701+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfd00b5660 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.702+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfd0075760 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.703+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfc401a070 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.703+0000 7fcfcdffb640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 0x7fcfbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.703+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfc408be00 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.703+0000 7fcfd54f1640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 0x7fcfbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.704+0000 7fcfd54f1640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 0x7fcfbc06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000f60 tx=0x7fcfc8007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:33.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.708+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcfc4059890 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.890+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcfd006c7f0 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.890 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.890+0000 7fcfcdffb640 1 -- 172.21.15.40:0/1095760332 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7fcfc405db90 con 0x7fcfd00d0cc0 2024-04-14T09:58:33.890 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 msgr2=0x7fcfbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 0x7fcfbc06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000f60 tx=0x7fcfc8007d50 comp rx=0 tx=0).stop 2024-04-14T09:58:33.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 msgr2=0x7fcfd00b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfc400e9b0 tx=0x7fcfc400ee70 comp rx=0 tx=0).stop 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 shutdown_connections 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcfbc06c8f0 0x7fcfbc06edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfd0161c80 0x7fcfd00b6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfd00d0cc0 0x7fcfd00b5120 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 --2- 172.21.15.40:0/1095760332 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfd00b1e60 0x7fcfd00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 >> 172.21.15.40:0/1095760332 conn(0x7fcfd009d5e0 msgr2=0x7fcfd006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.892+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 shutdown_connections 2024-04-14T09:58:33.893 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:33.893+0000 7fcfd7755640 1 -- 172.21.15.40:0/1095760332 wait complete. 2024-04-14T09:58:33.903 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:58:34.006 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.007+0000 7f350e708640 1 Processor -- start 2024-04-14T09:58:34.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.007+0000 7f350e708640 1 -- start start 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f350e708640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350809aa40 0x7f3508070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f350e708640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35080b4700 0x7f350809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f350e708640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35080d1e60 con 0x7f350806f560 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f350e708640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f35080b19c0 con 0x7f350809aa40 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f350e708640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35080d1670 con 0x7f35080b4700 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350809aa40 0x7f3508070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f350809aa40 0x7f3508070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42404/0 (socket says 172.21.15.40:42404) 2024-04-14T09:58:34.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 -- 172.21.15.40:0/2437500628 learned_addr learned my addr 172.21.15.40:0/2437500628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f35077fe640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35080b4700 0x7f350809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 -- 172.21.15.40:0/2437500628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35080b4700 msgr2=0x7f350809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35080b4700 0x7f350809ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 -- 172.21.15.40:0/2437500628 >> v1:172.21.15.136:6789/0 conn(0x7f350806f560 legacy=0x7f350806f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.008+0000 7f3507fff640 1 -- 172.21.15.40:0/2437500628 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350809b360 con 0x7f350809aa40 2024-04-14T09:58:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f3507fff640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f3508070810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009870 tx=0x7f34f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af09452e57178bad server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.016 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f3506ffd640 1 -- 172.21.15.40:0/2437500628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8034070 con 0x7f350809aa40 2024-04-14T09:58:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f3506ffd640 1 -- 172.21.15.40:0/2437500628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f8030840 con 0x7f350809aa40 2024-04-14T09:58:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f3506ffd640 1 -- 172.21.15.40:0/2437500628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f8030c10 con 0x7f350809aa40 2024-04-14T09:58:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f350e708640 1 -- 172.21.15.40:0/2437500628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 msgr2=0x7f3508070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.009+0000 7f350e708640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f3508070810 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f34f8009870 tx=0x7f34f802b980 comp rx=0 tx=0).stop 2024-04-14T09:58:34.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 -- 172.21.15.40:0/2437500628 shutdown_connections 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35080b4700 0x7f350809ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 --2- 172.21.15.40:0/2437500628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f3508070810 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 -- 172.21.15.40:0/2437500628 >> 172.21.15.40:0/2437500628 conn(0x7f35080b3be0 msgr2=0x7f35080b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 -- 172.21.15.40:0/2437500628 shutdown_connections 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.010+0000 7f350e708640 1 -- 172.21.15.40:0/2437500628 wait complete. 2024-04-14T09:58:34.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.011+0000 7f350e708640 1 Processor -- start 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.011+0000 7f350e708640 1 -- start start 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f350806f560 0x7f350815e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35080b4700 0x7f35080c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35080710c0 con 0x7f350809aa40 2024-04-14T09:58:34.019 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3508070de0 con 0x7f35080b4700 2024-04-14T09:58:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f350806c6d0 con 0x7f350806f560 2024-04-14T09:58:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42410/0 (socket says 172.21.15.40:42410) 2024-04-14T09:58:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 -- 172.21.15.40:0/3944721083 learned_addr learned my addr 172.21.15.40:0/3944721083 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:34.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f3507fff640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f350806f560 0x7f350815e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350cca5640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35080b4700 0x7f35080c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 -- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f350806f560 msgr2=0x7f350815e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f350806f560 0x7f350815e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 -- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35080b4700 msgr2=0x7f35080c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35080b4700 0x7f35080c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 -- 172.21.15.40:0/3944721083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35080caac0 con 0x7f350809aa40 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f35077fe640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34f000e9b0 tx=0x7f34f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f0017070 con 0x7f350809aa40 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f000c9a0 con 0x7f350809aa40 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f000cd70 con 0x7f350809aa40 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35080cada0 con 0x7f350809aa40 2024-04-14T09:58:34.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.012+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35080cb360 con 0x7f350809aa40 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.013+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3508075760 con 0x7f350809aa40 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.014+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f34f001a070 con 0x7f350809aa40 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.014+0000 7f3504ff9640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 0x7f34e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.014+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f34f008c140 con 0x7f350809aa40 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.014+0000 7f3507fff640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 0x7f34e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.015+0000 7f3507fff640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 0x7f34e806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34f8036000 tx=0x7f34f8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.019+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f34f0059be0 con 0x7f350809aa40 2024-04-14T09:58:34.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.203+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f35080b0fe0 con 0x7f350809aa40 2024-04-14T09:58:34.203 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.203+0000 7f3504ff9640 1 -- 172.21.15.40:0/3944721083 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f34f005dee0 con 0x7f350809aa40 2024-04-14T09:58:34.203 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:58:34.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 msgr2=0x7f34e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 0x7f34e806ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f34f8036000 tx=0x7f34f8008030 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 msgr2=0x7f35080b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f34f000e9b0 tx=0x7f34f000ee70 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 shutdown_connections 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f34e806c920 0x7f34e806ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35080b4700 0x7f35080c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f350809aa40 0x7f35080b75c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.205+0000 7f350e708640 1 --2- 172.21.15.40:0/3944721083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f350806f560 0x7f350815e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.206+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 >> 172.21.15.40:0/3944721083 conn(0x7f35080b3be0 msgr2=0x7f35080700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.206+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 shutdown_connections 2024-04-14T09:58:34.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.206+0000 7f350e708640 1 -- 172.21.15.40:0/3944721083 wait complete. 2024-04-14T09:58:34.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:58:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.320+0000 7f54b0e20640 1 Processor -- start 2024-04-14T09:58:34.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.320+0000 7f54b0e20640 1 -- start start 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54b0e20640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 0x7f54ac0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54b0e20640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54ac0d13d0 0x7f54ac0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54b0e20640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0b10e0 con 0x7f54ac0d2e50 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54b0e20640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f54ac0b1380 con 0x7f54ac0d13d0 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54b0e20640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0b1660 con 0x7f54ac161c80 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54ac0d13d0 0x7f54ac0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f54ac0d13d0 0x7f54ac0b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42426/0 (socket says 172.21.15.40:42426) 2024-04-14T09:58:34.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 -- 172.21.15.40:0/672953296 learned_addr learned my addr 172.21.15.40:0/672953296 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aa59c640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 0x7f54ac0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 -- 172.21.15.40:0/672953296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 msgr2=0x7f54ac0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 0x7f54ac0d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 -- 172.21.15.40:0/672953296 >> v1:172.21.15.136:6789/0 conn(0x7f54ac0d2e50 legacy=0x7f54ac0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aad9d640 1 -- 172.21.15.40:0/672953296 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0d3340 con 0x7f54ac0d13d0 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54a959a640 1 -- 172.21.15.40:0/672953296 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396159176 0 0) 0x7f54ac0b10e0 con 0x7f54ac0d2e50 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.321+0000 7f54aa59c640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 0x7f54ac0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.322+0000 7f54aad9d640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac0d13d0 0x7f54ac0b1e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f549c009e50 tx=0x7f549c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276bf50e239babc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.322+0000 7f54a959a640 1 -- 172.21.15.40:0/672953296 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c02ca70 con 0x7f54ac0d13d0 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.322+0000 7f54a959a640 1 -- 172.21.15.40:0/672953296 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c02cc10 con 0x7f54ac0d13d0 2024-04-14T09:58:34.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.322+0000 7f54a959a640 1 -- 172.21.15.40:0/672953296 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c0343f0 con 0x7f54ac0d13d0 2024-04-14T09:58:34.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 -- 172.21.15.40:0/672953296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac0d13d0 msgr2=0x7f54ac0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac0d13d0 0x7f54ac0b1e60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f549c009e50 tx=0x7f549c02bed0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 -- 172.21.15.40:0/672953296 shutdown_connections 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac0d13d0 0x7f54ac0b1e60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 --2- 172.21.15.40:0/672953296 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac161c80 0x7f54ac0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 -- 172.21.15.40:0/672953296 >> 172.21.15.40:0/672953296 conn(0x7f54ac09d5e0 msgr2=0x7f54ac0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 -- 172.21.15.40:0/672953296 shutdown_connections 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.323+0000 7f54b0e20640 1 -- 172.21.15.40:0/672953296 wait complete. 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.324+0000 7f54b0e20640 1 Processor -- start 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.324+0000 7f54b0e20640 1 -- start start 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac0d13d0 0x7f54ac1f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54ac0d2e50 0x7f54ac0c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b2520 con 0x7f54ac161c80 2024-04-14T09:58:34.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f54ac0b23a0 con 0x7f54ac0d2e50 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54b0e20640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f54ac0b26a0 con 0x7f54ac0d13d0 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42430/0 (socket says 172.21.15.40:42430) 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 -- 172.21.15.40:0/1149073245 learned_addr learned my addr 172.21.15.40:0/1149073245 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aa59c640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac0d13d0 0x7f54ac1f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54a9d9b640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54ac0d2e50 0x7f54ac0c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 -- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac0d13d0 msgr2=0x7f54ac1f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac0d13d0 0x7f54ac1f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 -- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54ac0d2e50 msgr2=0x7f54ac0c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54ac0d2e50 0x7f54ac0c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.325+0000 7f54aad9d640 1 -- 172.21.15.40:0/1149073245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0c8a90 con 0x7f54ac161c80 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54aad9d640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f549c036040 tx=0x7f549c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c043020 con 0x7f54ac161c80 2024-04-14T09:58:34.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549c03e450 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac0c8d70 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f549c009510 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.326+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54ac0c9330 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.327+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54ac075760 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.327+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f549c046020 con 0x7f54ac161c80 2024-04-14T09:58:34.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.328+0000 7f54a2ffd640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 0x7f548c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.328+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f549c0ae530 con 0x7f54ac161c80 2024-04-14T09:58:34.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.328+0000 7f54aa59c640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 0x7f548c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.328+0000 7f54aa59c640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 0x7f548c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009560 tx=0x7f54a4009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.332+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f549c04d030 con 0x7f54ac161c80 2024-04-14T09:58:34.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.517+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f54ac0d2660 con 0x7f54ac161c80 2024-04-14T09:58:34.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.517+0000 7f54a2ffd640 1 -- 172.21.15.40:0/1149073245 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f549c07bf40 con 0x7f54ac161c80 2024-04-14T09:58:34.517 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 msgr2=0x7f548c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 0x7f548c06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009560 tx=0x7f54a4009190 comp rx=0 tx=0).stop 2024-04-14T09:58:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 msgr2=0x7f54ac0ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f549c036040 tx=0x7f549c004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 shutdown_connections 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f548c06c8f0 0x7f548c06edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f54ac161c80 0x7f54ac0ca400 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f54ac0d2e50 0x7f54ac0c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 --2- 172.21.15.40:0/1149073245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f54ac0d13d0 0x7f54ac1f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 >> 172.21.15.40:0/1149073245 conn(0x7f54ac09d5e0 msgr2=0x7f54ac0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 shutdown_connections 2024-04-14T09:58:34.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.519+0000 7f54b0e20640 1 -- 172.21.15.40:0/1149073245 wait complete. 2024-04-14T09:58:34.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:58:34.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.632+0000 7fa5ffbbb640 1 Processor -- start 2024-04-14T09:58:34.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.632+0000 7fa5ffbbb640 1 -- start start 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5ffbbb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa5f815e700 0x7fa5f80d20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5ffbbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f80d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5ffbbb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5f815eae0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5ffbbb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa5f80b4310 con 0x7fa5f815e700 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5ffbbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f80d2610 con 0x7fa5f80cf910 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fe158640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa5f80d2e10 0x7fa5f80d0920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57664/0 (socket says 172.21.15.40:57664) 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fe158640 1 -- 172.21.15.40:0/671281709 learned_addr learned my addr 172.21.15.40:0/671281709 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fd957640 1 --2- 172.21.15.40:0/671281709 >> v2:172.21.15.136:3300/0 conn(0x7fa5f815e700 0x7fa5f80d20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fd156640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f80d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fc955640 1 -- 172.21.15.40:0/671281709 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034919479 0 0) 0x7fa5f815eae0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.633+0000 7fa5fc955640 1 -- 172.21.15.40:0/671281709 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5e0003520 con 0x7fa5f80d2e10 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd957640 1 -- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 msgr2=0x7fa5f80d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd957640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f80d28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd957640 1 -- 172.21.15.40:0/671281709 >> v1:172.21.15.40:6789/0 conn(0x7fa5f80d2e10 legacy=0x7fa5f80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd957640 1 -- 172.21.15.40:0/671281709 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f80cfe60 con 0x7fa5f815e700 2024-04-14T09:58:34.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd156640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.634+0000 7fa5fd957640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f80d20d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097a0 tx=0x7fa5f002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59de2bb2aa969d86 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5fc955640 1 -- 172.21.15.40:0/671281709 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0035020 con 0x7fa5f815e700 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5fc955640 1 -- 172.21.15.40:0/671281709 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0031830 con 0x7fa5f815e700 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5fc955640 1 -- 172.21.15.40:0/671281709 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0031c00 con 0x7fa5f815e700 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 msgr2=0x7fa5f80d20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f80d20d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00097a0 tx=0x7fa5f002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/671281709 shutdown_connections 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f80d28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/671281709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f80d20d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/671281709 >> 172.21.15.40:0/671281709 conn(0x7fa5f809d5c0 msgr2=0x7fa5f80d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/671281709 shutdown_connections 2024-04-14T09:58:34.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.635+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/671281709 wait complete. 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.636+0000 7fa5ffbbb640 1 Processor -- start 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.636+0000 7fa5ffbbb640 1 -- start start 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f8154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f80b3fa0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f80b3cc0 con 0x7fa5f815e700 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5ffbbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa5f80b57b0 con 0x7fa5f80cf910 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42434/0 (socket says 172.21.15.40:42434) 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 -- 172.21.15.40:0/2699327281 learned_addr learned my addr 172.21.15.40:0/2699327281 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:34.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd957640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f8154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fe158640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 -- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 msgr2=0x7fa5f8154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f8154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 -- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 msgr2=0x7fa5f81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f81565e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.637+0000 7fa5fd156640 1 -- 172.21.15.40:0/2699327281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5f81547a0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5fd156640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00ebe0 tx=0x7fa5ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.642 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec017070 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec00cc30 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f8154a40 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec013470 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.638+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f8155000 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.639+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8075760 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.639+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5ec01a070 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.640+0000 7fa5f67fc640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 0x7fa5e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.640+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa5ec08bdd0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.640+0000 7fa5fd957640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 0x7fa5e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:34.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.640+0000 7fa5fd957640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 0x7fa5e406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:34.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.644+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa5ec0597e0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.840+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5f80d0ce0 con 0x7fa5f80d2e10 2024-04-14T09:58:34.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.840+0000 7fa5f67fc640 1 -- 172.21.15.40:0/2699327281 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa5ec08d080 con 0x7fa5f80d2e10 2024-04-14T09:58:34.840 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:58:34.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 msgr2=0x7fa5e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 0x7fa5e406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f003c040 comp rx=0 tx=0).stop 2024-04-14T09:58:34.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 msgr2=0x7fa5f8152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00ebe0 tx=0x7fa5ec00c520 comp rx=0 tx=0).stop 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 shutdown_connections 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5e406c8f0 0x7fa5e406edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5f815e700 0x7fa5f81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa5f80d2e10 0x7fa5f8152da0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 --2- 172.21.15.40:0/2699327281 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5f80cf910 0x7fa5f8154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:34.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 >> 172.21.15.40:0/2699327281 conn(0x7fa5f809d5c0 msgr2=0x7fa5f80d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:34.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 shutdown_connections 2024-04-14T09:58:34.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:34.842+0000 7fa5ffbbb640 1 -- 172.21.15.40:0/2699327281 wait complete. 2024-04-14T09:58:34.853 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:58:34.853 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:58:34.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:35.017 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.018+0000 7f93d737b640 1 Processor -- start 2024-04-14T09:58:35.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.018+0000 7f93d737b640 1 -- start start 2024-04-14T09:58:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93d015e510 0x7f93d00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93d00d2800 0x7f93d00d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f93d00d31c0 con 0x7f93d00d2800 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f93d00ceda0 con 0x7f93d015e510 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d737b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f93d00cf040 con 0x7f93d00d0e90 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93d00d2800 0x7f93d00d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f93d00d2800 0x7f93d00d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42438/0 (socket says 172.21.15.40:42438) 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 -- 172.21.15.40:0/2126911888 learned_addr learned my addr 172.21.15.40:0/2126911888 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d5117640 1 --2- 172.21.15.40:0/2126911888 >> v2:172.21.15.136:3300/0 conn(0x7f93d015e510 0x7f93d00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d5918640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 -- 172.21.15.40:0/2126911888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 msgr2=0x7f93d00d12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00d12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 -- 172.21.15.40:0/2126911888 >> v2:172.21.15.136:3300/0 conn(0x7f93d015e510 msgr2=0x7f93d00cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 --2- 172.21.15.40:0/2126911888 >> v2:172.21.15.136:3300/0 conn(0x7f93d015e510 0x7f93d00cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.019+0000 7f93d4916640 1 -- 172.21.15.40:0/2126911888 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d00cf320 con 0x7f93d00d2800 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d4916640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d00d2c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93d008e0f0 tx=0x7f93c002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bf6ba6476f20de server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93c7fff640 1 -- 172.21.15.40:0/2126911888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c002e070 con 0x7f93d00d2800 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93c7fff640 1 -- 172.21.15.40:0/2126911888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0037070 con 0x7f93d00d2800 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93c7fff640 1 -- 172.21.15.40:0/2126911888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0031a00 con 0x7f93d00d2800 2024-04-14T09:58:35.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 -- 172.21.15.40:0/2126911888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 msgr2=0x7f93d00d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d00d2c80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f93d008e0f0 tx=0x7f93c002b880 comp rx=0 tx=0).stop 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 -- 172.21.15.40:0/2126911888 shutdown_connections 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00d12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 --2- 172.21.15.40:0/2126911888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d00d2c80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 --2- 172.21.15.40:0/2126911888 >> v2:172.21.15.136:3300/0 conn(0x7f93d015e510 0x7f93d00cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.020+0000 7f93d737b640 1 -- 172.21.15.40:0/2126911888 >> 172.21.15.40:0/2126911888 conn(0x7f93d009d570 msgr2=0x7f93d00d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.021+0000 7f93d737b640 1 -- 172.21.15.40:0/2126911888 shutdown_connections 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.021+0000 7f93d737b640 1 -- 172.21.15.40:0/2126911888 wait complete. 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 Processor -- start 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 -- start start 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00b8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 0x7f93d00b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f93d00d1820 con 0x7f93d00d2800 2024-04-14T09:58:35.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93d015e8f0 con 0x7f93d015e510 2024-04-14T09:58:35.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d737b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f93d00d19a0 con 0x7f93d00d0e90 2024-04-14T09:58:35.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d4916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.022+0000 7f93d4916640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42450/0 (socket says 172.21.15.40:42450) 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 -- 172.21.15.40:0/2412588731 learned_addr learned my addr 172.21.15.40:0/2412588731 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d5117640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00b8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d5918640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 0x7f93d00b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 -- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 msgr2=0x7f93d00b8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00b8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 -- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 msgr2=0x7f93d00b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 0x7f93d00b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 -- 172.21.15.40:0/2412588731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d00b78c0 con 0x7f93d00d2800 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d5918640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 0x7f93d00b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d4916640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0032670 con 0x7f93d00d2800 2024-04-14T09:58:35.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93c0032810 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d00b7ba0 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93c0032c00 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.023+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d00b8160 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.024+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d00756f0 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.025+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93c00453f0 con 0x7f93d00d2800 2024-04-14T09:58:35.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.025+0000 7f93c5ffb640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 0x7f93b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.025+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93c00ada10 con 0x7f93d00d2800 2024-04-14T09:58:35.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.025+0000 7f93d5117640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 0x7f93b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.026+0000 7f93d5117640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 0x7f93b406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009aa0 tx=0x7f93cc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.029+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f93c0040070 con 0x7f93d00d2800 2024-04-14T09:58:35.214 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.214+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93d006dbd0 con 0x7f93d00d2800 2024-04-14T09:58:35.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.215+0000 7f93c5ffb640 1 -- 172.21.15.40:0/2412588731 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f93c007b570 con 0x7f93d00d2800 2024-04-14T09:58:35.215 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:35.215 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:35.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 msgr2=0x7f93b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 0x7f93b406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f93cc009aa0 tx=0x7f93cc009190 comp rx=0 tx=0).stop 2024-04-14T09:58:35.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 msgr2=0x7f93d014e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f93c0000c00 tx=0x7f93c00046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 shutdown_connections 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93b406c8f0 0x7f93b406edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93d015e510 0x7f93d00b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93d00d2800 0x7f93d014e6d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 --2- 172.21.15.40:0/2412588731 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93d00d0e90 0x7f93d00b8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 >> 172.21.15.40:0/2412588731 conn(0x7f93d009d570 msgr2=0x7f93d015fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 shutdown_connections 2024-04-14T09:58:35.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.217+0000 7f93d737b640 1 -- 172.21.15.40:0/2412588731 wait complete. 2024-04-14T09:58:35.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:58:35.229 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:35.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.335+0000 7f42d4ade640 1 Processor -- start 2024-04-14T09:58:35.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.335+0000 7f42d4ade640 1 -- start start 2024-04-14T09:58:35.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f42d015c340 0x7f42d00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c720 0x7f42d006f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d00cd4c0 0x7f42d00cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f42d00d0710 con 0x7f42d00cd4c0 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f42d00cd030 con 0x7f42d015c340 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42d4ade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00d0960 con 0x7f42d015c720 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42ced9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d00cd4c0 0x7f42d00cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42ced9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f42d00cd4c0 0x7f42d00cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42458/0 (socket says 172.21.15.40:42458) 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42ced9d640 1 -- 172.21.15.40:0/4044139610 learned_addr learned my addr 172.21.15.40:0/4044139610 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42cdd9b640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c720 0x7f42d006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.336+0000 7f42ce59c640 1 --2- 172.21.15.40:0/4044139610 >> v2:172.21.15.136:3300/0 conn(0x7f42d015c340 0x7f42d00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 -- 172.21.15.40:0/4044139610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c720 msgr2=0x7f42d006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c720 0x7f42d006f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 -- 172.21.15.40:0/4044139610 >> v2:172.21.15.136:3300/0 conn(0x7f42d015c340 msgr2=0x7f42d00b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 --2- 172.21.15.40:0/4044139610 >> v2:172.21.15.136:3300/0 conn(0x7f42d015c340 0x7f42d00b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 -- 172.21.15.40:0/4044139610 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00d0c40 con 0x7f42d00cd4c0 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.337+0000 7f42ced9d640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00cd940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42d0072040 tx=0x7f42c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4dff6b6e418de3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42cd59a640 1 -- 172.21.15.40:0/4044139610 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c002ca70 con 0x7f42d00cd4c0 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42cd59a640 1 -- 172.21.15.40:0/4044139610 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c002cc10 con 0x7f42d00cd4c0 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42cd59a640 1 -- 172.21.15.40:0/4044139610 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00343f0 con 0x7f42d00cd4c0 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 -- 172.21.15.40:0/4044139610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 msgr2=0x7f42d00cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00cd940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f42d0072040 tx=0x7f42c002bed0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 -- 172.21.15.40:0/4044139610 shutdown_connections 2024-04-14T09:58:35.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00cd940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 --2- 172.21.15.40:0/4044139610 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c720 0x7f42d006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 --2- 172.21.15.40:0/4044139610 >> v2:172.21.15.136:3300/0 conn(0x7f42d015c340 0x7f42d00b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 -- 172.21.15.40:0/4044139610 >> 172.21.15.40:0/4044139610 conn(0x7f42d00b3c20 msgr2=0x7f42d00b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 -- 172.21.15.40:0/4044139610 shutdown_connections 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.338+0000 7f42d4ade640 1 -- 172.21.15.40:0/4044139610 wait complete. 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 Processor -- start 2024-04-14T09:58:35.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 -- start start 2024-04-14T09:58:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c340 0x7f42d01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d015c720 0x7f42d015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00cde80 con 0x7f42d00cd4c0 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f42d00ccc20 con 0x7f42d015c720 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42d4ade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f42d00ce000 con 0x7f42d015c340 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42ce59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42ce59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42468/0 (socket says 172.21.15.40:42468) 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42ce59c640 1 -- 172.21.15.40:0/1035332131 learned_addr learned my addr 172.21.15.40:0/1035332131 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42ced9d640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d015c720 0x7f42d015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.340+0000 7f42cdd9b640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c340 0x7f42d01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 -- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c340 msgr2=0x7f42d01f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c340 0x7f42d01f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 -- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d015c720 msgr2=0x7f42d015cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d015c720 0x7f42d015cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 -- 172.21.15.40:0/1035332131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d00c6f80 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42ce59c640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e890 tx=0x7f42c800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c8017070 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c800c940 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d00c7260 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c800cd10 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.341+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d00c7820 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.342+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d0075760 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.342+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f42c801a070 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.343+0000 7f42c6ffd640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 0x7f42b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.343+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42c808c090 con 0x7f42d00cd4c0 2024-04-14T09:58:35.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.343+0000 7f42cdd9b640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 0x7f42b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.343+0000 7f42cdd9b640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 0x7f42b006edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42d015a840 tx=0x7f42b8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.347+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f42c8059bc0 con 0x7f42d00cd4c0 2024-04-14T09:58:35.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.532+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f42d00b80b0 con 0x7f42d00cd4c0 2024-04-14T09:58:35.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.533+0000 7f42c6ffd640 1 -- 172.21.15.40:0/1035332131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f42c805dec0 con 0x7f42d00cd4c0 2024-04-14T09:58:35.533 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:35.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 msgr2=0x7f42b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 0x7f42b006edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f42d015a840 tx=0x7f42b8009190 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 msgr2=0x7f42d00c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f42c800e890 tx=0x7f42c800ed50 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 shutdown_connections 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f42b006c8f0 0x7f42b006edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42d015c720 0x7f42d015cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42d015c340 0x7f42d01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 --2- 172.21.15.40:0/1035332131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42d00cd4c0 0x7f42d00c8020 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 >> 172.21.15.40:0/1035332131 conn(0x7f42d00b3c20 msgr2=0x7f42d00b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 shutdown_connections 2024-04-14T09:58:35.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.535+0000 7f42d4ade640 1 -- 172.21.15.40:0/1035332131 wait complete. 2024-04-14T09:58:35.545 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:58:35.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.649+0000 7f537bb1e640 1 Processor -- start 2024-04-14T09:58:35.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.649+0000 7f537bb1e640 1 -- start start 2024-04-14T09:58:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537bb1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537bb1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f537415c720 0x7f537406f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537bb1e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53740d0960 con 0x7f53740cd4c0 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537bb1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f53740d0710 con 0x7f537415c720 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537bb1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f53740cd030 con 0x7f537415c340 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f53790b9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f537415c720 0x7f537406f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f53798ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f53790b9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f537415c720 0x7f537406f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:49454/0 (socket says 172.21.15.40:49454) 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f53798ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:34066/0 (socket says 172.21.15.40:34066) 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f53790b9640 1 -- 172.21.15.40:0/3481381546 learned_addr learned my addr 172.21.15.40:0/3481381546 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.650+0000 7f537a0bb640 1 --1- 172.21.15.40:0/3481381546 >> v1:172.21.15.136:6789/0 conn(0x7f53740cd4c0 0x7f53740cd940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:46756/0 (socket says 172.21.15.40:46756) 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53790b9640 1 -- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 msgr2=0x7f53740b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53790b9640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53790b9640 1 -- 172.21.15.40:0/3481381546 >> v1:172.21.15.136:6789/0 conn(0x7f53740cd4c0 legacy=0x7f53740cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53790b9640 1 -- 172.21.15.40:0/3481381546 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53740d0c40 con 0x7f537415c720 2024-04-14T09:58:35.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53798ba640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.651+0000 7f53790b9640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f537406f630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5368009870 tx=0x7f536802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6553fc0d446f902 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f53788b8640 1 -- 172.21.15.40:0/3481381546 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368034070 con 0x7f537415c720 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f53788b8640 1 -- 172.21.15.40:0/3481381546 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5368030840 con 0x7f537415c720 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f53788b8640 1 -- 172.21.15.40:0/3481381546 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368030c10 con 0x7f537415c720 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 -- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 msgr2=0x7f537406f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f537406f630 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5368009870 tx=0x7f536802b980 comp rx=0 tx=0).stop 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 -- 172.21.15.40:0/3481381546 shutdown_connections 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f537406f630 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 --2- 172.21.15.40:0/3481381546 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f537415c340 0x7f53740b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 -- 172.21.15.40:0/3481381546 >> 172.21.15.40:0/3481381546 conn(0x7f53740b3c20 msgr2=0x7f53740b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 -- 172.21.15.40:0/3481381546 shutdown_connections 2024-04-14T09:58:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.652+0000 7f537bb1e640 1 -- 172.21.15.40:0/3481381546 wait complete. 2024-04-14T09:58:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.653+0000 7f537bb1e640 1 Processor -- start 2024-04-14T09:58:35.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.653+0000 7f537bb1e640 1 -- start start 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53740cd4c0 0x7f5374159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f53740cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f53740ccc20 con 0x7f537415c340 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f53740ce050 con 0x7f537415c720 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537bb1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f537409aa40 con 0x7f53740cd4c0 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f53790b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f53790b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42476/0 (socket says 172.21.15.40:42476) 2024-04-14T09:58:35.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f53790b9640 1 -- 172.21.15.40:0/4103317397 learned_addr learned my addr 172.21.15.40:0/4103317397 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f53798ba640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53740cd4c0 0x7f5374159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.654+0000 7f537a0bb640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f53740cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 -- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53740cd4c0 msgr2=0x7f5374159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53740cd4c0 0x7f5374159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 -- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 msgr2=0x7f53740cb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f53740cb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 -- 172.21.15.40:0/4103317397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f537415ee80 con 0x7f537415c340 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53790b9640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f536802b9c0 tx=0x7f53680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368034040 con 0x7f537415c340 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5368039d90 con 0x7f537415c340 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f537415f160 con 0x7f537415c340 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5368043630 con 0x7f537415c340 2024-04-14T09:58:35.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.655+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53740c6b50 con 0x7f537415c340 2024-04-14T09:58:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.656+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53740b2ab0 con 0x7f537415c340 2024-04-14T09:58:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.656+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f536804a060 con 0x7f537415c340 2024-04-14T09:58:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.657+0000 7f53727fc640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.657+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f53680adca0 con 0x7f537415c340 2024-04-14T09:58:35.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.657+0000 7f53798ba640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.658+0000 7f53798ba640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f536c009560 tx=0x7f536c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.661+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f53740b2ab0 con 0x7f537415c340 2024-04-14T09:58:35.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.847+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5374075760 con 0x7f537415c340 2024-04-14T09:58:35.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.847+0000 7f53727fc640 1 -- 172.21.15.40:0/4103317397 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f536803e070 con 0x7f537415c340 2024-04-14T09:58:35.847 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 msgr2=0x7f536006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 0x7f536006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f536c009560 tx=0x7f536c009190 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 msgr2=0x7f537415e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f536802b9c0 tx=0x7f53680046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 shutdown_connections 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f536006c8f0 0x7f536006edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f537415c720 0x7f53740cb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f537415c340 0x7f537415e570 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 --2- 172.21.15.40:0/4103317397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53740cd4c0 0x7f5374159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 >> 172.21.15.40:0/4103317397 conn(0x7f53740b3c20 msgr2=0x7f537415b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 shutdown_connections 2024-04-14T09:58:35.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.849+0000 7f537bb1e640 1 -- 172.21.15.40:0/4103317397 wait complete. 2024-04-14T09:58:35.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:58:35.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.964+0000 7f48e2436640 1 Processor -- start 2024-04-14T09:58:35.964 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.964+0000 7f48e2436640 1 -- start start 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e2436640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f48dc0c7e30 0x7f48dc0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e2436640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48dc15e7b0 0x7f48dc0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e2436640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48dc0d2f30 con 0x7f48dc15e3d0 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e2436640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f48dc0cf000 con 0x7f48dc15e7b0 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e2436640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f48dc0cf2e0 con 0x7f48dc0c7e30 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48dc15e7b0 0x7f48dc0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48dc15e7b0 0x7f48dc0d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42486/0 (socket says 172.21.15.40:42486) 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 -- 172.21.15.40:0/2262229556 learned_addr learned my addr 172.21.15.40:0/2262229556 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.966 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48db7fe640 1 --2- 172.21.15.40:0/2262229556 >> v2:172.21.15.136:3300/0 conn(0x7f48dc0c7e30 0x7f48dc0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 -- 172.21.15.40:0/2262229556 >> v2:172.21.15.136:3300/0 conn(0x7f48dc0c7e30 msgr2=0x7f48dc0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 --2- 172.21.15.40:0/2262229556 >> v2:172.21.15.136:3300/0 conn(0x7f48dc0c7e30 0x7f48dc0d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48daffd640 1 -- 172.21.15.40:0/2262229556 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4197468745 0 0) 0x7f48dc0d2f30 con 0x7f48dc15e3d0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 -- 172.21.15.40:0/2262229556 >> v1:172.21.15.136:6789/0 conn(0x7f48dc15e3d0 legacy=0x7f48dc0d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.965+0000 7f48e09d3640 1 -- 172.21.15.40:0/2262229556 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc0cf5c0 con 0x7f48dc15e7b0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.966+0000 7f48e09d3640 1 --2- 172.21.15.40:0/2262229556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc15e7b0 0x7f48dc0d26b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48dc08caf0 tx=0x7f48d402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cfa881a9411882f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.966+0000 7f48daffd640 1 -- 172.21.15.40:0/2262229556 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d402cb20 con 0x7f48dc15e7b0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.966+0000 7f48daffd640 1 -- 172.21.15.40:0/2262229556 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d402ccc0 con 0x7f48dc15e7b0 2024-04-14T09:58:35.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.966+0000 7f48daffd640 1 -- 172.21.15.40:0/2262229556 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4034610 con 0x7f48dc15e7b0 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 -- 172.21.15.40:0/2262229556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc15e7b0 msgr2=0x7f48dc0d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 --2- 172.21.15.40:0/2262229556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc15e7b0 0x7f48dc0d26b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f48dc08caf0 tx=0x7f48d402bf80 comp rx=0 tx=0).stop 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 -- 172.21.15.40:0/2262229556 shutdown_connections 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 --2- 172.21.15.40:0/2262229556 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc15e7b0 0x7f48dc0d26b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 --2- 172.21.15.40:0/2262229556 >> v2:172.21.15.136:3300/0 conn(0x7f48dc0c7e30 0x7f48dc0d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 -- 172.21.15.40:0/2262229556 >> 172.21.15.40:0/2262229556 conn(0x7f48dc08dc90 msgr2=0x7f48dc09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 -- 172.21.15.40:0/2262229556 shutdown_connections 2024-04-14T09:58:35.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.967+0000 7f48e2436640 1 -- 172.21.15.40:0/2262229556 wait complete. 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.968+0000 7f48e2436640 1 Processor -- start 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.968+0000 7f48e2436640 1 -- start start 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48dc15e3d0 0x7f48dc161480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48dc15e7b0 0x7f48dc0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc0d3390 con 0x7f48dc0c7e30 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc0d3210 con 0x7f48dc15e3d0 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e2436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc0d4740 con 0x7f48dc15e7b0 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42494/0 (socket says 172.21.15.40:42494) 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 -- 172.21.15.40:0/2114098321 learned_addr learned my addr 172.21.15.40:0/2114098321 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48e09d3640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48dc15e7b0 0x7f48dc0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48db7fe640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48dc15e3d0 0x7f48dc161480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 -- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48dc15e7b0 msgr2=0x7f48dc0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48dc15e7b0 0x7f48dc0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 -- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48dc15e3d0 msgr2=0x7f48dc161480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48dc15e3d0 0x7f48dc161480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.969+0000 7f48dbfff640 1 -- 172.21.15.40:0/2114098321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc1603e0 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48dbfff640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c4b0 tx=0x7f48c400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4017070 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c4005480 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc1606c0 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4003830 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.970+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc160c80 con 0x7f48dc0c7e30 2024-04-14T09:58:35.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.971+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48dc075760 con 0x7f48dc0c7e30 2024-04-14T09:58:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.971+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48c401a070 con 0x7f48dc0c7e30 2024-04-14T09:58:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.972+0000 7f48d8ff9640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.972+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48c408b1e0 con 0x7f48dc0c7e30 2024-04-14T09:58:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.972+0000 7f48db7fe640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:35.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.972+0000 7f48db7fe640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 0x7f48bc06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0d1700 tx=0x7f48cc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:35.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:35.976+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f48c4058c80 con 0x7f48dc0c7e30 2024-04-14T09:58:36.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.161+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48dc0b5370 con 0x7f48dc0c7e30 2024-04-14T09:58:36.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.161+0000 7f48d8ff9640 1 -- 172.21.15.40:0/2114098321 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f48c405cf80 con 0x7f48dc0c7e30 2024-04-14T09:58:36.161 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:58:36.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 msgr2=0x7f48bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 0x7f48bc06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f48dc0d1700 tx=0x7f48cc009190 comp rx=0 tx=0).stop 2024-04-14T09:58:36.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 msgr2=0x7f48dc15f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f48c400c4b0 tx=0x7f48c400c970 comp rx=0 tx=0).stop 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 shutdown_connections 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48bc06c8f0 0x7f48bc06edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48dc15e7b0 0x7f48dc0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48dc15e3d0 0x7f48dc161480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 --2- 172.21.15.40:0/2114098321 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48dc0c7e30 0x7f48dc15f660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 >> 172.21.15.40:0/2114098321 conn(0x7f48dc08dc90 msgr2=0x7f48dc06cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 shutdown_connections 2024-04-14T09:58:36.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.163+0000 7f48e2436640 1 -- 172.21.15.40:0/2114098321 wait complete. 2024-04-14T09:58:36.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:58:36.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 Processor -- start 2024-04-14T09:58:36.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 -- start start 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f415e9a0 con 0x7f85f40b00c0 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f406fa80 con 0x7f85f415e5c0 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.279+0000 7f85f91a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f85f406fd60 con 0x7f85f406bc30 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85ebfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f85f40b00c0 0x7f85f406b520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:57670/0 (socket says 172.21.15.40:57670) 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85ebfff640 1 -- 172.21.15.40:0/3491737611 learned_addr learned my addr 172.21.15.40:0/3491737611 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f359e640 1 --2- 172.21.15.40:0/3491737611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485502889 0 0) 0x7f85f415e9a0 con 0x7f85f40b00c0 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85e0003520 con 0x7f85f40b00c0 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2496592953 0 0) 0x7f85f406fa80 con 0x7f85f415e5c0 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85f415e9a0 con 0x7f85f415e5c0 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f359e640 1 -- 172.21.15.40:0/3491737611 >> v1:172.21.15.136:6789/0 conn(0x7f85f415e5c0 legacy=0x7f85f4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f359e640 1 -- 172.21.15.40:0/3491737611 >> v1:172.21.15.40:6789/0 conn(0x7f85f40b00c0 legacy=0x7f85f406b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.280+0000 7f85f359e640 1 -- 172.21.15.40:0/3491737611 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f4070040 con 0x7f85f406bc30 2024-04-14T09:58:36.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f359e640 1 --2- 172.21.15.40:0/3491737611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f40b4dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009dc0 tx=0x7f85ec02be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de50f8263266e329 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec039070 con 0x7f85f406bc30 2024-04-14T09:58:36.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85ec02cc40 con 0x7f85f406bc30 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f259c640 1 -- 172.21.15.40:0/3491737611 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85ec034440 con 0x7f85f406bc30 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f91a3640 1 -- 172.21.15.40:0/3491737611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 msgr2=0x7f85f40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f91a3640 1 --2- 172.21.15.40:0/3491737611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f40b4dd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85ec009dc0 tx=0x7f85ec02be90 comp rx=0 tx=0).stop 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f91a3640 1 -- 172.21.15.40:0/3491737611 shutdown_connections 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f91a3640 1 --2- 172.21.15.40:0/3491737611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f40b4dd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.281+0000 7f85f91a3640 1 -- 172.21.15.40:0/3491737611 >> 172.21.15.40:0/3491737611 conn(0x7f85f40b2db0 msgr2=0x7f85f40b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:36.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.282+0000 7f85f91a3640 1 -- 172.21.15.40:0/3491737611 shutdown_connections 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.282+0000 7f85f91a3640 1 -- 172.21.15.40:0/3491737611 wait complete. 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.283+0000 7f85f91a3640 1 Processor -- start 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.283+0000 7f85f91a3640 1 -- start start 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.283+0000 7f85f91a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.283+0000 7f85f91a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f415e5c0 0x7f85f40b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40ad8b0 con 0x7f85f40b00c0 2024-04-14T09:58:36.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f85f40b09d0 con 0x7f85f415e5c0 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f85f40ada30 con 0x7f85f406bc30 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:42498/0 (socket says 172.21.15.40:42498) 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 -- 172.21.15.40:0/672923950 learned_addr learned my addr 172.21.15.40:0/672923950 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f359e640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f415e5c0 0x7f85f40b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f2d9d640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 -- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 msgr2=0x7f85f4157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f4157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 -- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f415e5c0 msgr2=0x7f85f40b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f415e5c0 0x7f85f40b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 -- 172.21.15.40:0/672923950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f4158450 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f2d9d640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f4157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85ebfff640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c500 tx=0x7f85dc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc017070 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85dc005ce0 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f40cee00 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85dc0072f0 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.284+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f40ce840 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.285+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f4075760 con 0x7f85f40b00c0 2024-04-14T09:58:36.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.286+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85dc01a070 con 0x7f85f40b00c0 2024-04-14T09:58:36.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.286+0000 7f85eb7fe640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.286+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f85dc08b190 con 0x7f85f40b00c0 2024-04-14T09:58:36.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.286+0000 7f85f2d9d640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.287+0000 7f85f2d9d640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 0x7f85d406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85f41f7130 tx=0x7f85e4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.291+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f85dc058c40 con 0x7f85f40b00c0 2024-04-14T09:58:36.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.473+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f85f41f3c40 con 0x7f85f40b00c0 2024-04-14T09:58:36.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.474+0000 7f85eb7fe640 1 -- 172.21.15.40:0/672923950 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f85dc05cf40 con 0x7f85f40b00c0 2024-04-14T09:58:36.474 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:36.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 msgr2=0x7f85d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 0x7f85d406edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85f41f7130 tx=0x7f85e4009040 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 msgr2=0x7f85f40d0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f85dc00c500 tx=0x7f85dc00c9c0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 shutdown_connections 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f85d406c8f0 0x7f85d406edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f415e5c0 0x7f85f40b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f85f40b00c0 0x7f85f40d0000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 --2- 172.21.15.40:0/672923950 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f406bc30 0x7f85f4157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 >> 172.21.15.40:0/672923950 conn(0x7f85f40b2db0 msgr2=0x7f85f415b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 shutdown_connections 2024-04-14T09:58:36.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.475+0000 7f85f91a3640 1 -- 172.21.15.40:0/672923950 wait complete. 2024-04-14T09:58:36.486 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:58:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.589+0000 7f7000aad640 1 Processor -- start 2024-04-14T09:58:36.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.589+0000 7f7000aad640 1 -- start start 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc071020 0x7f6ffc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ffc09af80 0x7f6ffc0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc09b3c0 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6ffc06cc40 con 0x7f6ffc09af80 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f7000aad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6ffc06c960 con 0x7f6ffc071020 2024-04-14T09:58:36.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50432/0 (socket says 172.21.15.40:50432) 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 -- 172.21.15.40:0/3883482042 learned_addr learned my addr 172.21.15.40:0/3883482042 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ff9d9b640 1 --2- 172.21.15.40:0/3883482042 >> v2:172.21.15.136:3300/0 conn(0x7f6ffc09af80 0x7f6ffc0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffa59c640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc071020 0x7f6ffc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 -- 172.21.15.40:0/3883482042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc071020 msgr2=0x7f6ffc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc071020 0x7f6ffc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 -- 172.21.15.40:0/3883482042 >> v2:172.21.15.136:3300/0 conn(0x7f6ffc09af80 msgr2=0x7f6ffc0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 --2- 172.21.15.40:0/3883482042 >> v2:172.21.15.136:3300/0 conn(0x7f6ffc09af80 0x7f6ffc0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.590+0000 7f6ffad9d640 1 -- 172.21.15.40:0/3883482042 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc0cc6d0 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.591+0000 7f6ffad9d640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc074c20 tx=0x7f6ff402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2462acf7067e48 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.591+0000 7f6ff959a640 1 -- 172.21.15.40:0/3883482042 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4034070 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.591+0000 7f6ff959a640 1 -- 172.21.15.40:0/3883482042 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ff4030860 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.591+0000 7f6ff959a640 1 -- 172.21.15.40:0/3883482042 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ff4030c30 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 -- 172.21.15.40:0/3883482042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc0cd9d0 msgr2=0x7f6ffc0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc074c20 tx=0x7f6ff402b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 -- 172.21.15.40:0/3883482042 shutdown_connections 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0cde60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 --2- 172.21.15.40:0/3883482042 >> v2:172.21.15.136:3300/0 conn(0x7f6ffc09af80 0x7f6ffc0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 --2- 172.21.15.40:0/3883482042 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc071020 0x7f6ffc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 -- 172.21.15.40:0/3883482042 >> 172.21.15.40:0/3883482042 conn(0x7f6ffc0b3ad0 msgr2=0x7f6ffc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 -- 172.21.15.40:0/3883482042 shutdown_connections 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.592+0000 7f7000aad640 1 -- 172.21.15.40:0/3883482042 wait complete. 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.593+0000 7f7000aad640 1 Processor -- start 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.593+0000 7f7000aad640 1 -- start start 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ffc09af80 0x7f6ffc0c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc0ccf70 con 0x7f6ffc071020 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6ffc0ccc90 con 0x7f6ffc09af80 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f7000aad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6ffc06db50 con 0x7f6ffc0cd9d0 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50446/0 (socket says 172.21.15.40:50446) 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 -- 172.21.15.40:0/3257242422 learned_addr learned my addr 172.21.15.40:0/3257242422 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ff9d9b640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ffc09af80 0x7f6ffc0c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffad9d640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 -- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc0cd9d0 msgr2=0x7f6ffc0c9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0c9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 -- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ffc09af80 msgr2=0x7f6ffc0c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ffc09af80 0x7f6ffc0c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.594+0000 7f6ffa59c640 1 -- 172.21.15.40:0/3257242422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ffc0ca310 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f6ffa59c640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00eed0 tx=0x7f6fec00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec018020 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec00bd90 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ffc0ca5e0 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec014620 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.595+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ffc0c5f20 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.596+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ffc075760 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.596+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fec005d10 con 0x7f6ffc071020 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.597+0000 7f6ff2ffd640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 0x7f6fdc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:36.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.597+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6fec08c4f0 con 0x7f6ffc071020 2024-04-14T09:58:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.597+0000 7f6ff9d9b640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 0x7f6fdc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.597+0000 7f6ff9d9b640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 0x7f6fdc06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0b1290 tx=0x7f6fe4009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:36.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.601+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6fec022070 con 0x7f6ffc071020 2024-04-14T09:58:36.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.796+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ffc15e010 con 0x7f6ffc071020 2024-04-14T09:58:36.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.797+0000 7f6ff2ffd640 1 -- 172.21.15.40:0/3257242422 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f6fec05a020 con 0x7f6ffc071020 2024-04-14T09:58:36.797 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 msgr2=0x7f6fdc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 0x7f6fdc06ede0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0b1290 tx=0x7f6fe4009190 comp rx=0 tx=0).stop 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 msgr2=0x7f6ffc0cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00eed0 tx=0x7f6fec00b480 comp rx=0 tx=0).stop 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 shutdown_connections 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6fdc06c920 0x7f6fdc06ede0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ffc0cd9d0 0x7f6ffc0c9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ffc09af80 0x7f6ffc0c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 --2- 172.21.15.40:0/3257242422 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ffc071020 0x7f6ffc0cbdc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:36.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 >> 172.21.15.40:0/3257242422 conn(0x7f6ffc0b3ad0 msgr2=0x7f6ffc0cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:36.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 shutdown_connections 2024-04-14T09:58:36.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:36.799+0000 7f7000aad640 1 -- 172.21.15.40:0/3257242422 wait complete. 2024-04-14T09:58:36.809 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi040.front.sepia.ceph.com... 2024-04-14T09:58:36.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:36.810 DEBUG:teuthology.orchestra.run.smithi040:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-14T09:58:36.835 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi040.stderr:ceph-fuse[44535]: fuse finished with error 0 and tester_r 0 2024-04-14T09:58:36.837 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T09:58:42.938 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:58:42.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:42.939 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-14T09:58:42.966 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.120+0000 7fd751c91640 1 Processor -- start 2024-04-14T09:58:43.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.120+0000 7fd751c91640 1 -- start start 2024-04-14T09:58:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 0x7fd74c0d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0d12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd74c0d31c0 con 0x7fd74c15e510 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd74c0ceda0 con 0x7fd74c0d2800 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd751c91640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c0cf040 con 0x7fd74c0d0e90 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0d12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd74b7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50454/0 (socket says 172.21.15.40:50454) 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd74b7fe640 1 -- 172.21.15.40:0/200584224 learned_addr learned my addr 172.21.15.40:0/200584224 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.121+0000 7fd74affd640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 0x7fd74c0d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 -- 172.21.15.40:0/200584224 >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 msgr2=0x7fd74c0d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 0x7fd74c0d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 -- 172.21.15.40:0/200584224 >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 msgr2=0x7fd74c0cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 -- 172.21.15.40:0/200584224 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c0cf320 con 0x7fd74c0d0e90 2024-04-14T09:58:43.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74b7fe640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:43.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74affd640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 0x7fd74c0d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.122+0000 7fd74bfff640 1 --2- 172.21.15.40:0/200584224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0d12e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0a21b0 tx=0x7fd74402bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9fc4e923f2627c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd74a7fc640 1 -- 172.21.15.40:0/200584224 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744039070 con 0x7fd74c0d0e90 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd74a7fc640 1 -- 172.21.15.40:0/200584224 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74402cb40 con 0x7fd74c0d0e90 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd74a7fc640 1 -- 172.21.15.40:0/200584224 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744034440 con 0x7fd74c0d0e90 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 -- 172.21.15.40:0/200584224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 msgr2=0x7fd74c0d12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 --2- 172.21.15.40:0/200584224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0d12e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd74c0a21b0 tx=0x7fd74402bd90 comp rx=0 tx=0).stop 2024-04-14T09:58:43.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 -- 172.21.15.40:0/200584224 shutdown_connections 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 --2- 172.21.15.40:0/200584224 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0d12e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.136:3300/0 conn(0x7fd74c0d2800 0x7fd74c0d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 --2- 172.21.15.40:0/200584224 >> v2:172.21.15.40:3300/0 conn(0x7fd74c15e510 0x7fd74c0cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 -- 172.21.15.40:0/200584224 >> 172.21.15.40:0/200584224 conn(0x7fd74c09d570 msgr2=0x7fd74c0d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 -- 172.21.15.40:0/200584224 shutdown_connections 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.123+0000 7fd751c91640 1 -- 172.21.15.40:0/200584224 wait complete. 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.124+0000 7fd751c91640 1 Processor -- start 2024-04-14T09:58:43.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 -- start start 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd74c0d2800 0x7fd74c0c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c0d1820 con 0x7fd74c15e510 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd74c15e8f0 con 0x7fd74c0d2800 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd751c91640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd74c0d19a0 con 0x7fd74c0d0e90 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd74bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50460/0 (socket says 172.21.15.40:50460) 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd74bfff640 1 -- 172.21.15.40:0/2963294502 learned_addr learned my addr 172.21.15.40:0/2963294502 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd74b7fe640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.125+0000 7fd74affd640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd74c0d2800 0x7fd74c0c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 -- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 msgr2=0x7fd74c0b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 -- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd74c0d2800 msgr2=0x7fd74c0c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd74c0d2800 0x7fd74c0c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 -- 172.21.15.40:0/2963294502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd74c0ccc30 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd74bfff640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd744009e80 tx=0x7fd744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744039050 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd744045070 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744009450 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd74c0ccf10 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.126+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd74c0cd4d0 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.127+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd74c0756f0 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.128+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd74403e850 con 0x7fd74c15e510 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.128+0000 7fd733fff640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 0x7fd73806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.128+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd7440aea70 con 0x7fd74c15e510 2024-04-14T09:58:43.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.128+0000 7fd74b7fe640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 0x7fd73806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.129+0000 7fd74b7fe640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 0x7fd73806ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006ca0 tx=0x7fd73c009240 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.133+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd74407c580 con 0x7fd74c15e510 2024-04-14T09:58:43.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.317+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd74c15f510 con 0x7fd74c15e510 2024-04-14T09:58:43.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.318+0000 7fd733fff640 1 -- 172.21.15.40:0/2963294502 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fd7440aee20 con 0x7fd74c15e510 2024-04-14T09:58:43.318 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:43.318 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 msgr2=0x7fd73806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 0x7fd73806ede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd73c006ca0 tx=0x7fd73c009240 comp rx=0 tx=0).stop 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 msgr2=0x7fd74c0b7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd744009e80 tx=0x7fd744004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 shutdown_connections 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd73806c920 0x7fd73806ede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd74c15e510 0x7fd74c0b7d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd74c0d2800 0x7fd74c0c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 --2- 172.21.15.40:0/2963294502 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd74c0d0e90 0x7fd74c0b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 >> 172.21.15.40:0/2963294502 conn(0x7fd74c09d570 msgr2=0x7fd74c15ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 shutdown_connections 2024-04-14T09:58:43.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.320+0000 7fd751c91640 1 -- 172.21.15.40:0/2963294502 wait complete. 2024-04-14T09:58:43.331 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.434+0000 7fc5f8fdc640 1 Processor -- start 2024-04-14T09:58:43.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.434+0000 7fc5f8fdc640 1 -- start start 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f8fdc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f415e570 0x7fc5f40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f8fdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f40c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f8fdc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5f40d05b0 con 0x7fc5f4162f70 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f8fdc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc5f40d11c0 con 0x7fc5f415e570 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f8fdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40d0890 con 0x7fc5f40d0130 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f1d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc5f4162f70 0x7fc5f4162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55698/0 (socket says 172.21.15.40:55698) 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc5f415e570 0x7fc5f40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f1d9b640 1 -- 172.21.15.40:0/1860779561 learned_addr learned my addr 172.21.15.40:0/1860779561 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f2d9d640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f40c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f259c640 1 -- 172.21.15.40:0/1860779561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 msgr2=0x7fc5f40c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f259c640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f40c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f259c640 1 -- 172.21.15.40:0/1860779561 >> v1:172.21.15.40:6789/0 conn(0x7fc5f4162f70 legacy=0x7fc5f4162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f259c640 1 -- 172.21.15.40:0/1860779561 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40d0b70 con 0x7fc5f415e570 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f159a640 1 -- 172.21.15.40:0/1860779561 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989063739 0 0) 0x7fc5f40d05b0 con 0x7fc5f4162f70 2024-04-14T09:58:43.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.435+0000 7fc5f2d9d640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f40c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.436+0000 7fc5f259c640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40cfbf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40097a0 tx=0x7fc5e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd4873d0ca40f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.436+0000 7fc5f159a640 1 -- 172.21.15.40:0/1860779561 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4035020 con 0x7fc5f415e570 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.436+0000 7fc5f159a640 1 -- 172.21.15.40:0/1860779561 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e4031830 con 0x7fc5f415e570 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.436+0000 7fc5f159a640 1 -- 172.21.15.40:0/1860779561 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e4031c00 con 0x7fc5f415e570 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1860779561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 msgr2=0x7fc5f40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40cfbf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40097a0 tx=0x7fc5e402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1860779561 shutdown_connections 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f40c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1860779561 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40cfbf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1860779561 >> 172.21.15.40:0/1860779561 conn(0x7fc5f409d5a0 msgr2=0x7fc5f40d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1860779561 shutdown_connections 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.437+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1860779561 wait complete. 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.438+0000 7fc5f8fdc640 1 Processor -- start 2024-04-14T09:58:43.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.438+0000 7fc5f8fdc640 1 -- start start 2024-04-14T09:58:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f41f4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5f4162f70 0x7fc5f40b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4162bd0 con 0x7fc5f415e570 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc5f4162a50 con 0x7fc5f4162f70 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f8fdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc5f40d1650 con 0x7fc5f40d0130 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50470/0 (socket says 172.21.15.40:50470) 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 -- 172.21.15.40:0/1178318505 learned_addr learned my addr 172.21.15.40:0/1178318505 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f259c640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f41f4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f2d9d640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5f4162f70 0x7fc5f40b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 -- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 msgr2=0x7fc5f41f4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f41f4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 -- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5f4162f70 msgr2=0x7fc5f40b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5f4162f70 0x7fc5f40b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 -- 172.21.15.40:0/1178318505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5f40b7920 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.439+0000 7fc5f1d9b640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c410 tx=0x7fc5e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.440+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8017070 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.440+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5e8005ce0 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.440+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5f40b7c00 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.440+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8007310 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.440+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5f40b81c0 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.441+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5f40756f0 con 0x7fc5f415e570 2024-04-14T09:58:43.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.441+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc5e801a070 con 0x7fc5f415e570 2024-04-14T09:58:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.441+0000 7fc5e2ffd640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 0x7fc5d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.442+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc5e808b0a0 con 0x7fc5f415e570 2024-04-14T09:58:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.442+0000 7fc5f259c640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 0x7fc5d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.442+0000 7fc5f259c640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 0x7fc5d406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4036000 tx=0x7fc5e4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.446+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc5e8058b40 con 0x7fc5f415e570 2024-04-14T09:58:43.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.631+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc5f40d2a50 con 0x7fc5f415e570 2024-04-14T09:58:43.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.632+0000 7fc5e2ffd640 1 -- 172.21.15.40:0/1178318505 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fc5e805ce40 con 0x7fc5f415e570 2024-04-14T09:58:43.632 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:43.632 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 msgr2=0x7fc5d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 0x7fc5d406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4036000 tx=0x7fc5e4008030 comp rx=0 tx=0).stop 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 msgr2=0x7fc5f40b6d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c410 tx=0x7fc5e800c810 comp rx=0 tx=0).stop 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 shutdown_connections 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc5d406c8f0 0x7fc5d406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc5f4162f70 0x7fc5f40b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc5f415e570 0x7fc5f40b6d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 --2- 172.21.15.40:0/1178318505 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc5f40d0130 0x7fc5f41f4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 >> 172.21.15.40:0/1178318505 conn(0x7fc5f409d5a0 msgr2=0x7fc5f406d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 shutdown_connections 2024-04-14T09:58:43.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.634+0000 7fc5f8fdc640 1 -- 172.21.15.40:0/1178318505 wait complete. 2024-04-14T09:58:43.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T09:58:43.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.750+0000 7f6cfcade640 1 Processor -- start 2024-04-14T09:58:43.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.750+0000 7f6cfcade640 1 -- start start 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cfcade640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cfcade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf806fd40 0x7f6cf815fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cfcade640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf80701d0 con 0x7f6cf80ccca0 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cfcade640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6cf80cdf50 con 0x7f6cf815c3c0 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cfcade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf80cfd20 con 0x7f6cf806fd40 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cf659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cf659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50480/0 (socket says 172.21.15.40:50480) 2024-04-14T09:58:43.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cf659c640 1 -- 172.21.15.40:0/406283378 learned_addr learned my addr 172.21.15.40:0/406283378 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.751+0000 7f6cf6d9d640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf806fd40 0x7f6cf815fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.752+0000 7f6cf659c640 1 -- 172.21.15.40:0/406283378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf806fd40 msgr2=0x7f6cf815fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.752+0000 7f6cf659c640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf806fd40 0x7f6cf815fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.752+0000 7f6cf659c640 1 -- 172.21.15.40:0/406283378 >> v1:172.21.15.136:6789/0 conn(0x7f6cf80ccca0 legacy=0x7f6cf806f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.752+0000 7f6cf659c640 1 -- 172.21.15.40:0/406283378 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf80d0000 con 0x7f6cf815c3c0 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.752+0000 7f6cf659c640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009870 tx=0x7f6ce802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deefc8cf2515afa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cf5d9b640 1 -- 172.21.15.40:0/406283378 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce802f840 con 0x7f6cf815c3c0 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cf5d9b640 1 -- 172.21.15.40:0/406283378 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce802f9e0 con 0x7f6cf815c3c0 2024-04-14T09:58:43.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cf5d9b640 1 -- 172.21.15.40:0/406283378 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce802fdb0 con 0x7f6cf815c3c0 2024-04-14T09:58:43.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 -- 172.21.15.40:0/406283378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf815c3c0 msgr2=0x7f6cf80d0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8009870 tx=0x7f6ce802ba20 comp rx=0 tx=0).stop 2024-04-14T09:58:43.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 -- 172.21.15.40:0/406283378 shutdown_connections 2024-04-14T09:58:43.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf806fd40 0x7f6cf815fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 --2- 172.21.15.40:0/406283378 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf815c3c0 0x7f6cf80d0ae0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 -- 172.21.15.40:0/406283378 >> 172.21.15.40:0/406283378 conn(0x7f6cf80d20b0 msgr2=0x7f6cf80d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 -- 172.21.15.40:0/406283378 shutdown_connections 2024-04-14T09:58:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.753+0000 7f6cfcade640 1 -- 172.21.15.40:0/406283378 wait complete. 2024-04-14T09:58:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 Processor -- start 2024-04-14T09:58:43.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 -- start start 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cf80ccca0 0x7f6cf80c7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf815c3c0 0x7f6cf8150530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80d1020 con 0x7f6cf806fd40 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf80d05c0 con 0x7f6cf80ccca0 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cfcade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6cf815c7a0 con 0x7f6cf815c3c0 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cf659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cf659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50490/0 (socket says 172.21.15.40:50490) 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.755+0000 7f6cf659c640 1 -- 172.21.15.40:0/338662389 learned_addr learned my addr 172.21.15.40:0/338662389 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:43.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf6d9d640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf815c3c0 0x7f6cf8150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cedd9b640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cf80ccca0 0x7f6cf80c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 -- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf815c3c0 msgr2=0x7f6cf8150530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf815c3c0 0x7f6cf8150530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 -- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cf80ccca0 msgr2=0x7f6cf80c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cf80ccca0 0x7f6cf80c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 -- 172.21.15.40:0/338662389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8150a70 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cf659c640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c00 tx=0x7f6ce8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8037bc0 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ce8046070 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf80c8320 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8041400 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.756+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf80c7a80 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.757+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf80756f0 con 0x7f6cf806fd40 2024-04-14T09:58:43.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.758+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6ce8040070 con 0x7f6cf806fd40 2024-04-14T09:58:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.758+0000 7f6cef7fe640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 0x7f6cd806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.758+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ce80ae290 con 0x7f6cf806fd40 2024-04-14T09:58:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.758+0000 7f6cedd9b640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 0x7f6cd806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:43.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.759+0000 7f6cedd9b640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 0x7f6cd806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80d2a20 tx=0x7f6ce0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:43.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.762+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6cf8150a70 con 0x7f6cf806fd40 2024-04-14T09:58:43.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:43.987+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6cf80d0930 con 0x7f6cf806fd40 2024-04-14T09:58:44.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.453+0000 7f6cef7fe640 1 -- 172.21.15.40:0/338662389 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f6ce8033030 con 0x7f6cf806fd40 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 msgr2=0x7f6cd806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 0x7f6cd806edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80d2a20 tx=0x7f6ce0009040 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 msgr2=0x7f6cf81e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f6ce8000c00 tx=0x7f6ce8004730 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 shutdown_connections 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6cd806c8f0 0x7f6cd806edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6cf815c3c0 0x7f6cf8150530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6cf80ccca0 0x7f6cf80c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 --2- 172.21.15.40:0/338662389 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6cf806fd40 0x7f6cf81e7140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 >> 172.21.15.40:0/338662389 conn(0x7f6cf80d20b0 msgr2=0x7f6cf815b690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 shutdown_connections 2024-04-14T09:58:44.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.456+0000 7f6cfcade640 1 -- 172.21.15.40:0/338662389 wait complete. 2024-04-14T09:58:44.468 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-14T09:58:44.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T09:58:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.577+0000 7f0380036640 1 Processor -- start 2024-04-14T09:58:44.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 -- start start 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f03780d1350 0x7f03780d2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03780d4c90 0x7f03780b4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f037815e9f0 con 0x7f037815e610 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f03780d3210 con 0x7f03780d4c90 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.578+0000 7f0380036640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f03780d2f30 con 0x7f03780d1350 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03780d4c90 0x7f03780b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f03780d4c90 0x7f03780b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50498/0 (socket says 172.21.15.40:50498) 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 -- 172.21.15.40:0/2999315670 learned_addr learned my addr 172.21.15.40:0/2999315670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037d5d1640 1 --2- 172.21.15.40:0/2999315670 >> v2:172.21.15.136:3300/0 conn(0x7f03780d1350 0x7f03780d2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037cdd0640 1 -- 172.21.15.40:0/2999315670 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4171440156 0 0) 0x7f037815e9f0 con 0x7f037815e610 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 -- 172.21.15.40:0/2999315670 >> v2:172.21.15.136:3300/0 conn(0x7f03780d1350 msgr2=0x7f03780d2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 --2- 172.21.15.40:0/2999315670 >> v2:172.21.15.136:3300/0 conn(0x7f03780d1350 0x7f03780d2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 -- 172.21.15.40:0/2999315670 >> v1:172.21.15.136:6789/0 conn(0x7f037815e610 legacy=0x7f03780d0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.579+0000 7f037e5d3640 1 -- 172.21.15.40:0/2999315670 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03780b3d50 con 0x7f03780d4c90 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f037e5d3640 1 --2- 172.21.15.40:0/2999315670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03780d4c90 0x7f03780b4830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f037808cb20 tx=0x7f036802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c30f630f457903 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f037cdd0640 1 -- 172.21.15.40:0/2999315670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036802cb20 con 0x7f03780d4c90 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f037cdd0640 1 -- 172.21.15.40:0/2999315670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036802ccc0 con 0x7f03780d4c90 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f037cdd0640 1 -- 172.21.15.40:0/2999315670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368034610 con 0x7f03780d4c90 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 -- 172.21.15.40:0/2999315670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03780d4c90 msgr2=0x7f03780b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 --2- 172.21.15.40:0/2999315670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03780d4c90 0x7f03780b4830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f037808cb20 tx=0x7f036802bf80 comp rx=0 tx=0).stop 2024-04-14T09:58:44.581 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 -- 172.21.15.40:0/2999315670 shutdown_connections 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 --2- 172.21.15.40:0/2999315670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f03780d4c90 0x7f03780b4830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 --2- 172.21.15.40:0/2999315670 >> v2:172.21.15.136:3300/0 conn(0x7f03780d1350 0x7f03780d2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 -- 172.21.15.40:0/2999315670 >> 172.21.15.40:0/2999315670 conn(0x7f037809d550 msgr2=0x7f03780d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 -- 172.21.15.40:0/2999315670 shutdown_connections 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.580+0000 7f0380036640 1 -- 172.21.15.40:0/2999315670 wait complete. 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 Processor -- start 2024-04-14T09:58:44.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 -- start start 2024-04-14T09:58:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03780d1350 0x7f03780cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03780d4c90 0x7f03780cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f03780d50e0 con 0x7f037815e610 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f03780b4310 con 0x7f03780d4c90 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f0380036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f03780b4d70 con 0x7f03780d1350 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f037e5d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f037e5d3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50504/0 (socket says 172.21.15.40:50504) 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f037e5d3640 1 -- 172.21.15.40:0/3996213940 learned_addr learned my addr 172.21.15.40:0/3996213940 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f037d5d1640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03780d4c90 0x7f03780cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.582+0000 7f037ddd2640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03780d1350 0x7f03780cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 -- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03780d1350 msgr2=0x7f03780cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03780d1350 0x7f03780cda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 -- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03780d4c90 msgr2=0x7f03780cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03780d4c90 0x7f03780cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:44.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 -- 172.21.15.40:0/3996213940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03780cbd20 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f037e5d3640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0368036040 tx=0x7f0368004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368043030 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036803e450 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03780cc060 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0368009510 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.583+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03780cc8a0 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.584+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03780756f0 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.584+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0368046070 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.585+0000 7f03767fc640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 0x7f036406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.585+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f03680ae0b0 con 0x7f037815e610 2024-04-14T09:58:44.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.585+0000 7f037ddd2640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 0x7f036406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:44.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.586+0000 7f037ddd2640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 0x7f036406edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0370000f60 tx=0x7f0370009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:44.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.589+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f036804d070 con 0x7f037815e610 2024-04-14T09:58:44.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:44.814+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f03780cca70 con 0x7f037815e610 2024-04-14T09:58:45.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.462+0000 7f03767fc640 1 -- 172.21.15.40:0/3996213940 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f03780cc060 con 0x7f037815e610 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 msgr2=0x7f036406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 0x7f036406edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0370000f60 tx=0x7f0370009040 comp rx=0 tx=0).stop 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 msgr2=0x7f03780b86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0368036040 tx=0x7f0368004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 shutdown_connections 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f036406c8f0 0x7f036406edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f037815e610 0x7f03780b86b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f03780d4c90 0x7f03780cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 --2- 172.21.15.40:0/3996213940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f03780d1350 0x7f03780cda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 >> 172.21.15.40:0/3996213940 conn(0x7f037809d550 msgr2=0x7f03780ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:45.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 shutdown_connections 2024-04-14T09:58:45.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.465+0000 7f0380036640 1 -- 172.21.15.40:0/3996213940 wait complete. 2024-04-14T09:58:45.478 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T09:58:45.478 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:45.585 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.586+0000 7f0c2ff5e640 1 Processor -- start 2024-04-14T09:58:45.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.586+0000 7f0c2ff5e640 1 -- start start 2024-04-14T09:58:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ff5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 0x7f0c2809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ff5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0c280b45b0 0x7f0c280cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ff5e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2809b360 con 0x7f0c280cd610 2024-04-14T09:58:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ff5e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2806f840 con 0x7f0c280b45b0 2024-04-14T09:58:45.587 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ff5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2806fb20 con 0x7f0c2809aa40 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2e4fb640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0c280cd610 0x7f0c280cdac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55702/0 (socket says 172.21.15.40:55702) 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2e4fb640 1 -- 172.21.15.40:0/3243457782 learned_addr learned my addr 172.21.15.40:0/3243457782 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/3243457782 >> v2:172.21.15.136:3300/0 conn(0x7f0c280b45b0 0x7f0c280cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2dcfa640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 0x7f0c2809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ccf8640 1 -- 172.21.15.40:0/3243457782 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1343277971 0 0) 0x7f0c2809b360 con 0x7f0c280cd610 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2ccf8640 1 -- 172.21.15.40:0/3243457782 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c14003520 con 0x7f0c280cd610 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2d4f9640 1 -- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 msgr2=0x7f0c2809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 0x7f0c2809ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2d4f9640 1 -- 172.21.15.40:0/3243457782 >> v1:172.21.15.40:6789/0 conn(0x7f0c280cd610 legacy=0x7f0c280cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2d4f9640 1 -- 172.21.15.40:0/3243457782 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c280cc5f0 con 0x7f0c280b45b0 2024-04-14T09:58:45.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.587+0000 7f0c2dcfa640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 0x7f0c2809ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.588+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280b45b0 0x7f0c280cd0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097a0 tx=0x7f0c1802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee8fbddd83b9015e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.588+0000 7f0c2ccf8640 1 -- 172.21.15.40:0/3243457782 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18035020 con 0x7f0c280b45b0 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.588+0000 7f0c2ccf8640 1 -- 172.21.15.40:0/3243457782 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c18031830 con 0x7f0c280b45b0 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.588+0000 7f0c2ccf8640 1 -- 172.21.15.40:0/3243457782 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c18031be0 con 0x7f0c280b45b0 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280b45b0 msgr2=0x7f0c280cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280b45b0 0x7f0c280cd0d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0c180097a0 tx=0x7f0c1802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/3243457782 shutdown_connections 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280b45b0 0x7f0c280cd0d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/3243457782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c2809aa40 0x7f0c2809ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/3243457782 >> 172.21.15.40:0/3243457782 conn(0x7f0c280b3a90 msgr2=0x7f0c280b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/3243457782 shutdown_connections 2024-04-14T09:58:45.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.589+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/3243457782 wait complete. 2024-04-14T09:58:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.590+0000 7f0c2ff5e640 1 Processor -- start 2024-04-14T09:58:45.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.590+0000 7f0c2ff5e640 1 -- start start 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c280b45b0 0x7f0c281613f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280cd610 0x7f0c2814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2809b860 con 0x7f0c2809aa40 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c280ccbb0 con 0x7f0c280cd610 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2ff5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2809b9e0 con 0x7f0c280b45b0 2024-04-14T09:58:45.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50508/0 (socket says 172.21.15.40:50508) 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 -- 172.21.15.40:0/2420819401 learned_addr learned my addr 172.21.15.40:0/2420819401 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2e4fb640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280cd610 0x7f0c2814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c280b45b0 0x7f0c281613f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 -- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c280b45b0 msgr2=0x7f0c281613f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c280b45b0 0x7f0c281613f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 -- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280cd610 msgr2=0x7f0c2814cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280cd610 0x7f0c2814cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.591+0000 7f0c2dcfa640 1 -- 172.21.15.40:0/2420819401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2815ef20 con 0x7f0c2809aa40 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c2dcfa640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400e990 tx=0x7f0c2400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24017070 con 0x7f0c2809aa40 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2400c9e0 con 0x7f0c2809aa40 2024-04-14T09:58:45.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c28160630 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2400cdb0 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.592+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c28160bf0 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.593+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c280756f0 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.593+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c2401a070 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.593+0000 7f0c1e7fc640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 0x7f0c0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.594+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c2408c0b0 con 0x7f0c2809aa40 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.594+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 0x7f0c0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.594+0000 7f0c2d4f9640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 0x7f0c0c06ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036000 tx=0x7f0c1803c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.598+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0c24059ac0 con 0x7f0c2809aa40 2024-04-14T09:58:45.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.823+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c28161e90 con 0x7f0c2809aa40 2024-04-14T09:58:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.823+0000 7f0c1e7fc640 1 -- 172.21.15.40:0/2420819401 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f0c2405ddc0 con 0x7f0c2809aa40 2024-04-14T09:58:45.823 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:45.823 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:45.823 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:58:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 msgr2=0x7f0c0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 0x7f0c0c06ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0c18036000 tx=0x7f0c1803c040 comp rx=0 tx=0).stop 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 msgr2=0x7f0c2815e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400e990 tx=0x7f0c2400ee50 comp rx=0 tx=0).stop 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 shutdown_connections 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c0c06c920 0x7f0c0c06ede0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c280cd610 0x7f0c2814cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c280b45b0 0x7f0c281613f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 --2- 172.21.15.40:0/2420819401 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c2809aa40 0x7f0c2815e890 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 >> 172.21.15.40:0/2420819401 conn(0x7f0c280b3a90 msgr2=0x7f0c2806e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 shutdown_connections 2024-04-14T09:58:45.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.825+0000 7f0c2ff5e640 1 -- 172.21.15.40:0/2420819401 wait complete. 2024-04-14T09:58:45.836 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:45.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 Processor -- start 2024-04-14T09:58:45.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 -- start start 2024-04-14T09:58:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f425415e650 0x7f42540b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 0x7f42540d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540b4c70 con 0x7f42540d2cb0 2024-04-14T09:58:45.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f42540d3120 con 0x7f425415e650 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.938+0000 7f425895e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f42540b5880 con 0x7f42540b4760 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f425259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f425415e650 0x7f42540b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f4252d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f42540d2cb0 0x7f42541622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55710/0 (socket says 172.21.15.40:55710) 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f4252d9d640 1 -- 172.21.15.40:0/591080823 learned_addr learned my addr 172.21.15.40:0/591080823 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f424bfff640 1 --2- 172.21.15.40:0/591080823 >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 0x7f42540d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f425259c640 1 -- 172.21.15.40:0/591080823 >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 msgr2=0x7f42540d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f425259c640 1 --2- 172.21.15.40:0/591080823 >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 0x7f42540d2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f425259c640 1 -- 172.21.15.40:0/591080823 >> v1:172.21.15.40:6789/0 conn(0x7f42540d2cb0 legacy=0x7f42541622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f425259c640 1 -- 172.21.15.40:0/591080823 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540b4f50 con 0x7f425415e650 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f4251d9b640 1 -- 172.21.15.40:0/591080823 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222233785 0 0) 0x7f42540b4c70 con 0x7f42540d2cb0 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.939+0000 7f424bfff640 1 --2- 172.21.15.40:0/591080823 >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 0x7f42540d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425259c640 1 --2- 172.21.15.40:0/591080823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425415e650 0x7f42540b4220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4254162240 tx=0x7f424402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a59d822af9265880 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f4251d9b640 1 -- 172.21.15.40:0/591080823 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244035020 con 0x7f425415e650 2024-04-14T09:58:45.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f4251d9b640 1 -- 172.21.15.40:0/591080823 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4244031830 con 0x7f425415e650 2024-04-14T09:58:45.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f4251d9b640 1 -- 172.21.15.40:0/591080823 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244031c00 con 0x7f425415e650 2024-04-14T09:58:45.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 -- 172.21.15.40:0/591080823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425415e650 msgr2=0x7f42540b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.943 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 --2- 172.21.15.40:0/591080823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425415e650 0x7f42540b4220 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4254162240 tx=0x7f424402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 -- 172.21.15.40:0/591080823 shutdown_connections 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 --2- 172.21.15.40:0/591080823 >> v2:172.21.15.136:3300/0 conn(0x7f42540b4760 0x7f42540d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 --2- 172.21.15.40:0/591080823 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f425415e650 0x7f42540b4220 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 -- 172.21.15.40:0/591080823 >> 172.21.15.40:0/591080823 conn(0x7f425409d580 msgr2=0x7f42540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 -- 172.21.15.40:0/591080823 shutdown_connections 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.940+0000 7f425895e640 1 -- 172.21.15.40:0/591080823 wait complete. 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 Processor -- start 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 -- start start 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 0x7f42540b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 0x7f425414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.944 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f42540d2270 con 0x7f42540b4760 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f42540b5510 con 0x7f42540d2cb0 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425895e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f425415ea30 con 0x7f425415e650 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.942+0000 7f425259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50526/0 (socket says 172.21.15.40:50526) 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 -- 172.21.15.40:0/4140764660 learned_addr learned my addr 172.21.15.40:0/4140764660 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f4252d9d640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 0x7f425414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f424bfff640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 0x7f42540b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 -- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 msgr2=0x7f425414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 0x7f425414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 -- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 msgr2=0x7f42540b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 0x7f42540b97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 -- 172.21.15.40:0/4140764660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540cc1f0 con 0x7f42540b4760 2024-04-14T09:58:45.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f424bfff640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 0x7f42540b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f4252d9d640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 0x7f425414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425259c640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4244009890 tx=0x7f42440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244035070 con 0x7f42540b4760 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4244004250 con 0x7f42540b4760 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424403a630 con 0x7f42540b4760 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42541f4930 con 0x7f42540b4760 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.943+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42541f5170 con 0x7f42540b4760 2024-04-14T09:58:45.947 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.944+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42540756f0 con 0x7f42540b4760 2024-04-14T09:58:45.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.945+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4244038020 con 0x7f42540b4760 2024-04-14T09:58:45.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.945+0000 7f424affd640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:45.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.945+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f42440adbb0 con 0x7f42540b4760 2024-04-14T09:58:45.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.945+0000 7f424bfff640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:45.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.945+0000 7f424bfff640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 0x7f423406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f425415b630 tx=0x7f423c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:45.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:45.949+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f42541f4930 con 0x7f42540b4760 2024-04-14T09:58:46.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.138+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42540d4c30 con 0x7f42540b4760 2024-04-14T09:58:46.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.139+0000 7f424affd640 1 -- 172.21.15.40:0/4140764660 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f4244040070 con 0x7f42540b4760 2024-04-14T09:58:46.139 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:46.139 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 msgr2=0x7f423406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 0x7f423406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f425415b630 tx=0x7f423c008040 comp rx=0 tx=0).stop 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 msgr2=0x7f42541f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4244009890 tx=0x7f42440046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 shutdown_connections 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f423406c8f0 0x7f423406edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f425415e650 0x7f425414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f42540d2cb0 0x7f42540b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 --2- 172.21.15.40:0/4140764660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f42540b4760 0x7f42541f42f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 >> 172.21.15.40:0/4140764660 conn(0x7f425409d580 msgr2=0x7f42540d0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 shutdown_connections 2024-04-14T09:58:46.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.141+0000 7f425895e640 1 -- 172.21.15.40:0/4140764660 wait complete. 2024-04-14T09:58:46.152 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T09:58:46.152 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:58:46.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.254+0000 7f9ecf020640 1 Processor -- start 2024-04-14T09:58:46.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.254+0000 7f9ecf020640 1 -- start start 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ecf020640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ec80d2f10 0x7f9ec80cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ecf020640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec80ceda0 con 0x7f9ec815e510 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ecf020640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec80cf040 con 0x7f9ec80d0e90 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ecf020640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec80d19c0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9eccdbc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9ec815e510 0x7f9ec80d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:55724/0 (socket says 172.21.15.40:55724) 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9eccdbc640 1 -- 172.21.15.40:0/510772169 learned_addr learned my addr 172.21.15.40:0/510772169 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec7fff640 1 --2- 172.21.15.40:0/510772169 >> v2:172.21.15.136:3300/0 conn(0x7f9ec80d2f10 0x7f9ec80cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940214377 0 0) 0x7f9ec80ceda0 con 0x7f9ec815e510 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9eb8003520 con 0x7f9ec815e510 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514189933 0 0) 0x7f9ec80cf040 con 0x7f9ec80d0e90 2024-04-14T09:58:46.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec80ceda0 con 0x7f9ec80d0e90 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec7fff640 1 -- 172.21.15.40:0/510772169 >> v1:172.21.15.136:6789/0 conn(0x7f9ec80d0e90 legacy=0x7f9ec80d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec7fff640 1 -- 172.21.15.40:0/510772169 >> v1:172.21.15.40:6789/0 conn(0x7f9ec815e510 legacy=0x7f9ec80d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.255+0000 7f9ec7fff640 1 -- 172.21.15.40:0/510772169 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec80cf320 con 0x7f9ec80d2f10 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.256+0000 7f9ec7fff640 1 --2- 172.21.15.40:0/510772169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80cfe00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097a0 tx=0x7f9eb402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e71da6b6fdd221 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.256+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4035020 con 0x7f9ec80d2f10 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.256+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb4031830 con 0x7f9ec80d2f10 2024-04-14T09:58:46.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.256+0000 7f9ec77fe640 1 -- 172.21.15.40:0/510772169 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4031be0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 -- 172.21.15.40:0/510772169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec80d2f10 msgr2=0x7f9ec80cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 --2- 172.21.15.40:0/510772169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80cfe00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40097a0 tx=0x7f9eb402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 -- 172.21.15.40:0/510772169 shutdown_connections 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 --2- 172.21.15.40:0/510772169 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80cfe00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 -- 172.21.15.40:0/510772169 >> 172.21.15.40:0/510772169 conn(0x7f9ec809d570 msgr2=0x7f9ec80d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 -- 172.21.15.40:0/510772169 shutdown_connections 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.257+0000 7f9ecf020640 1 -- 172.21.15.40:0/510772169 wait complete. 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.258+0000 7f9ecf020640 1 Processor -- start 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.258+0000 7f9ecf020640 1 -- start start 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ec80d0e90 0x7f9ec80c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.260 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec815e510 0x7f9ec80cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec80b3ad0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec815e8f0 con 0x7f9ec815e510 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec80b3c50 con 0x7f9ec80d0e90 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:50540/0 (socket says 172.21.15.40:50540) 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 -- 172.21.15.40:0/3799860090 learned_addr learned my addr 172.21.15.40:0/3799860090 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9eccdbc640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ec80d0e90 0x7f9ec80c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecd5bd640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec815e510 0x7f9ec80cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 -- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ec80d0e90 msgr2=0x7f9ec80c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ec80d0e90 0x7f9ec80c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 -- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec815e510 msgr2=0x7f9ec80cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec815e510 0x7f9ec80cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.261 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 -- 172.21.15.40:0/3799860090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec80c93a0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec7fff640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40098c0 tx=0x7f9eb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb4035040 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb403f070 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec80ccf00 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb403bb60 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.259+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec80cd7a0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.262 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.260+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec80cd0d0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.261+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9eb4038020 con 0x7f9ec80d2f10 2024-04-14T09:58:46.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.261+0000 7f9ec57fa640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.261+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9eb40ad8f0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.261+0000 7f9eccdbc640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.262+0000 7f9eccdbc640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 0x7f9eac06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc000f60 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.265 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.266+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9eb407b3a0 con 0x7f9ec80d2f10 2024-04-14T09:58:46.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.447+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9ec80cd300 con 0x7f9eac06c8f0 2024-04-14T09:58:46.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.455+0000 7f9ec57fa640 1 -- 172.21.15.40:0/3799860090 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9ebc0014f0 con 0x7f9eac06c8f0 2024-04-14T09:58:46.459 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:46.461 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 msgr2=0x7f9eac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 0x7f9eac06edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc000f60 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 msgr2=0x7f9ec80ca450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9eb40098c0 tx=0x7f9eb40046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 shutdown_connections 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ec815e510 0x7f9ec80cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ec80d2f10 0x7f9ec80ca450 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 --2- 172.21.15.40:0/3799860090 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ec80d0e90 0x7f9ec80c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 >> 172.21.15.40:0/3799860090 conn(0x7f9ec809d570 msgr2=0x7f9ec806ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 shutdown_connections 2024-04-14T09:58:46.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.459+0000 7f9ecf020640 1 -- 172.21.15.40:0/3799860090 wait complete. 2024-04-14T09:58:46.470 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-14T09:58:44.807907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002172"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718547+0000","last_change":"2024-04-14T09:58:22.400374+0000","last_active":"2024-04-14T09:58:28.718547+0000","last_peered":"2024-04-14T09:58:28.718547+0000","last_clean":"2024-04-14T09:58:28.718547+0000","last_became_active":"2024-04-14T09:58:22.400083+0000","last_became_peered":"2024-04-14T09:58:22.400083+0000","last_unstale":"2024-04-14T09:58:28.718547+0000","last_undegraded":"2024-04-14T09:58:28.718547+0000","last_fullsized":"2024-04-14T09:58:28.718547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411956+0000","last_change":"2024-04-14T09:58:23.405589+0000","last_active":"2024-04-14T09:58:28.411956+0000","last_peered":"2024-04-14T09:58:28.411956+0000","last_clean":"2024-04-14T09:58:28.411956+0000","last_became_active":"2024-04-14T09:58:23.405288+0000","last_became_peered":"2024-04-14T09:58:23.405288+0000","last_unstale":"2024-04-14T09:58:28.411956+0000","last_undegraded":"2024-04-14T09:58:28.411956+0000","last_fullsized":"2024-04-14T09:58:28.411956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411293+0000","last_change":"2024-04-14T09:58:27.669278+0000","last_active":"2024-04-14T09:58:28.411293+0000","last_peered":"2024-04-14T09:58:28.411293+0000","last_clean":"2024-04-14T09:58:28.411293+0000","last_became_active":"2024-04-14T09:58:27.668928+0000","last_became_peered":"2024-04-14T09:58:27.668928+0000","last_unstale":"2024-04-14T09:58:28.411293+0000","last_undegraded":"2024-04-14T09:58:28.411293+0000","last_fullsized":"2024-04-14T09:58:28.411293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:59.301538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412073+0000","last_change":"2024-04-14T09:58:22.396110+0000","last_active":"2024-04-14T09:58:28.412073+0000","last_peered":"2024-04-14T09:58:28.412073+0000","last_clean":"2024-04-14T09:58:28.412073+0000","last_became_active":"2024-04-14T09:58:22.395818+0000","last_became_peered":"2024-04-14T09:58:22.395818+0000","last_unstale":"2024-04-14T09:58:28.412073+0000","last_undegraded":"2024-04-14T09:58:28.412073+0000","last_fullsized":"2024-04-14T09:58:28.412073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:02:50.002691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718273+0000","last_change":"2024-04-14T09:58:23.405100+0000","last_active":"2024-04-14T09:58:28.718273+0000","last_peered":"2024-04-14T09:58:28.718273+0000","last_clean":"2024-04-14T09:58:28.718273+0000","last_became_active":"2024-04-14T09:58:23.404837+0000","last_became_peered":"2024-04-14T09:58:23.404837+0000","last_unstale":"2024-04-14T09:58:28.718273+0000","last_undegraded":"2024-04-14T09:58:28.718273+0000","last_fullsized":"2024-04-14T09:58:28.718273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:53.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411717+0000","last_change":"2024-04-14T09:58:27.431626+0000","last_active":"2024-04-14T09:58:28.411717+0000","last_peered":"2024-04-14T09:58:28.411717+0000","last_clean":"2024-04-14T09:58:28.411717+0000","last_became_active":"2024-04-14T09:58:27.431160+0000","last_became_peered":"2024-04-14T09:58:27.431160+0000","last_unstale":"2024-04-14T09:58:28.411717+0000","last_undegraded":"2024-04-14T09:58:28.411717+0000","last_fullsized":"2024-04-14T09:58:28.411717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:01.933626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719419+0000","last_change":"2024-04-14T09:58:22.396291+0000","last_active":"2024-04-14T09:58:28.719419+0000","last_peered":"2024-04-14T09:58:28.719419+0000","last_clean":"2024-04-14T09:58:28.719419+0000","last_became_active":"2024-04-14T09:58:22.396071+0000","last_became_peered":"2024-04-14T09:58:22.396071+0000","last_unstale":"2024-04-14T09:58:28.719419+0000","last_undegraded":"2024-04-14T09:58:28.719419+0000","last_fullsized":"2024-04-14T09:58:28.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717868+0000","last_change":"2024-04-14T09:58:23.397574+0000","last_active":"2024-04-14T09:58:28.717868+0000","last_peered":"2024-04-14T09:58:28.717868+0000","last_clean":"2024-04-14T09:58:28.717868+0000","last_became_active":"2024-04-14T09:58:23.397261+0000","last_became_peered":"2024-04-14T09:58:23.397261+0000","last_unstale":"2024-04-14T09:58:28.717868+0000","last_undegraded":"2024-04-14T09:58:28.717868+0000","last_fullsized":"2024-04-14T09:58:28.717868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412409+0000","last_change":"2024-04-14T09:58:27.427865+0000","last_active":"2024-04-14T09:58:28.412409+0000","last_peered":"2024-04-14T09:58:28.412409+0000","last_clean":"2024-04-14T09:58:28.412409+0000","last_became_active":"2024-04-14T09:58:27.427483+0000","last_became_peered":"2024-04-14T09:58:27.427483+0000","last_unstale":"2024-04-14T09:58:28.412409+0000","last_undegraded":"2024-04-14T09:58:28.412409+0000","last_fullsized":"2024-04-14T09:58:28.412409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718852+0000","last_change":"2024-04-14T09:58:22.394942+0000","last_active":"2024-04-14T09:58:28.718852+0000","last_peered":"2024-04-14T09:58:28.718852+0000","last_clean":"2024-04-14T09:58:28.718852+0000","last_became_active":"2024-04-14T09:58:22.394679+0000","last_became_peered":"2024-04-14T09:58:22.394679+0000","last_unstale":"2024-04-14T09:58:28.718852+0000","last_undegraded":"2024-04-14T09:58:28.718852+0000","last_fullsized":"2024-04-14T09:58:28.718852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:33.668503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718216+0000","last_change":"2024-04-14T09:58:23.402824+0000","last_active":"2024-04-14T09:58:28.718216+0000","last_peered":"2024-04-14T09:58:28.718216+0000","last_clean":"2024-04-14T09:58:28.718216+0000","last_became_active":"2024-04-14T09:58:23.402246+0000","last_became_peered":"2024-04-14T09:58:23.402246+0000","last_unstale":"2024-04-14T09:58:28.718216+0000","last_undegraded":"2024-04-14T09:58:28.718216+0000","last_fullsized":"2024-04-14T09:58:28.718216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411885+0000","last_change":"2024-04-14T09:58:27.423837+0000","last_active":"2024-04-14T09:58:28.411885+0000","last_peered":"2024-04-14T09:58:28.411885+0000","last_clean":"2024-04-14T09:58:28.411885+0000","last_became_active":"2024-04-14T09:58:27.423439+0000","last_became_peered":"2024-04-14T09:58:27.423439+0000","last_unstale":"2024-04-14T09:58:28.411885+0000","last_undegraded":"2024-04-14T09:58:28.411885+0000","last_fullsized":"2024-04-14T09:58:28.411885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:48.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718018+0000","last_change":"2024-04-14T09:58:23.404740+0000","last_active":"2024-04-14T09:58:28.718018+0000","last_peered":"2024-04-14T09:58:28.718018+0000","last_clean":"2024-04-14T09:58:28.718018+0000","last_became_active":"2024-04-14T09:58:23.404362+0000","last_became_peered":"2024-04-14T09:58:23.404362+0000","last_unstale":"2024-04-14T09:58:28.718018+0000","last_undegraded":"2024-04-14T09:58:28.718018+0000","last_fullsized":"2024-04-14T09:58:28.718018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719028+0000","last_change":"2024-04-14T09:58:22.391425+0000","last_active":"2024-04-14T09:58:28.719028+0000","last_peered":"2024-04-14T09:58:28.719028+0000","last_clean":"2024-04-14T09:58:28.719028+0000","last_became_active":"2024-04-14T09:58:22.391062+0000","last_became_peered":"2024-04-14T09:58:22.391062+0000","last_unstale":"2024-04-14T09:58:28.719028+0000","last_undegraded":"2024-04-14T09:58:28.719028+0000","last_fullsized":"2024-04-14T09:58:28.719028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:45.817473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412039+0000","last_change":"2024-04-14T09:58:27.431221+0000","last_active":"2024-04-14T09:58:28.412039+0000","last_peered":"2024-04-14T09:58:28.412039+0000","last_clean":"2024-04-14T09:58:28.412039+0000","last_became_active":"2024-04-14T09:58:27.430764+0000","last_became_peered":"2024-04-14T09:58:27.430764+0000","last_unstale":"2024-04-14T09:58:28.412039+0000","last_undegraded":"2024-04-14T09:58:28.412039+0000","last_fullsized":"2024-04-14T09:58:28.412039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411673+0000","last_change":"2024-04-14T09:58:23.403246+0000","last_active":"2024-04-14T09:58:28.411673+0000","last_peered":"2024-04-14T09:58:28.411673+0000","last_clean":"2024-04-14T09:58:28.411673+0000","last_became_active":"2024-04-14T09:58:23.402610+0000","last_became_peered":"2024-04-14T09:58:23.402610+0000","last_unstale":"2024-04-14T09:58:28.411673+0000","last_undegraded":"2024-04-14T09:58:28.411673+0000","last_fullsized":"2024-04-14T09:58:28.411673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718903+0000","last_change":"2024-04-14T09:58:22.395168+0000","last_active":"2024-04-14T09:58:28.718903+0000","last_peered":"2024-04-14T09:58:28.718903+0000","last_clean":"2024-04-14T09:58:28.718903+0000","last_became_active":"2024-04-14T09:58:22.394913+0000","last_became_peered":"2024-04-14T09:58:22.394913+0000","last_unstale":"2024-04-14T09:58:28.718903+0000","last_undegraded":"2024-04-14T09:58:28.718903+0000","last_fullsized":"2024-04-14T09:58:28.718903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412208+0000","last_change":"2024-04-14T09:58:27.431150+0000","last_active":"2024-04-14T09:58:28.412208+0000","last_peered":"2024-04-14T09:58:28.412208+0000","last_clean":"2024-04-14T09:58:28.412208+0000","last_became_active":"2024-04-14T09:58:27.430727+0000","last_became_peered":"2024-04-14T09:58:27.430727+0000","last_unstale":"2024-04-14T09:58:28.412208+0000","last_undegraded":"2024-04-14T09:58:28.412208+0000","last_fullsized":"2024-04-14T09:58:28.412208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411542+0000","last_change":"2024-04-14T09:58:23.396679+0000","last_active":"2024-04-14T09:58:28.411542+0000","last_peered":"2024-04-14T09:58:28.411542+0000","last_clean":"2024-04-14T09:58:28.411542+0000","last_became_active":"2024-04-14T09:58:23.396401+0000","last_became_peered":"2024-04-14T09:58:23.396401+0000","last_unstale":"2024-04-14T09:58:28.411542+0000","last_undegraded":"2024-04-14T09:58:28.411542+0000","last_fullsized":"2024-04-14T09:58:28.411542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718109+0000","last_change":"2024-04-14T09:58:22.390340+0000","last_active":"2024-04-14T09:58:28.718109+0000","last_peered":"2024-04-14T09:58:28.718109+0000","last_clean":"2024-04-14T09:58:28.718109+0000","last_became_active":"2024-04-14T09:58:22.390062+0000","last_became_peered":"2024-04-14T09:58:22.390062+0000","last_unstale":"2024-04-14T09:58:28.718109+0000","last_undegraded":"2024-04-14T09:58:28.718109+0000","last_fullsized":"2024-04-14T09:58:28.718109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718409+0000","last_change":"2024-04-14T09:58:27.667944+0000","last_active":"2024-04-14T09:58:28.718409+0000","last_peered":"2024-04-14T09:58:28.718409+0000","last_clean":"2024-04-14T09:58:28.718409+0000","last_became_active":"2024-04-14T09:58:27.667524+0000","last_became_peered":"2024-04-14T09:58:27.667524+0000","last_unstale":"2024-04-14T09:58:28.718409+0000","last_undegraded":"2024-04-14T09:58:28.718409+0000","last_fullsized":"2024-04-14T09:58:28.718409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412175+0000","last_change":"2024-04-14T09:58:23.396159+0000","last_active":"2024-04-14T09:58:28.412175+0000","last_peered":"2024-04-14T09:58:28.412175+0000","last_clean":"2024-04-14T09:58:28.412175+0000","last_became_active":"2024-04-14T09:58:23.395832+0000","last_became_peered":"2024-04-14T09:58:23.395832+0000","last_unstale":"2024-04-14T09:58:28.412175+0000","last_undegraded":"2024-04-14T09:58:28.412175+0000","last_fullsized":"2024-04-14T09:58:28.412175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:07.911238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718345+0000","last_change":"2024-04-14T09:58:22.398706+0000","last_active":"2024-04-14T09:58:28.718345+0000","last_peered":"2024-04-14T09:58:28.718345+0000","last_clean":"2024-04-14T09:58:28.718345+0000","last_became_active":"2024-04-14T09:58:22.398161+0000","last_became_peered":"2024-04-14T09:58:22.398161+0000","last_unstale":"2024-04-14T09:58:28.718345+0000","last_undegraded":"2024-04-14T09:58:28.718345+0000","last_fullsized":"2024-04-14T09:58:28.718345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411920+0000","last_change":"2024-04-14T09:58:27.427979+0000","last_active":"2024-04-14T09:58:28.411920+0000","last_peered":"2024-04-14T09:58:28.411920+0000","last_clean":"2024-04-14T09:58:28.411920+0000","last_became_active":"2024-04-14T09:58:27.427612+0000","last_became_peered":"2024-04-14T09:58:27.427612+0000","last_unstale":"2024-04-14T09:58:28.411920+0000","last_undegraded":"2024-04-14T09:58:28.411920+0000","last_fullsized":"2024-04-14T09:58:28.411920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:10.049805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719106+0000","last_change":"2024-04-14T09:58:23.403433+0000","last_active":"2024-04-14T09:58:28.719106+0000","last_peered":"2024-04-14T09:58:28.719106+0000","last_clean":"2024-04-14T09:58:28.719106+0000","last_became_active":"2024-04-14T09:58:23.402914+0000","last_became_peered":"2024-04-14T09:58:23.402914+0000","last_unstale":"2024-04-14T09:58:28.719106+0000","last_undegraded":"2024-04-14T09:58:28.719106+0000","last_fullsized":"2024-04-14T09:58:28.719106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719347+0000","last_change":"2024-04-14T09:58:22.390638+0000","last_active":"2024-04-14T09:58:28.719347+0000","last_peered":"2024-04-14T09:58:28.719347+0000","last_clean":"2024-04-14T09:58:28.719347+0000","last_became_active":"2024-04-14T09:58:22.390011+0000","last_became_peered":"2024-04-14T09:58:22.390011+0000","last_unstale":"2024-04-14T09:58:28.719347+0000","last_undegraded":"2024-04-14T09:58:28.719347+0000","last_fullsized":"2024-04-14T09:58:28.719347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411864+0000","last_change":"2024-04-14T09:58:27.669279+0000","last_active":"2024-04-14T09:58:28.411864+0000","last_peered":"2024-04-14T09:58:28.411864+0000","last_clean":"2024-04-14T09:58:28.411864+0000","last_became_active":"2024-04-14T09:58:27.668902+0000","last_became_peered":"2024-04-14T09:58:27.668902+0000","last_unstale":"2024-04-14T09:58:28.411864+0000","last_undegraded":"2024-04-14T09:58:28.411864+0000","last_fullsized":"2024-04-14T09:58:28.411864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:35.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412231+0000","last_change":"2024-04-14T09:58:23.406160+0000","last_active":"2024-04-14T09:58:28.412231+0000","last_peered":"2024-04-14T09:58:28.412231+0000","last_clean":"2024-04-14T09:58:28.412231+0000","last_became_active":"2024-04-14T09:58:23.405890+0000","last_became_peered":"2024-04-14T09:58:23.405890+0000","last_unstale":"2024-04-14T09:58:28.412231+0000","last_undegraded":"2024-04-14T09:58:28.412231+0000","last_fullsized":"2024-04-14T09:58:28.412231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719543+0000","last_change":"2024-04-14T09:58:22.395184+0000","last_active":"2024-04-14T09:58:28.719543+0000","last_peered":"2024-04-14T09:58:28.719543+0000","last_clean":"2024-04-14T09:58:28.719543+0000","last_became_active":"2024-04-14T09:58:22.394873+0000","last_became_peered":"2024-04-14T09:58:22.394873+0000","last_unstale":"2024-04-14T09:58:28.719543+0000","last_undegraded":"2024-04-14T09:58:28.719543+0000","last_fullsized":"2024-04-14T09:58:28.719543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411231+0000","last_change":"2024-04-14T09:58:27.669744+0000","last_active":"2024-04-14T09:58:28.411231+0000","last_peered":"2024-04-14T09:58:28.411231+0000","last_clean":"2024-04-14T09:58:28.411231+0000","last_became_active":"2024-04-14T09:58:27.668513+0000","last_became_peered":"2024-04-14T09:58:27.668513+0000","last_unstale":"2024-04-14T09:58:28.411231+0000","last_undegraded":"2024-04-14T09:58:28.411231+0000","last_fullsized":"2024-04-14T09:58:28.411231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:15.700051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719218+0000","last_change":"2024-04-14T09:58:23.394968+0000","last_active":"2024-04-14T09:58:28.719218+0000","last_peered":"2024-04-14T09:58:28.719218+0000","last_clean":"2024-04-14T09:58:28.719218+0000","last_became_active":"2024-04-14T09:58:23.394596+0000","last_became_peered":"2024-04-14T09:58:23.394596+0000","last_unstale":"2024-04-14T09:58:28.719218+0000","last_undegraded":"2024-04-14T09:58:28.719218+0000","last_fullsized":"2024-04-14T09:58:28.719218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719510+0000","last_change":"2024-04-14T09:58:22.398406+0000","last_active":"2024-04-14T09:58:28.719510+0000","last_peered":"2024-04-14T09:58:28.719510+0000","last_clean":"2024-04-14T09:58:28.719510+0000","last_became_active":"2024-04-14T09:58:22.398116+0000","last_became_peered":"2024-04-14T09:58:22.398116+0000","last_unstale":"2024-04-14T09:58:28.719510+0000","last_undegraded":"2024-04-14T09:58:28.719510+0000","last_fullsized":"2024-04-14T09:58:28.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:16.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718418+0000","last_change":"2024-04-14T09:58:27.668504+0000","last_active":"2024-04-14T09:58:28.718418+0000","last_peered":"2024-04-14T09:58:28.718418+0000","last_clean":"2024-04-14T09:58:28.718418+0000","last_became_active":"2024-04-14T09:58:27.667630+0000","last_became_peered":"2024-04-14T09:58:27.667630+0000","last_unstale":"2024-04-14T09:58:28.718418+0000","last_undegraded":"2024-04-14T09:58:28.718418+0000","last_fullsized":"2024-04-14T09:58:28.718418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718268+0000","last_change":"2024-04-14T09:58:23.404467+0000","last_active":"2024-04-14T09:58:28.718268+0000","last_peered":"2024-04-14T09:58:28.718268+0000","last_clean":"2024-04-14T09:58:28.718268+0000","last_became_active":"2024-04-14T09:58:23.403864+0000","last_became_peered":"2024-04-14T09:58:23.403864+0000","last_unstale":"2024-04-14T09:58:28.718268+0000","last_undegraded":"2024-04-14T09:58:28.718268+0000","last_fullsized":"2024-04-14T09:58:28.718268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719289+0000","last_change":"2024-04-14T09:58:22.398987+0000","last_active":"2024-04-14T09:58:28.719289+0000","last_peered":"2024-04-14T09:58:28.719289+0000","last_clean":"2024-04-14T09:58:28.719289+0000","last_became_active":"2024-04-14T09:58:22.398682+0000","last_became_peered":"2024-04-14T09:58:22.398682+0000","last_unstale":"2024-04-14T09:58:28.719289+0000","last_undegraded":"2024-04-14T09:58:28.719289+0000","last_fullsized":"2024-04-14T09:58:28.719289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718473+0000","last_change":"2024-04-14T09:58:27.431798+0000","last_active":"2024-04-14T09:58:28.718473+0000","last_peered":"2024-04-14T09:58:28.718473+0000","last_clean":"2024-04-14T09:58:28.718473+0000","last_became_active":"2024-04-14T09:58:27.431417+0000","last_became_peered":"2024-04-14T09:58:27.431417+0000","last_unstale":"2024-04-14T09:58:28.718473+0000","last_undegraded":"2024-04-14T09:58:28.718473+0000","last_fullsized":"2024-04-14T09:58:28.718473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412488+0000","last_change":"2024-04-14T09:58:23.400432+0000","last_active":"2024-04-14T09:58:28.412488+0000","last_peered":"2024-04-14T09:58:28.412488+0000","last_clean":"2024-04-14T09:58:28.412488+0000","last_became_active":"2024-04-14T09:58:23.400175+0000","last_became_peered":"2024-04-14T09:58:23.400175+0000","last_unstale":"2024-04-14T09:58:28.412488+0000","last_undegraded":"2024-04-14T09:58:28.412488+0000","last_fullsized":"2024-04-14T09:58:28.412488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718166+0000","last_change":"2024-04-14T09:58:22.385714+0000","last_active":"2024-04-14T09:58:28.718166+0000","last_peered":"2024-04-14T09:58:28.718166+0000","last_clean":"2024-04-14T09:58:28.718166+0000","last_became_active":"2024-04-14T09:58:22.385337+0000","last_became_peered":"2024-04-14T09:58:22.385337+0000","last_unstale":"2024-04-14T09:58:28.718166+0000","last_undegraded":"2024-04-14T09:58:28.718166+0000","last_fullsized":"2024-04-14T09:58:28.718166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719243+0000","last_change":"2024-04-14T09:58:27.436131+0000","last_active":"2024-04-14T09:58:28.719243+0000","last_peered":"2024-04-14T09:58:28.719243+0000","last_clean":"2024-04-14T09:58:28.719243+0000","last_became_active":"2024-04-14T09:58:27.435730+0000","last_became_peered":"2024-04-14T09:58:27.435730+0000","last_unstale":"2024-04-14T09:58:28.719243+0000","last_undegraded":"2024-04-14T09:58:28.719243+0000","last_fullsized":"2024-04-14T09:58:28.719243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717989+0000","last_change":"2024-04-14T09:58:23.395456+0000","last_active":"2024-04-14T09:58:28.717989+0000","last_peered":"2024-04-14T09:58:28.717989+0000","last_clean":"2024-04-14T09:58:28.717989+0000","last_became_active":"2024-04-14T09:58:23.394235+0000","last_became_peered":"2024-04-14T09:58:23.394235+0000","last_unstale":"2024-04-14T09:58:28.717989+0000","last_undegraded":"2024-04-14T09:58:28.717989+0000","last_fullsized":"2024-04-14T09:58:28.717989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718058+0000","last_change":"2024-04-14T09:58:22.394128+0000","last_active":"2024-04-14T09:58:28.718058+0000","last_peered":"2024-04-14T09:58:28.718058+0000","last_clean":"2024-04-14T09:58:28.718058+0000","last_became_active":"2024-04-14T09:58:22.393765+0000","last_became_peered":"2024-04-14T09:58:22.393765+0000","last_unstale":"2024-04-14T09:58:28.718058+0000","last_undegraded":"2024-04-14T09:58:28.718058+0000","last_fullsized":"2024-04-14T09:58:28.718058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718551+0000","last_change":"2024-04-14T09:58:27.435923+0000","last_active":"2024-04-14T09:58:28.718551+0000","last_peered":"2024-04-14T09:58:28.718551+0000","last_clean":"2024-04-14T09:58:28.718551+0000","last_became_active":"2024-04-14T09:58:27.435542+0000","last_became_peered":"2024-04-14T09:58:27.435542+0000","last_unstale":"2024-04-14T09:58:28.718551+0000","last_undegraded":"2024-04-14T09:58:28.718551+0000","last_fullsized":"2024-04-14T09:58:28.718551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718022+0000","last_change":"2024-04-14T09:58:23.397634+0000","last_active":"2024-04-14T09:58:28.718022+0000","last_peered":"2024-04-14T09:58:28.718022+0000","last_clean":"2024-04-14T09:58:28.718022+0000","last_became_active":"2024-04-14T09:58:23.397351+0000","last_became_peered":"2024-04-14T09:58:23.397351+0000","last_unstale":"2024-04-14T09:58:28.718022+0000","last_undegraded":"2024-04-14T09:58:28.718022+0000","last_fullsized":"2024-04-14T09:58:28.718022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:17.852536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718440+0000","last_change":"2024-04-14T09:58:22.391011+0000","last_active":"2024-04-14T09:58:28.718440+0000","last_peered":"2024-04-14T09:58:28.718440+0000","last_clean":"2024-04-14T09:58:28.718440+0000","last_became_active":"2024-04-14T09:58:22.389916+0000","last_became_peered":"2024-04-14T09:58:22.389916+0000","last_unstale":"2024-04-14T09:58:28.718440+0000","last_undegraded":"2024-04-14T09:58:28.718440+0000","last_fullsized":"2024-04-14T09:58:28.718440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719004+0000","last_change":"2024-04-14T09:58:27.668355+0000","last_active":"2024-04-14T09:58:28.719004+0000","last_peered":"2024-04-14T09:58:28.719004+0000","last_clean":"2024-04-14T09:58:28.719004+0000","last_became_active":"2024-04-14T09:58:27.667937+0000","last_became_peered":"2024-04-14T09:58:27.667937+0000","last_unstale":"2024-04-14T09:58:28.719004+0000","last_undegraded":"2024-04-14T09:58:28.719004+0000","last_fullsized":"2024-04-14T09:58:28.719004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411503+0000","last_change":"2024-04-14T09:58:23.402580+0000","last_active":"2024-04-14T09:58:28.411503+0000","last_peered":"2024-04-14T09:58:28.411503+0000","last_clean":"2024-04-14T09:58:28.411503+0000","last_became_active":"2024-04-14T09:58:23.401893+0000","last_became_peered":"2024-04-14T09:58:23.401893+0000","last_unstale":"2024-04-14T09:58:28.411503+0000","last_undegraded":"2024-04-14T09:58:28.411503+0000","last_fullsized":"2024-04-14T09:58:28.411503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717978+0000","last_change":"2024-04-14T09:58:22.384644+0000","last_active":"2024-04-14T09:58:28.717978+0000","last_peered":"2024-04-14T09:58:28.717978+0000","last_clean":"2024-04-14T09:58:28.717978+0000","last_became_active":"2024-04-14T09:58:22.384367+0000","last_became_peered":"2024-04-14T09:58:22.384367+0000","last_unstale":"2024-04-14T09:58:28.717978+0000","last_undegraded":"2024-04-14T09:58:28.717978+0000","last_fullsized":"2024-04-14T09:58:28.717978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718493+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:58:28.718493+0000","last_peered":"2024-04-14T09:58:28.718493+0000","last_clean":"2024-04-14T09:58:28.718493+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:58:28.718493+0000","last_undegraded":"2024-04-14T09:58:28.718493+0000","last_fullsized":"2024-04-14T09:58:28.718493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717982+0000","last_change":"2024-04-14T09:58:27.668840+0000","last_active":"2024-04-14T09:58:28.717982+0000","last_peered":"2024-04-14T09:58:28.717982+0000","last_clean":"2024-04-14T09:58:28.717982+0000","last_became_active":"2024-04-14T09:58:27.668471+0000","last_became_peered":"2024-04-14T09:58:27.668471+0000","last_unstale":"2024-04-14T09:58:28.717982+0000","last_undegraded":"2024-04-14T09:58:28.717982+0000","last_fullsized":"2024-04-14T09:58:28.717982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719240+0000","last_change":"2024-04-14T09:58:23.409162+0000","last_active":"2024-04-14T09:58:28.719240+0000","last_peered":"2024-04-14T09:58:28.719240+0000","last_clean":"2024-04-14T09:58:28.719240+0000","last_became_active":"2024-04-14T09:58:23.408850+0000","last_became_peered":"2024-04-14T09:58:23.408850+0000","last_unstale":"2024-04-14T09:58:28.719240+0000","last_undegraded":"2024-04-14T09:58:28.719240+0000","last_fullsized":"2024-04-14T09:58:28.719240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:22.384829+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:22.383935+0000","last_became_peered":"2024-04-14T09:58:22.383935+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717969+0000","last_change":"2024-04-14T09:58:27.667909+0000","last_active":"2024-04-14T09:58:28.717969+0000","last_peered":"2024-04-14T09:58:28.717969+0000","last_clean":"2024-04-14T09:58:28.717969+0000","last_became_active":"2024-04-14T09:58:27.667550+0000","last_became_peered":"2024-04-14T09:58:27.667550+0000","last_unstale":"2024-04-14T09:58:28.717969+0000","last_undegraded":"2024-04-14T09:58:28.717969+0000","last_fullsized":"2024-04-14T09:58:28.717969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717961+0000","last_change":"2024-04-14T09:58:23.408028+0000","last_active":"2024-04-14T09:58:28.717961+0000","last_peered":"2024-04-14T09:58:28.717961+0000","last_clean":"2024-04-14T09:58:28.717961+0000","last_became_active":"2024-04-14T09:58:23.407386+0000","last_became_peered":"2024-04-14T09:58:23.407386+0000","last_unstale":"2024-04-14T09:58:28.717961+0000","last_undegraded":"2024-04-14T09:58:28.717961+0000","last_fullsized":"2024-04-14T09:58:28.717961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719337+0000","last_change":"2024-04-14T09:58:22.390083+0000","last_active":"2024-04-14T09:58:28.719337+0000","last_peered":"2024-04-14T09:58:28.719337+0000","last_clean":"2024-04-14T09:58:28.719337+0000","last_became_active":"2024-04-14T09:58:22.389814+0000","last_became_peered":"2024-04-14T09:58:22.389814+0000","last_unstale":"2024-04-14T09:58:28.719337+0000","last_undegraded":"2024-04-14T09:58:28.719337+0000","last_fullsized":"2024-04-14T09:58:28.719337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718671+0000","last_change":"2024-04-14T09:58:27.428137+0000","last_active":"2024-04-14T09:58:28.718671+0000","last_peered":"2024-04-14T09:58:28.718671+0000","last_clean":"2024-04-14T09:58:28.718671+0000","last_became_active":"2024-04-14T09:58:27.427703+0000","last_became_peered":"2024-04-14T09:58:27.427703+0000","last_unstale":"2024-04-14T09:58:28.718671+0000","last_undegraded":"2024-04-14T09:58:28.718671+0000","last_fullsized":"2024-04-14T09:58:28.718671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719613+0000","last_change":"2024-04-14T09:58:23.404910+0000","last_active":"2024-04-14T09:58:28.719613+0000","last_peered":"2024-04-14T09:58:28.719613+0000","last_clean":"2024-04-14T09:58:28.719613+0000","last_became_active":"2024-04-14T09:58:23.404674+0000","last_became_peered":"2024-04-14T09:58:23.404674+0000","last_unstale":"2024-04-14T09:58:28.719613+0000","last_undegraded":"2024-04-14T09:58:28.719613+0000","last_fullsized":"2024-04-14T09:58:28.719613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:55.269064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718569+0000","last_change":"2024-04-14T09:58:22.394100+0000","last_active":"2024-04-14T09:58:28.718569+0000","last_peered":"2024-04-14T09:58:28.718569+0000","last_clean":"2024-04-14T09:58:28.718569+0000","last_became_active":"2024-04-14T09:58:22.393802+0000","last_became_peered":"2024-04-14T09:58:22.393802+0000","last_unstale":"2024-04-14T09:58:28.718569+0000","last_undegraded":"2024-04-14T09:58:28.718569+0000","last_fullsized":"2024-04-14T09:58:28.718569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717532+0000","last_change":"2024-04-14T09:58:27.667932+0000","last_active":"2024-04-14T09:58:28.717532+0000","last_peered":"2024-04-14T09:58:28.717532+0000","last_clean":"2024-04-14T09:58:28.717532+0000","last_became_active":"2024-04-14T09:58:27.667573+0000","last_became_peered":"2024-04-14T09:58:27.667573+0000","last_unstale":"2024-04-14T09:58:28.717532+0000","last_undegraded":"2024-04-14T09:58:28.717532+0000","last_fullsized":"2024-04-14T09:58:28.717532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719102+0000","last_change":"2024-04-14T09:58:23.404327+0000","last_active":"2024-04-14T09:58:28.719102+0000","last_peered":"2024-04-14T09:58:28.719102+0000","last_clean":"2024-04-14T09:58:28.719102+0000","last_became_active":"2024-04-14T09:58:23.403839+0000","last_became_peered":"2024-04-14T09:58:23.403839+0000","last_unstale":"2024-04-14T09:58:28.719102+0000","last_undegraded":"2024-04-14T09:58:28.719102+0000","last_fullsized":"2024-04-14T09:58:28.719102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412068+0000","last_change":"2024-04-14T09:58:22.399651+0000","last_active":"2024-04-14T09:58:28.412068+0000","last_peered":"2024-04-14T09:58:28.412068+0000","last_clean":"2024-04-14T09:58:28.412068+0000","last_became_active":"2024-04-14T09:58:22.399360+0000","last_became_peered":"2024-04-14T09:58:22.399360+0000","last_unstale":"2024-04-14T09:58:28.412068+0000","last_undegraded":"2024-04-14T09:58:28.412068+0000","last_fullsized":"2024-04-14T09:58:28.412068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411723+0000","last_change":"2024-04-14T09:58:27.428173+0000","last_active":"2024-04-14T09:58:28.411723+0000","last_peered":"2024-04-14T09:58:28.411723+0000","last_clean":"2024-04-14T09:58:28.411723+0000","last_became_active":"2024-04-14T09:58:27.427578+0000","last_became_peered":"2024-04-14T09:58:27.427578+0000","last_unstale":"2024-04-14T09:58:28.411723+0000","last_undegraded":"2024-04-14T09:58:28.411723+0000","last_fullsized":"2024-04-14T09:58:28.411723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:22.952495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718706+0000","last_change":"2024-04-14T09:58:23.401131+0000","last_active":"2024-04-14T09:58:28.718706+0000","last_peered":"2024-04-14T09:58:28.718706+0000","last_clean":"2024-04-14T09:58:28.718706+0000","last_became_active":"2024-04-14T09:58:23.400782+0000","last_became_peered":"2024-04-14T09:58:23.400782+0000","last_unstale":"2024-04-14T09:58:28.718706+0000","last_undegraded":"2024-04-14T09:58:28.718706+0000","last_fullsized":"2024-04-14T09:58:28.718706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718236+0000","last_change":"2024-04-14T09:58:22.384480+0000","last_active":"2024-04-14T09:58:28.718236+0000","last_peered":"2024-04-14T09:58:28.718236+0000","last_clean":"2024-04-14T09:58:28.718236+0000","last_became_active":"2024-04-14T09:58:22.384218+0000","last_became_peered":"2024-04-14T09:58:22.384218+0000","last_unstale":"2024-04-14T09:58:28.718236+0000","last_undegraded":"2024-04-14T09:58:28.718236+0000","last_fullsized":"2024-04-14T09:58:28.718236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:27.426500+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:27.426031+0000","last_became_peered":"2024-04-14T09:58:27.426031+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718325+0000","last_change":"2024-04-14T09:58:23.405791+0000","last_active":"2024-04-14T09:58:28.718325+0000","last_peered":"2024-04-14T09:58:28.718325+0000","last_clean":"2024-04-14T09:58:28.718325+0000","last_became_active":"2024-04-14T09:58:23.405500+0000","last_became_peered":"2024-04-14T09:58:23.405500+0000","last_unstale":"2024-04-14T09:58:28.718325+0000","last_undegraded":"2024-04-14T09:58:28.718325+0000","last_fullsized":"2024-04-14T09:58:28.718325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718933+0000","last_change":"2024-04-14T09:58:22.390322+0000","last_active":"2024-04-14T09:58:28.718933+0000","last_peered":"2024-04-14T09:58:28.718933+0000","last_clean":"2024-04-14T09:58:28.718933+0000","last_became_active":"2024-04-14T09:58:22.390024+0000","last_became_peered":"2024-04-14T09:58:22.390024+0000","last_unstale":"2024-04-14T09:58:28.718933+0000","last_undegraded":"2024-04-14T09:58:28.718933+0000","last_fullsized":"2024-04-14T09:58:28.718933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412180+0000","last_change":"2024-04-14T09:58:27.670485+0000","last_active":"2024-04-14T09:58:28.412180+0000","last_peered":"2024-04-14T09:58:28.412180+0000","last_clean":"2024-04-14T09:58:28.412180+0000","last_became_active":"2024-04-14T09:58:27.670080+0000","last_became_peered":"2024-04-14T09:58:27.670080+0000","last_unstale":"2024-04-14T09:58:28.412180+0000","last_undegraded":"2024-04-14T09:58:28.412180+0000","last_fullsized":"2024-04-14T09:58:28.412180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:09.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:23.404680+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:23.404418+0000","last_became_peered":"2024-04-14T09:58:23.404418+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718090+0000","last_change":"2024-04-14T09:58:22.393671+0000","last_active":"2024-04-14T09:58:28.718090+0000","last_peered":"2024-04-14T09:58:28.718090+0000","last_clean":"2024-04-14T09:58:28.718090+0000","last_became_active":"2024-04-14T09:58:22.393431+0000","last_became_peered":"2024-04-14T09:58:22.393431+0000","last_unstale":"2024-04-14T09:58:28.718090+0000","last_undegraded":"2024-04-14T09:58:28.718090+0000","last_fullsized":"2024-04-14T09:58:28.718090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412086+0000","last_change":"2024-04-14T09:58:27.668347+0000","last_active":"2024-04-14T09:58:28.412086+0000","last_peered":"2024-04-14T09:58:28.412086+0000","last_clean":"2024-04-14T09:58:28.412086+0000","last_became_active":"2024-04-14T09:58:27.667469+0000","last_became_peered":"2024-04-14T09:58:27.667469+0000","last_unstale":"2024-04-14T09:58:28.412086+0000","last_undegraded":"2024-04-14T09:58:28.412086+0000","last_fullsized":"2024-04-14T09:58:28.412086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718924+0000","last_change":"2024-04-14T09:58:23.408574+0000","last_active":"2024-04-14T09:58:28.718924+0000","last_peered":"2024-04-14T09:58:28.718924+0000","last_clean":"2024-04-14T09:58:28.718924+0000","last_became_active":"2024-04-14T09:58:23.408295+0000","last_became_peered":"2024-04-14T09:58:23.408295+0000","last_unstale":"2024-04-14T09:58:28.718924+0000","last_undegraded":"2024-04-14T09:58:28.718924+0000","last_fullsized":"2024-04-14T09:58:28.718924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718923+0000","last_change":"2024-04-14T09:58:22.398210+0000","last_active":"2024-04-14T09:58:28.718923+0000","last_peered":"2024-04-14T09:58:28.718923+0000","last_clean":"2024-04-14T09:58:28.718923+0000","last_became_active":"2024-04-14T09:58:22.397939+0000","last_became_peered":"2024-04-14T09:58:22.397939+0000","last_unstale":"2024-04-14T09:58:28.718923+0000","last_undegraded":"2024-04-14T09:58:28.718923+0000","last_fullsized":"2024-04-14T09:58:28.718923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:32:05.174642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718300+0000","last_change":"2024-04-14T09:58:27.668858+0000","last_active":"2024-04-14T09:58:28.718300+0000","last_peered":"2024-04-14T09:58:28.718300+0000","last_clean":"2024-04-14T09:58:28.718300+0000","last_became_active":"2024-04-14T09:58:27.668509+0000","last_became_peered":"2024-04-14T09:58:27.668509+0000","last_unstale":"2024-04-14T09:58:28.718300+0000","last_undegraded":"2024-04-14T09:58:28.718300+0000","last_fullsized":"2024-04-14T09:58:28.718300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719155+0000","last_change":"2024-04-14T09:58:23.403359+0000","last_active":"2024-04-14T09:58:28.719155+0000","last_peered":"2024-04-14T09:58:28.719155+0000","last_clean":"2024-04-14T09:58:28.719155+0000","last_became_active":"2024-04-14T09:58:23.403105+0000","last_became_peered":"2024-04-14T09:58:23.403105+0000","last_unstale":"2024-04-14T09:58:28.719155+0000","last_undegraded":"2024-04-14T09:58:28.719155+0000","last_fullsized":"2024-04-14T09:58:28.719155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:32.895716+0000","last_change":"2024-04-14T09:58:22.393783+0000","last_active":"2024-04-14T09:58:32.895716+0000","last_peered":"2024-04-14T09:58:32.895716+0000","last_clean":"2024-04-14T09:58:32.895716+0000","last_became_active":"2024-04-14T09:58:22.393497+0000","last_became_peered":"2024-04-14T09:58:22.393497+0000","last_unstale":"2024-04-14T09:58:32.895716+0000","last_undegraded":"2024-04-14T09:58:32.895716+0000","last_fullsized":"2024-04-14T09:58:32.895716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718743+0000","last_change":"2024-04-14T09:58:27.435279+0000","last_active":"2024-04-14T09:58:28.718743+0000","last_peered":"2024-04-14T09:58:28.718743+0000","last_clean":"2024-04-14T09:58:28.718743+0000","last_became_active":"2024-04-14T09:58:27.434860+0000","last_became_peered":"2024-04-14T09:58:27.434860+0000","last_unstale":"2024-04-14T09:58:28.718743+0000","last_undegraded":"2024-04-14T09:58:28.718743+0000","last_fullsized":"2024-04-14T09:58:28.718743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412292+0000","last_change":"2024-04-14T09:58:23.406709+0000","last_active":"2024-04-14T09:58:28.412292+0000","last_peered":"2024-04-14T09:58:28.412292+0000","last_clean":"2024-04-14T09:58:28.412292+0000","last_became_active":"2024-04-14T09:58:23.406119+0000","last_became_peered":"2024-04-14T09:58:23.406119+0000","last_unstale":"2024-04-14T09:58:28.412292+0000","last_undegraded":"2024-04-14T09:58:28.412292+0000","last_fullsized":"2024-04-14T09:58:28.412292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:34.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719263+0000","last_change":"2024-04-14T09:58:22.383968+0000","last_active":"2024-04-14T09:58:28.719263+0000","last_peered":"2024-04-14T09:58:28.719263+0000","last_clean":"2024-04-14T09:58:28.719263+0000","last_became_active":"2024-04-14T09:58:22.383573+0000","last_became_peered":"2024-04-14T09:58:22.383573+0000","last_unstale":"2024-04-14T09:58:28.719263+0000","last_undegraded":"2024-04-14T09:58:28.719263+0000","last_fullsized":"2024-04-14T09:58:28.719263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412330+0000","last_change":"2024-04-14T09:58:27.428066+0000","last_active":"2024-04-14T09:58:28.412330+0000","last_peered":"2024-04-14T09:58:28.412330+0000","last_clean":"2024-04-14T09:58:28.412330+0000","last_became_active":"2024-04-14T09:58:27.427579+0000","last_became_peered":"2024-04-14T09:58:27.427579+0000","last_unstale":"2024-04-14T09:58:28.412330+0000","last_undegraded":"2024-04-14T09:58:28.412330+0000","last_fullsized":"2024-04-14T09:58:28.412330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718449+0000","last_change":"2024-04-14T09:58:23.404342+0000","last_active":"2024-04-14T09:58:28.718449+0000","last_peered":"2024-04-14T09:58:28.718449+0000","last_clean":"2024-04-14T09:58:28.718449+0000","last_became_active":"2024-04-14T09:58:23.403726+0000","last_became_peered":"2024-04-14T09:58:23.403726+0000","last_unstale":"2024-04-14T09:58:28.718449+0000","last_undegraded":"2024-04-14T09:58:28.718449+0000","last_fullsized":"2024-04-14T09:58:28.718449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718147+0000","last_change":"2024-04-14T09:58:22.392609+0000","last_active":"2024-04-14T09:58:28.718147+0000","last_peered":"2024-04-14T09:58:28.718147+0000","last_clean":"2024-04-14T09:58:28.718147+0000","last_became_active":"2024-04-14T09:58:22.392332+0000","last_became_peered":"2024-04-14T09:58:22.392332+0000","last_unstale":"2024-04-14T09:58:28.718147+0000","last_undegraded":"2024-04-14T09:58:28.718147+0000","last_fullsized":"2024-04-14T09:58:28.718147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411427+0000","last_change":"2024-04-14T09:58:27.434042+0000","last_active":"2024-04-14T09:58:28.411427+0000","last_peered":"2024-04-14T09:58:28.411427+0000","last_clean":"2024-04-14T09:58:28.411427+0000","last_became_active":"2024-04-14T09:58:27.433635+0000","last_became_peered":"2024-04-14T09:58:27.433635+0000","last_unstale":"2024-04-14T09:58:28.411427+0000","last_undegraded":"2024-04-14T09:58:28.411427+0000","last_fullsized":"2024-04-14T09:58:28.411427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:25.171487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717663+0000","last_change":"2024-04-14T09:58:23.410881+0000","last_active":"2024-04-14T09:58:28.717663+0000","last_peered":"2024-04-14T09:58:28.717663+0000","last_clean":"2024-04-14T09:58:28.717663+0000","last_became_active":"2024-04-14T09:58:23.410383+0000","last_became_peered":"2024-04-14T09:58:23.410383+0000","last_unstale":"2024-04-14T09:58:28.717663+0000","last_undegraded":"2024-04-14T09:58:28.717663+0000","last_fullsized":"2024-04-14T09:58:28.717663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719207+0000","last_change":"2024-04-14T09:58:22.392621+0000","last_active":"2024-04-14T09:58:28.719207+0000","last_peered":"2024-04-14T09:58:28.719207+0000","last_clean":"2024-04-14T09:58:28.719207+0000","last_became_active":"2024-04-14T09:58:22.390883+0000","last_became_peered":"2024-04-14T09:58:22.390883+0000","last_unstale":"2024-04-14T09:58:28.719207+0000","last_undegraded":"2024-04-14T09:58:28.719207+0000","last_fullsized":"2024-04-14T09:58:28.719207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411485+0000","last_change":"2024-04-14T09:58:27.668298+0000","last_active":"2024-04-14T09:58:28.411485+0000","last_peered":"2024-04-14T09:58:28.411485+0000","last_clean":"2024-04-14T09:58:28.411485+0000","last_became_active":"2024-04-14T09:58:27.667944+0000","last_became_peered":"2024-04-14T09:58:27.667944+0000","last_unstale":"2024-04-14T09:58:28.411485+0000","last_undegraded":"2024-04-14T09:58:28.411485+0000","last_fullsized":"2024-04-14T09:58:28.411485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718701+0000","last_change":"2024-04-14T09:58:27.669462+0000","last_active":"2024-04-14T09:58:28.718701+0000","last_peered":"2024-04-14T09:58:28.718701+0000","last_clean":"2024-04-14T09:58:28.718701+0000","last_became_active":"2024-04-14T09:58:27.669027+0000","last_became_peered":"2024-04-14T09:58:27.669027+0000","last_unstale":"2024-04-14T09:58:28.718701+0000","last_undegraded":"2024-04-14T09:58:28.718701+0000","last_fullsized":"2024-04-14T09:58:28.718701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717917+0000","last_change":"2024-04-14T09:58:23.398529+0000","last_active":"2024-04-14T09:58:28.717917+0000","last_peered":"2024-04-14T09:58:28.717917+0000","last_clean":"2024-04-14T09:58:28.717917+0000","last_became_active":"2024-04-14T09:58:23.397726+0000","last_became_peered":"2024-04-14T09:58:23.397726+0000","last_unstale":"2024-04-14T09:58:28.717917+0000","last_undegraded":"2024-04-14T09:58:28.717917+0000","last_fullsized":"2024-04-14T09:58:28.717917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717881+0000","last_change":"2024-04-14T09:58:22.384888+0000","last_active":"2024-04-14T09:58:28.717881+0000","last_peered":"2024-04-14T09:58:28.717881+0000","last_clean":"2024-04-14T09:58:28.717881+0000","last_became_active":"2024-04-14T09:58:22.383944+0000","last_became_peered":"2024-04-14T09:58:22.383944+0000","last_unstale":"2024-04-14T09:58:28.717881+0000","last_undegraded":"2024-04-14T09:58:28.717881+0000","last_fullsized":"2024-04-14T09:58:28.717881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719260+0000","last_change":"2024-04-14T09:58:27.429696+0000","last_active":"2024-04-14T09:58:28.719260+0000","last_peered":"2024-04-14T09:58:28.719260+0000","last_clean":"2024-04-14T09:58:28.719260+0000","last_became_active":"2024-04-14T09:58:27.429288+0000","last_became_peered":"2024-04-14T09:58:27.429288+0000","last_unstale":"2024-04-14T09:58:28.719260+0000","last_undegraded":"2024-04-14T09:58:28.719260+0000","last_fullsized":"2024-04-14T09:58:28.719260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411313+0000","last_change":"2024-04-14T09:58:23.400094+0000","last_active":"2024-04-14T09:58:28.411313+0000","last_peered":"2024-04-14T09:58:28.411313+0000","last_clean":"2024-04-14T09:58:28.411313+0000","last_became_active":"2024-04-14T09:58:23.399785+0000","last_became_peered":"2024-04-14T09:58:23.399785+0000","last_unstale":"2024-04-14T09:58:28.411313+0000","last_undegraded":"2024-04-14T09:58:28.411313+0000","last_fullsized":"2024-04-14T09:58:28.411313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411504+0000","last_change":"2024-04-14T09:58:22.397732+0000","last_active":"2024-04-14T09:58:28.411504+0000","last_peered":"2024-04-14T09:58:28.411504+0000","last_clean":"2024-04-14T09:58:28.411504+0000","last_became_active":"2024-04-14T09:58:22.397449+0000","last_became_peered":"2024-04-14T09:58:22.397449+0000","last_unstale":"2024-04-14T09:58:28.411504+0000","last_undegraded":"2024-04-14T09:58:28.411504+0000","last_fullsized":"2024-04-14T09:58:28.411504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718183+0000","last_change":"2024-04-14T09:58:22.393706+0000","last_active":"2024-04-14T09:58:28.718183+0000","last_peered":"2024-04-14T09:58:28.718183+0000","last_clean":"2024-04-14T09:58:28.718183+0000","last_became_active":"2024-04-14T09:58:22.393405+0000","last_became_peered":"2024-04-14T09:58:22.393405+0000","last_unstale":"2024-04-14T09:58:28.718183+0000","last_undegraded":"2024-04-14T09:58:28.718183+0000","last_fullsized":"2024-04-14T09:58:28.718183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:23.402551+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:23.402184+0000","last_became_peered":"2024-04-14T09:58:23.402184+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717894+0000","last_change":"2024-04-14T09:58:27.432957+0000","last_active":"2024-04-14T09:58:28.717894+0000","last_peered":"2024-04-14T09:58:28.717894+0000","last_clean":"2024-04-14T09:58:28.717894+0000","last_became_active":"2024-04-14T09:58:27.432530+0000","last_became_peered":"2024-04-14T09:58:27.432530+0000","last_unstale":"2024-04-14T09:58:28.717894+0000","last_undegraded":"2024-04-14T09:58:28.717894+0000","last_fullsized":"2024-04-14T09:58:28.717894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:57.757589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411784+0000","last_change":"2024-04-14T09:58:22.391395+0000","last_active":"2024-04-14T09:58:28.411784+0000","last_peered":"2024-04-14T09:58:28.411784+0000","last_clean":"2024-04-14T09:58:28.411784+0000","last_became_active":"2024-04-14T09:58:22.391132+0000","last_became_peered":"2024-04-14T09:58:22.391132+0000","last_unstale":"2024-04-14T09:58:28.411784+0000","last_undegraded":"2024-04-14T09:58:28.411784+0000","last_fullsized":"2024-04-14T09:58:28.411784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:45.950958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411949+0000","last_change":"2024-04-14T09:58:23.396095+0000","last_active":"2024-04-14T09:58:28.411949+0000","last_peered":"2024-04-14T09:58:28.411949+0000","last_clean":"2024-04-14T09:58:28.411949+0000","last_became_active":"2024-04-14T09:58:23.395823+0000","last_became_peered":"2024-04-14T09:58:23.395823+0000","last_unstale":"2024-04-14T09:58:28.411949+0000","last_undegraded":"2024-04-14T09:58:28.411949+0000","last_fullsized":"2024-04-14T09:58:28.411949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:06.520353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412451+0000","last_change":"2024-04-14T09:58:27.432961+0000","last_active":"2024-04-14T09:58:28.412451+0000","last_peered":"2024-04-14T09:58:28.412451+0000","last_clean":"2024-04-14T09:58:28.412451+0000","last_became_active":"2024-04-14T09:58:27.432561+0000","last_became_peered":"2024-04-14T09:58:27.432561+0000","last_unstale":"2024-04-14T09:58:28.412451+0000","last_undegraded":"2024-04-14T09:58:28.412451+0000","last_fullsized":"2024-04-14T09:58:28.412451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:05.795116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718199+0000","last_change":"2024-04-14T09:58:23.407620+0000","last_active":"2024-04-14T09:58:28.718199+0000","last_peered":"2024-04-14T09:58:28.718199+0000","last_clean":"2024-04-14T09:58:28.718199+0000","last_became_active":"2024-04-14T09:58:23.407229+0000","last_became_peered":"2024-04-14T09:58:23.407229+0000","last_unstale":"2024-04-14T09:58:28.718199+0000","last_undegraded":"2024-04-14T09:58:28.718199+0000","last_fullsized":"2024-04-14T09:58:28.718199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717968+0000","last_change":"2024-04-14T09:58:23.401653+0000","last_active":"2024-04-14T09:58:28.717968+0000","last_peered":"2024-04-14T09:58:28.717968+0000","last_clean":"2024-04-14T09:58:28.717968+0000","last_became_active":"2024-04-14T09:58:23.401364+0000","last_became_peered":"2024-04-14T09:58:23.401364+0000","last_unstale":"2024-04-14T09:58:28.717968+0000","last_undegraded":"2024-04-14T09:58:28.717968+0000","last_fullsized":"2024-04-14T09:58:28.717968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718067+0000","last_change":"2024-04-14T09:58:23.408171+0000","last_active":"2024-04-14T09:58:28.718067+0000","last_peered":"2024-04-14T09:58:28.718067+0000","last_clean":"2024-04-14T09:58:28.718067+0000","last_became_active":"2024-04-14T09:58:23.407239+0000","last_became_peered":"2024-04-14T09:58:23.407239+0000","last_unstale":"2024-04-14T09:58:28.718067+0000","last_undegraded":"2024-04-14T09:58:28.718067+0000","last_fullsized":"2024-04-14T09:58:28.718067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718730+0000","last_change":"2024-04-14T09:58:23.404101+0000","last_active":"2024-04-14T09:58:28.718730+0000","last_peered":"2024-04-14T09:58:28.718730+0000","last_clean":"2024-04-14T09:58:28.718730+0000","last_became_active":"2024-04-14T09:58:23.403370+0000","last_became_peered":"2024-04-14T09:58:23.403370+0000","last_unstale":"2024-04-14T09:58:28.718730+0000","last_undegraded":"2024-04-14T09:58:28.718730+0000","last_fullsized":"2024-04-14T09:58:28.718730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:17:06.376909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412345+0000","last_change":"2024-04-14T09:58:23.404808+0000","last_active":"2024-04-14T09:58:28.412345+0000","last_peered":"2024-04-14T09:58:28.412345+0000","last_clean":"2024-04-14T09:58:28.412345+0000","last_became_active":"2024-04-14T09:58:23.404405+0000","last_became_peered":"2024-04-14T09:58:23.404405+0000","last_unstale":"2024-04-14T09:58:28.412345+0000","last_undegraded":"2024-04-14T09:58:28.412345+0000","last_fullsized":"2024-04-14T09:58:28.412345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719094+0000","last_change":"2024-04-14T09:58:23.404182+0000","last_active":"2024-04-14T09:58:28.719094+0000","last_peered":"2024-04-14T09:58:28.719094+0000","last_clean":"2024-04-14T09:58:28.719094+0000","last_became_active":"2024-04-14T09:58:23.403910+0000","last_became_peered":"2024-04-14T09:58:23.403910+0000","last_unstale":"2024-04-14T09:58:28.719094+0000","last_undegraded":"2024-04-14T09:58:28.719094+0000","last_fullsized":"2024-04-14T09:58:28.719094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719413+0000","last_change":"2024-04-14T09:58:23.408207+0000","last_active":"2024-04-14T09:58:28.719413+0000","last_peered":"2024-04-14T09:58:28.719413+0000","last_clean":"2024-04-14T09:58:28.719413+0000","last_became_active":"2024-04-14T09:58:23.406767+0000","last_became_peered":"2024-04-14T09:58:23.406767+0000","last_unstale":"2024-04-14T09:58:28.719413+0000","last_undegraded":"2024-04-14T09:58:28.719413+0000","last_fullsized":"2024-04-14T09:58:28.719413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412204+0000","last_change":"2024-04-14T09:58:23.406514+0000","last_active":"2024-04-14T09:58:28.412204+0000","last_peered":"2024-04-14T09:58:28.412204+0000","last_clean":"2024-04-14T09:58:28.412204+0000","last_became_active":"2024-04-14T09:58:23.405465+0000","last_became_peered":"2024-04-14T09:58:23.405465+0000","last_unstale":"2024-04-14T09:58:28.412204+0000","last_undegraded":"2024-04-14T09:58:28.412204+0000","last_fullsized":"2024-04-14T09:58:28.412204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717813+0000","last_change":"2024-04-14T09:58:23.406224+0000","last_active":"2024-04-14T09:58:28.717813+0000","last_peered":"2024-04-14T09:58:28.717813+0000","last_clean":"2024-04-14T09:58:28.717813+0000","last_became_active":"2024-04-14T09:58:23.405960+0000","last_became_peered":"2024-04-14T09:58:23.405960+0000","last_unstale":"2024-04-14T09:58:28.717813+0000","last_undegraded":"2024-04-14T09:58:28.717813+0000","last_fullsized":"2024-04-14T09:58:28.717813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411302+0000","last_change":"2024-04-14T09:58:23.397512+0000","last_active":"2024-04-14T09:58:28.411302+0000","last_peered":"2024-04-14T09:58:28.411302+0000","last_clean":"2024-04-14T09:58:28.411302+0000","last_became_active":"2024-04-14T09:58:23.397243+0000","last_became_peered":"2024-04-14T09:58:23.397243+0000","last_unstale":"2024-04-14T09:58:28.411302+0000","last_undegraded":"2024-04-14T09:58:28.411302+0000","last_fullsized":"2024-04-14T09:58:28.411302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718006+0000","last_change":"2024-04-14T09:58:23.397450+0000","last_active":"2024-04-14T09:58:28.718006+0000","last_peered":"2024-04-14T09:58:28.718006+0000","last_clean":"2024-04-14T09:58:28.718006+0000","last_became_active":"2024-04-14T09:58:23.397165+0000","last_became_peered":"2024-04-14T09:58:23.397165+0000","last_unstale":"2024-04-14T09:58:28.718006+0000","last_undegraded":"2024-04-14T09:58:28.718006+0000","last_fullsized":"2024-04-14T09:58:28.718006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718469+0000","last_change":"2024-04-14T09:58:23.407381+0000","last_active":"2024-04-14T09:58:28.718469+0000","last_peered":"2024-04-14T09:58:28.718469+0000","last_clean":"2024-04-14T09:58:28.718469+0000","last_became_active":"2024-04-14T09:58:23.407118+0000","last_became_peered":"2024-04-14T09:58:23.407118+0000","last_unstale":"2024-04-14T09:58:28.718469+0000","last_undegraded":"2024-04-14T09:58:28.718469+0000","last_fullsized":"2024-04-14T09:58:28.718469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718613+0000","last_change":"2024-04-14T09:58:23.404570+0000","last_active":"2024-04-14T09:58:28.718613+0000","last_peered":"2024-04-14T09:58:28.718613+0000","last_clean":"2024-04-14T09:58:28.718613+0000","last_became_active":"2024-04-14T09:58:23.404262+0000","last_became_peered":"2024-04-14T09:58:23.404262+0000","last_unstale":"2024-04-14T09:58:28.718613+0000","last_undegraded":"2024-04-14T09:58:28.718613+0000","last_fullsized":"2024-04-14T09:58:28.718613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719427+0000","last_change":"2024-04-14T09:58:23.404295+0000","last_active":"2024-04-14T09:58:28.719427+0000","last_peered":"2024-04-14T09:58:28.719427+0000","last_clean":"2024-04-14T09:58:28.719427+0000","last_became_active":"2024-04-14T09:58:23.404005+0000","last_became_peered":"2024-04-14T09:58:23.404005+0000","last_unstale":"2024-04-14T09:58:28.719427+0000","last_undegraded":"2024-04-14T09:58:28.719427+0000","last_fullsized":"2024-04-14T09:58:28.719427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718467+0000","last_change":"2024-04-14T09:58:23.407616+0000","last_active":"2024-04-14T09:58:28.718467+0000","last_peered":"2024-04-14T09:58:28.718467+0000","last_clean":"2024-04-14T09:58:28.718467+0000","last_became_active":"2024-04-14T09:58:23.407260+0000","last_became_peered":"2024-04-14T09:58:23.407260+0000","last_unstale":"2024-04-14T09:58:28.718467+0000","last_undegraded":"2024-04-14T09:58:28.718467+0000","last_fullsized":"2024-04-14T09:58:28.718467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718039+0000","last_change":"2024-04-14T09:58:23.410650+0000","last_active":"2024-04-14T09:58:28.718039+0000","last_peered":"2024-04-14T09:58:28.718039+0000","last_clean":"2024-04-14T09:58:28.718039+0000","last_became_active":"2024-04-14T09:58:23.410379+0000","last_became_peered":"2024-04-14T09:58:23.410379+0000","last_unstale":"2024-04-14T09:58:28.718039+0000","last_undegraded":"2024-04-14T09:58:28.718039+0000","last_fullsized":"2024-04-14T09:58:28.718039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717749+0000","last_change":"2024-04-14T09:58:23.398466+0000","last_active":"2024-04-14T09:58:28.717749+0000","last_peered":"2024-04-14T09:58:28.717749+0000","last_clean":"2024-04-14T09:58:28.717749+0000","last_became_active":"2024-04-14T09:58:23.398189+0000","last_became_peered":"2024-04-14T09:58:23.398189+0000","last_unstale":"2024-04-14T09:58:28.717749+0000","last_undegraded":"2024-04-14T09:58:28.717749+0000","last_fullsized":"2024-04-14T09:58:28.717749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718017+0000","last_change":"2024-04-14T09:58:23.393259+0000","last_active":"2024-04-14T09:58:28.718017+0000","last_peered":"2024-04-14T09:58:28.718017+0000","last_clean":"2024-04-14T09:58:28.718017+0000","last_became_active":"2024-04-14T09:58:23.392971+0000","last_became_peered":"2024-04-14T09:58:23.392971+0000","last_unstale":"2024-04-14T09:58:28.718017+0000","last_undegraded":"2024-04-14T09:58:28.718017+0000","last_fullsized":"2024-04-14T09:58:28.718017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718832+0000","last_change":"2024-04-14T09:58:23.398828+0000","last_active":"2024-04-14T09:58:28.718832+0000","last_peered":"2024-04-14T09:58:28.718832+0000","last_clean":"2024-04-14T09:58:28.718832+0000","last_became_active":"2024-04-14T09:58:23.398386+0000","last_became_peered":"2024-04-14T09:58:23.398386+0000","last_unstale":"2024-04-14T09:58:28.718832+0000","last_undegraded":"2024-04-14T09:58:28.718832+0000","last_fullsized":"2024-04-14T09:58:28.718832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411945+0000","last_change":"2024-04-14T09:58:23.407691+0000","last_active":"2024-04-14T09:58:28.411945+0000","last_peered":"2024-04-14T09:58:28.411945+0000","last_clean":"2024-04-14T09:58:28.411945+0000","last_became_active":"2024-04-14T09:58:23.407271+0000","last_became_peered":"2024-04-14T09:58:23.407271+0000","last_unstale":"2024-04-14T09:58:28.411945+0000","last_undegraded":"2024-04-14T09:58:28.411945+0000","last_fullsized":"2024-04-14T09:58:28.411945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412261+0000","last_change":"2024-04-14T09:58:23.405452+0000","last_active":"2024-04-14T09:58:28.412261+0000","last_peered":"2024-04-14T09:58:28.412261+0000","last_clean":"2024-04-14T09:58:28.412261+0000","last_became_active":"2024-04-14T09:58:23.404804+0000","last_became_peered":"2024-04-14T09:58:23.404804+0000","last_unstale":"2024-04-14T09:58:28.412261+0000","last_undegraded":"2024-04-14T09:58:28.412261+0000","last_fullsized":"2024-04-14T09:58:28.412261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718106+0000","last_change":"2024-04-14T09:58:23.413350+0000","last_active":"2024-04-14T09:58:28.718106+0000","last_peered":"2024-04-14T09:58:28.718106+0000","last_clean":"2024-04-14T09:58:28.718106+0000","last_became_active":"2024-04-14T09:58:23.413030+0000","last_became_peered":"2024-04-14T09:58:23.413030+0000","last_unstale":"2024-04-14T09:58:28.718106+0000","last_undegraded":"2024-04-14T09:58:28.718106+0000","last_fullsized":"2024-04-14T09:58:28.718106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719331+0000","last_change":"2024-04-14T09:58:23.411335+0000","last_active":"2024-04-14T09:58:28.719331+0000","last_peered":"2024-04-14T09:58:28.719331+0000","last_clean":"2024-04-14T09:58:28.719331+0000","last_became_active":"2024-04-14T09:58:23.409283+0000","last_became_peered":"2024-04-14T09:58:23.409283+0000","last_unstale":"2024-04-14T09:58:28.719331+0000","last_undegraded":"2024-04-14T09:58:28.719331+0000","last_fullsized":"2024-04-14T09:58:28.719331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719533+0000","last_change":"2024-04-14T09:58:23.408154+0000","last_active":"2024-04-14T09:58:28.719533+0000","last_peered":"2024-04-14T09:58:28.719533+0000","last_clean":"2024-04-14T09:58:28.719533+0000","last_became_active":"2024-04-14T09:58:23.407848+0000","last_became_peered":"2024-04-14T09:58:23.407848+0000","last_unstale":"2024-04-14T09:58:28.719533+0000","last_undegraded":"2024-04-14T09:58:28.719533+0000","last_fullsized":"2024-04-14T09:58:28.719533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411189+0000","last_change":"2024-04-14T09:58:23.399466+0000","last_active":"2024-04-14T09:58:28.411189+0000","last_peered":"2024-04-14T09:58:28.411189+0000","last_clean":"2024-04-14T09:58:28.411189+0000","last_became_active":"2024-04-14T09:58:23.399192+0000","last_became_peered":"2024-04-14T09:58:23.399192+0000","last_unstale":"2024-04-14T09:58:28.411189+0000","last_undegraded":"2024-04-14T09:58:28.411189+0000","last_fullsized":"2024-04-14T09:58:28.411189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718615+0000","last_change":"2024-04-14T09:58:23.402089+0000","last_active":"2024-04-14T09:58:28.718615+0000","last_peered":"2024-04-14T09:58:28.718615+0000","last_clean":"2024-04-14T09:58:28.718615+0000","last_became_active":"2024-04-14T09:58:23.401791+0000","last_became_peered":"2024-04-14T09:58:23.401791+0000","last_unstale":"2024-04-14T09:58:28.718615+0000","last_undegraded":"2024-04-14T09:58:28.718615+0000","last_fullsized":"2024-04-14T09:58:28.718615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717901+0000","last_change":"2024-04-14T09:58:23.400405+0000","last_active":"2024-04-14T09:58:28.717901+0000","last_peered":"2024-04-14T09:58:28.717901+0000","last_clean":"2024-04-14T09:58:28.717901+0000","last_became_active":"2024-04-14T09:58:23.400094+0000","last_became_peered":"2024-04-14T09:58:23.400094+0000","last_unstale":"2024-04-14T09:58:28.717901+0000","last_undegraded":"2024-04-14T09:58:28.717901+0000","last_fullsized":"2024-04-14T09:58:28.717901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718700+0000","last_change":"2024-04-14T09:58:23.401268+0000","last_active":"2024-04-14T09:58:28.718700+0000","last_peered":"2024-04-14T09:58:28.718700+0000","last_clean":"2024-04-14T09:58:28.718700+0000","last_became_active":"2024-04-14T09:58:23.400978+0000","last_became_peered":"2024-04-14T09:58:23.400978+0000","last_unstale":"2024-04-14T09:58:28.718700+0000","last_undegraded":"2024-04-14T09:58:28.718700+0000","last_fullsized":"2024-04-14T09:58:28.718700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717724+0000","last_change":"2024-04-14T09:58:23.410361+0000","last_active":"2024-04-14T09:58:28.717724+0000","last_peered":"2024-04-14T09:58:28.717724+0000","last_clean":"2024-04-14T09:58:28.717724+0000","last_became_active":"2024-04-14T09:58:23.407726+0000","last_became_peered":"2024-04-14T09:58:23.407726+0000","last_unstale":"2024-04-14T09:58:28.717724+0000","last_undegraded":"2024-04-14T09:58:28.717724+0000","last_fullsized":"2024-04-14T09:58:28.717724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719465+0000","last_change":"2024-04-14T09:58:23.402602+0000","last_active":"2024-04-14T09:58:28.719465+0000","last_peered":"2024-04-14T09:58:28.719465+0000","last_clean":"2024-04-14T09:58:28.719465+0000","last_became_active":"2024-04-14T09:58:23.402243+0000","last_became_peered":"2024-04-14T09:58:23.402243+0000","last_unstale":"2024-04-14T09:58:28.719465+0000","last_undegraded":"2024-04-14T09:58:28.719465+0000","last_fullsized":"2024-04-14T09:58:28.719465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:37.707556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719506+0000","last_change":"2024-04-14T09:58:23.399802+0000","last_active":"2024-04-14T09:58:28.719506+0000","last_peered":"2024-04-14T09:58:28.719506+0000","last_clean":"2024-04-14T09:58:28.719506+0000","last_became_active":"2024-04-14T09:58:23.399467+0000","last_became_peered":"2024-04-14T09:58:23.399467+0000","last_unstale":"2024-04-14T09:58:28.719506+0000","last_undegraded":"2024-04-14T09:58:28.719506+0000","last_fullsized":"2024-04-14T09:58:28.719506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719375+0000","last_change":"2024-04-14T09:58:23.406066+0000","last_active":"2024-04-14T09:58:28.719375+0000","last_peered":"2024-04-14T09:58:28.719375+0000","last_clean":"2024-04-14T09:58:28.719375+0000","last_became_active":"2024-04-14T09:58:23.405739+0000","last_became_peered":"2024-04-14T09:58:23.405739+0000","last_unstale":"2024-04-14T09:58:28.719375+0000","last_undegraded":"2024-04-14T09:58:28.719375+0000","last_fullsized":"2024-04-14T09:58:28.719375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:58:46.475 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:58:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.611+0000 7fcc344de640 1 Processor -- start 2024-04-14T09:58:46.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.611+0000 7fcc344de640 1 -- start start 2024-04-14T09:58:46.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc344de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 0x7fcc2c0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc344de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 0x7fcc2c168350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc344de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc2c06c760 con 0x7fcc2c06d800 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc344de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fcc2c06d370 con 0x7fcc2c09b150 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc344de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c06ca40 con 0x7fcc2c15e370 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc31a79640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcc2c06d800 0x7fcc2c09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40846/0 (socket says 172.21.15.40:40846) 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc31a79640 1 -- 172.21.15.40:0/4192231980 learned_addr learned my addr 172.21.15.40:0/4192231980 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc32a7b640 1 --2- 172.21.15.40:0/4192231980 >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 0x7fcc2c168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.612+0000 7fcc3227a640 1 --2- 172.21.15.40:0/4192231980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 0x7fcc2c0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc31278640 1 -- 172.21.15.40:0/4192231980 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354185102 0 0) 0x7fcc2c06c760 con 0x7fcc2c06d800 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc31278640 1 -- 172.21.15.40:0/4192231980 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc18003520 con 0x7fcc2c06d800 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc3227a640 1 -- 172.21.15.40:0/4192231980 >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 msgr2=0x7fcc2c168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:46.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc3227a640 1 --2- 172.21.15.40:0/4192231980 >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 0x7fcc2c168350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc3227a640 1 -- 172.21.15.40:0/4192231980 >> v1:172.21.15.40:6789/0 conn(0x7fcc2c06d800 legacy=0x7fcc2c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc3227a640 1 -- 172.21.15.40:0/4192231980 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c06cd20 con 0x7fcc2c15e370 2024-04-14T09:58:46.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.613+0000 7fcc32a7b640 1 --2- 172.21.15.40:0/4192231980 >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 0x7fcc2c168350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc3227a640 1 --2- 172.21.15.40:0/4192231980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 0x7fcc2c0d0db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc2802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca79dacce25e9b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc31278640 1 -- 172.21.15.40:0/4192231980 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035020 con 0x7fcc2c15e370 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc31278640 1 -- 172.21.15.40:0/4192231980 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc28031830 con 0x7fcc2c15e370 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc31278640 1 -- 172.21.15.40:0/4192231980 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28031c00 con 0x7fcc2c15e370 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 -- 172.21.15.40:0/4192231980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 msgr2=0x7fcc2c0d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 --2- 172.21.15.40:0/4192231980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 0x7fcc2c0d0db0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcc280097a0 tx=0x7fcc2802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 -- 172.21.15.40:0/4192231980 shutdown_connections 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 --2- 172.21.15.40:0/4192231980 >> v2:172.21.15.136:3300/0 conn(0x7fcc2c09b150 0x7fcc2c168350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 --2- 172.21.15.40:0/4192231980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c15e370 0x7fcc2c0d0db0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 -- 172.21.15.40:0/4192231980 >> 172.21.15.40:0/4192231980 conn(0x7fcc2c0b3ba0 msgr2=0x7fcc2c0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 -- 172.21.15.40:0/4192231980 shutdown_connections 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.614+0000 7fcc344de640 1 -- 172.21.15.40:0/4192231980 wait complete. 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.615+0000 7fcc344de640 1 Processor -- start 2024-04-14T09:58:46.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.615+0000 7fcc344de640 1 -- start start 2024-04-14T09:58:46.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 0x7fcc2c15b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc2c15e370 0x7fcc2c14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c15e8d0 con 0x7fcc2c06d800 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcc2c15e750 con 0x7fcc2c15e370 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc344de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcc2c0d12f0 con 0x7fcc2c09b150 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54798/0 (socket says 172.21.15.40:54798) 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 -- 172.21.15.40:0/3683167761 learned_addr learned my addr 172.21.15.40:0/3683167761 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc31a79640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 0x7fcc2c15b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc32a7b640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc2c15e370 0x7fcc2c14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 -- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 msgr2=0x7fcc2c15b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 0x7fcc2c15b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 -- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc2c15e370 msgr2=0x7fcc2c14e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.616+0000 7fcc3227a640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc2c15e370 0x7fcc2c14e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc3227a640 1 -- 172.21.15.40:0/3683167761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc2c0b5f50 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc31a79640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 0x7fcc2c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc3227a640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28035040 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2803b880 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc2803bc70 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc2c1f40b0 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.617+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc2c1f4670 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.618+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc2c0756f0 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.618+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc28038020 con 0x7fcc2c06d800 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.619+0000 7fcc22ffd640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 0x7fcc1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.619+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcc280ade40 con 0x7fcc2c06d800 2024-04-14T09:58:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.619+0000 7fcc31a79640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 0x7fcc1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.619+0000 7fcc31a79640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 0x7fcc1006ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007fd0 tx=0x7fcc1c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.623+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcc2807bf20 con 0x7fcc2c06d800 2024-04-14T09:58:46.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.805+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcc2c0b8030 con 0x7fcc1006c920 2024-04-14T09:58:46.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.813+0000 7fcc22ffd640 1 -- 172.21.15.40:0/3683167761 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fcc2c0b8030 con 0x7fcc1006c920 2024-04-14T09:58:46.816 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:46.818 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:58:46.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.816+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 msgr2=0x7fcc1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.816+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 0x7fcc1006ede0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c007fd0 tx=0x7fcc1c009040 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.816+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 msgr2=0x7fcc2c1581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.816+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcc28000c00 tx=0x7fcc280046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 shutdown_connections 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcc1006c920 0x7fcc1006ede0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc2c15e370 0x7fcc2c14e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc2c09b150 0x7fcc2c15b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 --2- 172.21.15.40:0/3683167761 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcc2c06d800 0x7fcc2c1581a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 >> 172.21.15.40:0/3683167761 conn(0x7fcc2c0b3ba0 msgr2=0x7fcc2c070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 shutdown_connections 2024-04-14T09:58:46.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.817+0000 7fcc344de640 1 -- 172.21.15.40:0/3683167761 wait complete. 2024-04-14T09:58:46.827 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-14T09:58:44.807907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002172"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718547+0000","last_change":"2024-04-14T09:58:22.400374+0000","last_active":"2024-04-14T09:58:28.718547+0000","last_peered":"2024-04-14T09:58:28.718547+0000","last_clean":"2024-04-14T09:58:28.718547+0000","last_became_active":"2024-04-14T09:58:22.400083+0000","last_became_peered":"2024-04-14T09:58:22.400083+0000","last_unstale":"2024-04-14T09:58:28.718547+0000","last_undegraded":"2024-04-14T09:58:28.718547+0000","last_fullsized":"2024-04-14T09:58:28.718547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411956+0000","last_change":"2024-04-14T09:58:23.405589+0000","last_active":"2024-04-14T09:58:28.411956+0000","last_peered":"2024-04-14T09:58:28.411956+0000","last_clean":"2024-04-14T09:58:28.411956+0000","last_became_active":"2024-04-14T09:58:23.405288+0000","last_became_peered":"2024-04-14T09:58:23.405288+0000","last_unstale":"2024-04-14T09:58:28.411956+0000","last_undegraded":"2024-04-14T09:58:28.411956+0000","last_fullsized":"2024-04-14T09:58:28.411956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411293+0000","last_change":"2024-04-14T09:58:27.669278+0000","last_active":"2024-04-14T09:58:28.411293+0000","last_peered":"2024-04-14T09:58:28.411293+0000","last_clean":"2024-04-14T09:58:28.411293+0000","last_became_active":"2024-04-14T09:58:27.668928+0000","last_became_peered":"2024-04-14T09:58:27.668928+0000","last_unstale":"2024-04-14T09:58:28.411293+0000","last_undegraded":"2024-04-14T09:58:28.411293+0000","last_fullsized":"2024-04-14T09:58:28.411293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:59.301538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412073+0000","last_change":"2024-04-14T09:58:22.396110+0000","last_active":"2024-04-14T09:58:28.412073+0000","last_peered":"2024-04-14T09:58:28.412073+0000","last_clean":"2024-04-14T09:58:28.412073+0000","last_became_active":"2024-04-14T09:58:22.395818+0000","last_became_peered":"2024-04-14T09:58:22.395818+0000","last_unstale":"2024-04-14T09:58:28.412073+0000","last_undegraded":"2024-04-14T09:58:28.412073+0000","last_fullsized":"2024-04-14T09:58:28.412073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:02:50.002691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718273+0000","last_change":"2024-04-14T09:58:23.405100+0000","last_active":"2024-04-14T09:58:28.718273+0000","last_peered":"2024-04-14T09:58:28.718273+0000","last_clean":"2024-04-14T09:58:28.718273+0000","last_became_active":"2024-04-14T09:58:23.404837+0000","last_became_peered":"2024-04-14T09:58:23.404837+0000","last_unstale":"2024-04-14T09:58:28.718273+0000","last_undegraded":"2024-04-14T09:58:28.718273+0000","last_fullsized":"2024-04-14T09:58:28.718273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:53.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411717+0000","last_change":"2024-04-14T09:58:27.431626+0000","last_active":"2024-04-14T09:58:28.411717+0000","last_peered":"2024-04-14T09:58:28.411717+0000","last_clean":"2024-04-14T09:58:28.411717+0000","last_became_active":"2024-04-14T09:58:27.431160+0000","last_became_peered":"2024-04-14T09:58:27.431160+0000","last_unstale":"2024-04-14T09:58:28.411717+0000","last_undegraded":"2024-04-14T09:58:28.411717+0000","last_fullsized":"2024-04-14T09:58:28.411717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:01.933626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719419+0000","last_change":"2024-04-14T09:58:22.396291+0000","last_active":"2024-04-14T09:58:28.719419+0000","last_peered":"2024-04-14T09:58:28.719419+0000","last_clean":"2024-04-14T09:58:28.719419+0000","last_became_active":"2024-04-14T09:58:22.396071+0000","last_became_peered":"2024-04-14T09:58:22.396071+0000","last_unstale":"2024-04-14T09:58:28.719419+0000","last_undegraded":"2024-04-14T09:58:28.719419+0000","last_fullsized":"2024-04-14T09:58:28.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717868+0000","last_change":"2024-04-14T09:58:23.397574+0000","last_active":"2024-04-14T09:58:28.717868+0000","last_peered":"2024-04-14T09:58:28.717868+0000","last_clean":"2024-04-14T09:58:28.717868+0000","last_became_active":"2024-04-14T09:58:23.397261+0000","last_became_peered":"2024-04-14T09:58:23.397261+0000","last_unstale":"2024-04-14T09:58:28.717868+0000","last_undegraded":"2024-04-14T09:58:28.717868+0000","last_fullsized":"2024-04-14T09:58:28.717868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412409+0000","last_change":"2024-04-14T09:58:27.427865+0000","last_active":"2024-04-14T09:58:28.412409+0000","last_peered":"2024-04-14T09:58:28.412409+0000","last_clean":"2024-04-14T09:58:28.412409+0000","last_became_active":"2024-04-14T09:58:27.427483+0000","last_became_peered":"2024-04-14T09:58:27.427483+0000","last_unstale":"2024-04-14T09:58:28.412409+0000","last_undegraded":"2024-04-14T09:58:28.412409+0000","last_fullsized":"2024-04-14T09:58:28.412409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718852+0000","last_change":"2024-04-14T09:58:22.394942+0000","last_active":"2024-04-14T09:58:28.718852+0000","last_peered":"2024-04-14T09:58:28.718852+0000","last_clean":"2024-04-14T09:58:28.718852+0000","last_became_active":"2024-04-14T09:58:22.394679+0000","last_became_peered":"2024-04-14T09:58:22.394679+0000","last_unstale":"2024-04-14T09:58:28.718852+0000","last_undegraded":"2024-04-14T09:58:28.718852+0000","last_fullsized":"2024-04-14T09:58:28.718852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:33.668503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718216+0000","last_change":"2024-04-14T09:58:23.402824+0000","last_active":"2024-04-14T09:58:28.718216+0000","last_peered":"2024-04-14T09:58:28.718216+0000","last_clean":"2024-04-14T09:58:28.718216+0000","last_became_active":"2024-04-14T09:58:23.402246+0000","last_became_peered":"2024-04-14T09:58:23.402246+0000","last_unstale":"2024-04-14T09:58:28.718216+0000","last_undegraded":"2024-04-14T09:58:28.718216+0000","last_fullsized":"2024-04-14T09:58:28.718216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411885+0000","last_change":"2024-04-14T09:58:27.423837+0000","last_active":"2024-04-14T09:58:28.411885+0000","last_peered":"2024-04-14T09:58:28.411885+0000","last_clean":"2024-04-14T09:58:28.411885+0000","last_became_active":"2024-04-14T09:58:27.423439+0000","last_became_peered":"2024-04-14T09:58:27.423439+0000","last_unstale":"2024-04-14T09:58:28.411885+0000","last_undegraded":"2024-04-14T09:58:28.411885+0000","last_fullsized":"2024-04-14T09:58:28.411885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:48.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718018+0000","last_change":"2024-04-14T09:58:23.404740+0000","last_active":"2024-04-14T09:58:28.718018+0000","last_peered":"2024-04-14T09:58:28.718018+0000","last_clean":"2024-04-14T09:58:28.718018+0000","last_became_active":"2024-04-14T09:58:23.404362+0000","last_became_peered":"2024-04-14T09:58:23.404362+0000","last_unstale":"2024-04-14T09:58:28.718018+0000","last_undegraded":"2024-04-14T09:58:28.718018+0000","last_fullsized":"2024-04-14T09:58:28.718018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719028+0000","last_change":"2024-04-14T09:58:22.391425+0000","last_active":"2024-04-14T09:58:28.719028+0000","last_peered":"2024-04-14T09:58:28.719028+0000","last_clean":"2024-04-14T09:58:28.719028+0000","last_became_active":"2024-04-14T09:58:22.391062+0000","last_became_peered":"2024-04-14T09:58:22.391062+0000","last_unstale":"2024-04-14T09:58:28.719028+0000","last_undegraded":"2024-04-14T09:58:28.719028+0000","last_fullsized":"2024-04-14T09:58:28.719028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:45.817473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412039+0000","last_change":"2024-04-14T09:58:27.431221+0000","last_active":"2024-04-14T09:58:28.412039+0000","last_peered":"2024-04-14T09:58:28.412039+0000","last_clean":"2024-04-14T09:58:28.412039+0000","last_became_active":"2024-04-14T09:58:27.430764+0000","last_became_peered":"2024-04-14T09:58:27.430764+0000","last_unstale":"2024-04-14T09:58:28.412039+0000","last_undegraded":"2024-04-14T09:58:28.412039+0000","last_fullsized":"2024-04-14T09:58:28.412039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411673+0000","last_change":"2024-04-14T09:58:23.403246+0000","last_active":"2024-04-14T09:58:28.411673+0000","last_peered":"2024-04-14T09:58:28.411673+0000","last_clean":"2024-04-14T09:58:28.411673+0000","last_became_active":"2024-04-14T09:58:23.402610+0000","last_became_peered":"2024-04-14T09:58:23.402610+0000","last_unstale":"2024-04-14T09:58:28.411673+0000","last_undegraded":"2024-04-14T09:58:28.411673+0000","last_fullsized":"2024-04-14T09:58:28.411673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718903+0000","last_change":"2024-04-14T09:58:22.395168+0000","last_active":"2024-04-14T09:58:28.718903+0000","last_peered":"2024-04-14T09:58:28.718903+0000","last_clean":"2024-04-14T09:58:28.718903+0000","last_became_active":"2024-04-14T09:58:22.394913+0000","last_became_peered":"2024-04-14T09:58:22.394913+0000","last_unstale":"2024-04-14T09:58:28.718903+0000","last_undegraded":"2024-04-14T09:58:28.718903+0000","last_fullsized":"2024-04-14T09:58:28.718903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412208+0000","last_change":"2024-04-14T09:58:27.431150+0000","last_active":"2024-04-14T09:58:28.412208+0000","last_peered":"2024-04-14T09:58:28.412208+0000","last_clean":"2024-04-14T09:58:28.412208+0000","last_became_active":"2024-04-14T09:58:27.430727+0000","last_became_peered":"2024-04-14T09:58:27.430727+0000","last_unstale":"2024-04-14T09:58:28.412208+0000","last_undegraded":"2024-04-14T09:58:28.412208+0000","last_fullsized":"2024-04-14T09:58:28.412208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411542+0000","last_change":"2024-04-14T09:58:23.396679+0000","last_active":"2024-04-14T09:58:28.411542+0000","last_peered":"2024-04-14T09:58:28.411542+0000","last_clean":"2024-04-14T09:58:28.411542+0000","last_became_active":"2024-04-14T09:58:23.396401+0000","last_became_peered":"2024-04-14T09:58:23.396401+0000","last_unstale":"2024-04-14T09:58:28.411542+0000","last_undegraded":"2024-04-14T09:58:28.411542+0000","last_fullsized":"2024-04-14T09:58:28.411542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718109+0000","last_change":"2024-04-14T09:58:22.390340+0000","last_active":"2024-04-14T09:58:28.718109+0000","last_peered":"2024-04-14T09:58:28.718109+0000","last_clean":"2024-04-14T09:58:28.718109+0000","last_became_active":"2024-04-14T09:58:22.390062+0000","last_became_peered":"2024-04-14T09:58:22.390062+0000","last_unstale":"2024-04-14T09:58:28.718109+0000","last_undegraded":"2024-04-14T09:58:28.718109+0000","last_fullsized":"2024-04-14T09:58:28.718109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718409+0000","last_change":"2024-04-14T09:58:27.667944+0000","last_active":"2024-04-14T09:58:28.718409+0000","last_peered":"2024-04-14T09:58:28.718409+0000","last_clean":"2024-04-14T09:58:28.718409+0000","last_became_active":"2024-04-14T09:58:27.667524+0000","last_became_peered":"2024-04-14T09:58:27.667524+0000","last_unstale":"2024-04-14T09:58:28.718409+0000","last_undegraded":"2024-04-14T09:58:28.718409+0000","last_fullsized":"2024-04-14T09:58:28.718409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412175+0000","last_change":"2024-04-14T09:58:23.396159+0000","last_active":"2024-04-14T09:58:28.412175+0000","last_peered":"2024-04-14T09:58:28.412175+0000","last_clean":"2024-04-14T09:58:28.412175+0000","last_became_active":"2024-04-14T09:58:23.395832+0000","last_became_peered":"2024-04-14T09:58:23.395832+0000","last_unstale":"2024-04-14T09:58:28.412175+0000","last_undegraded":"2024-04-14T09:58:28.412175+0000","last_fullsized":"2024-04-14T09:58:28.412175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:07.911238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718345+0000","last_change":"2024-04-14T09:58:22.398706+0000","last_active":"2024-04-14T09:58:28.718345+0000","last_peered":"2024-04-14T09:58:28.718345+0000","last_clean":"2024-04-14T09:58:28.718345+0000","last_became_active":"2024-04-14T09:58:22.398161+0000","last_became_peered":"2024-04-14T09:58:22.398161+0000","last_unstale":"2024-04-14T09:58:28.718345+0000","last_undegraded":"2024-04-14T09:58:28.718345+0000","last_fullsized":"2024-04-14T09:58:28.718345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411920+0000","last_change":"2024-04-14T09:58:27.427979+0000","last_active":"2024-04-14T09:58:28.411920+0000","last_peered":"2024-04-14T09:58:28.411920+0000","last_clean":"2024-04-14T09:58:28.411920+0000","last_became_active":"2024-04-14T09:58:27.427612+0000","last_became_peered":"2024-04-14T09:58:27.427612+0000","last_unstale":"2024-04-14T09:58:28.411920+0000","last_undegraded":"2024-04-14T09:58:28.411920+0000","last_fullsized":"2024-04-14T09:58:28.411920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:10.049805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719106+0000","last_change":"2024-04-14T09:58:23.403433+0000","last_active":"2024-04-14T09:58:28.719106+0000","last_peered":"2024-04-14T09:58:28.719106+0000","last_clean":"2024-04-14T09:58:28.719106+0000","last_became_active":"2024-04-14T09:58:23.402914+0000","last_became_peered":"2024-04-14T09:58:23.402914+0000","last_unstale":"2024-04-14T09:58:28.719106+0000","last_undegraded":"2024-04-14T09:58:28.719106+0000","last_fullsized":"2024-04-14T09:58:28.719106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719347+0000","last_change":"2024-04-14T09:58:22.390638+0000","last_active":"2024-04-14T09:58:28.719347+0000","last_peered":"2024-04-14T09:58:28.719347+0000","last_clean":"2024-04-14T09:58:28.719347+0000","last_became_active":"2024-04-14T09:58:22.390011+0000","last_became_peered":"2024-04-14T09:58:22.390011+0000","last_unstale":"2024-04-14T09:58:28.719347+0000","last_undegraded":"2024-04-14T09:58:28.719347+0000","last_fullsized":"2024-04-14T09:58:28.719347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411864+0000","last_change":"2024-04-14T09:58:27.669279+0000","last_active":"2024-04-14T09:58:28.411864+0000","last_peered":"2024-04-14T09:58:28.411864+0000","last_clean":"2024-04-14T09:58:28.411864+0000","last_became_active":"2024-04-14T09:58:27.668902+0000","last_became_peered":"2024-04-14T09:58:27.668902+0000","last_unstale":"2024-04-14T09:58:28.411864+0000","last_undegraded":"2024-04-14T09:58:28.411864+0000","last_fullsized":"2024-04-14T09:58:28.411864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:35.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412231+0000","last_change":"2024-04-14T09:58:23.406160+0000","last_active":"2024-04-14T09:58:28.412231+0000","last_peered":"2024-04-14T09:58:28.412231+0000","last_clean":"2024-04-14T09:58:28.412231+0000","last_became_active":"2024-04-14T09:58:23.405890+0000","last_became_peered":"2024-04-14T09:58:23.405890+0000","last_unstale":"2024-04-14T09:58:28.412231+0000","last_undegraded":"2024-04-14T09:58:28.412231+0000","last_fullsized":"2024-04-14T09:58:28.412231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719543+0000","last_change":"2024-04-14T09:58:22.395184+0000","last_active":"2024-04-14T09:58:28.719543+0000","last_peered":"2024-04-14T09:58:28.719543+0000","last_clean":"2024-04-14T09:58:28.719543+0000","last_became_active":"2024-04-14T09:58:22.394873+0000","last_became_peered":"2024-04-14T09:58:22.394873+0000","last_unstale":"2024-04-14T09:58:28.719543+0000","last_undegraded":"2024-04-14T09:58:28.719543+0000","last_fullsized":"2024-04-14T09:58:28.719543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411231+0000","last_change":"2024-04-14T09:58:27.669744+0000","last_active":"2024-04-14T09:58:28.411231+0000","last_peered":"2024-04-14T09:58:28.411231+0000","last_clean":"2024-04-14T09:58:28.411231+0000","last_became_active":"2024-04-14T09:58:27.668513+0000","last_became_peered":"2024-04-14T09:58:27.668513+0000","last_unstale":"2024-04-14T09:58:28.411231+0000","last_undegraded":"2024-04-14T09:58:28.411231+0000","last_fullsized":"2024-04-14T09:58:28.411231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:15.700051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719218+0000","last_change":"2024-04-14T09:58:23.394968+0000","last_active":"2024-04-14T09:58:28.719218+0000","last_peered":"2024-04-14T09:58:28.719218+0000","last_clean":"2024-04-14T09:58:28.719218+0000","last_became_active":"2024-04-14T09:58:23.394596+0000","last_became_peered":"2024-04-14T09:58:23.394596+0000","last_unstale":"2024-04-14T09:58:28.719218+0000","last_undegraded":"2024-04-14T09:58:28.719218+0000","last_fullsized":"2024-04-14T09:58:28.719218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719510+0000","last_change":"2024-04-14T09:58:22.398406+0000","last_active":"2024-04-14T09:58:28.719510+0000","last_peered":"2024-04-14T09:58:28.719510+0000","last_clean":"2024-04-14T09:58:28.719510+0000","last_became_active":"2024-04-14T09:58:22.398116+0000","last_became_peered":"2024-04-14T09:58:22.398116+0000","last_unstale":"2024-04-14T09:58:28.719510+0000","last_undegraded":"2024-04-14T09:58:28.719510+0000","last_fullsized":"2024-04-14T09:58:28.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:16.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718418+0000","last_change":"2024-04-14T09:58:27.668504+0000","last_active":"2024-04-14T09:58:28.718418+0000","last_peered":"2024-04-14T09:58:28.718418+0000","last_clean":"2024-04-14T09:58:28.718418+0000","last_became_active":"2024-04-14T09:58:27.667630+0000","last_became_peered":"2024-04-14T09:58:27.667630+0000","last_unstale":"2024-04-14T09:58:28.718418+0000","last_undegraded":"2024-04-14T09:58:28.718418+0000","last_fullsized":"2024-04-14T09:58:28.718418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718268+0000","last_change":"2024-04-14T09:58:23.404467+0000","last_active":"2024-04-14T09:58:28.718268+0000","last_peered":"2024-04-14T09:58:28.718268+0000","last_clean":"2024-04-14T09:58:28.718268+0000","last_became_active":"2024-04-14T09:58:23.403864+0000","last_became_peered":"2024-04-14T09:58:23.403864+0000","last_unstale":"2024-04-14T09:58:28.718268+0000","last_undegraded":"2024-04-14T09:58:28.718268+0000","last_fullsized":"2024-04-14T09:58:28.718268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719289+0000","last_change":"2024-04-14T09:58:22.398987+0000","last_active":"2024-04-14T09:58:28.719289+0000","last_peered":"2024-04-14T09:58:28.719289+0000","last_clean":"2024-04-14T09:58:28.719289+0000","last_became_active":"2024-04-14T09:58:22.398682+0000","last_became_peered":"2024-04-14T09:58:22.398682+0000","last_unstale":"2024-04-14T09:58:28.719289+0000","last_undegraded":"2024-04-14T09:58:28.719289+0000","last_fullsized":"2024-04-14T09:58:28.719289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718473+0000","last_change":"2024-04-14T09:58:27.431798+0000","last_active":"2024-04-14T09:58:28.718473+0000","last_peered":"2024-04-14T09:58:28.718473+0000","last_clean":"2024-04-14T09:58:28.718473+0000","last_became_active":"2024-04-14T09:58:27.431417+0000","last_became_peered":"2024-04-14T09:58:27.431417+0000","last_unstale":"2024-04-14T09:58:28.718473+0000","last_undegraded":"2024-04-14T09:58:28.718473+0000","last_fullsized":"2024-04-14T09:58:28.718473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412488+0000","last_change":"2024-04-14T09:58:23.400432+0000","last_active":"2024-04-14T09:58:28.412488+0000","last_peered":"2024-04-14T09:58:28.412488+0000","last_clean":"2024-04-14T09:58:28.412488+0000","last_became_active":"2024-04-14T09:58:23.400175+0000","last_became_peered":"2024-04-14T09:58:23.400175+0000","last_unstale":"2024-04-14T09:58:28.412488+0000","last_undegraded":"2024-04-14T09:58:28.412488+0000","last_fullsized":"2024-04-14T09:58:28.412488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718166+0000","last_change":"2024-04-14T09:58:22.385714+0000","last_active":"2024-04-14T09:58:28.718166+0000","last_peered":"2024-04-14T09:58:28.718166+0000","last_clean":"2024-04-14T09:58:28.718166+0000","last_became_active":"2024-04-14T09:58:22.385337+0000","last_became_peered":"2024-04-14T09:58:22.385337+0000","last_unstale":"2024-04-14T09:58:28.718166+0000","last_undegraded":"2024-04-14T09:58:28.718166+0000","last_fullsized":"2024-04-14T09:58:28.718166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719243+0000","last_change":"2024-04-14T09:58:27.436131+0000","last_active":"2024-04-14T09:58:28.719243+0000","last_peered":"2024-04-14T09:58:28.719243+0000","last_clean":"2024-04-14T09:58:28.719243+0000","last_became_active":"2024-04-14T09:58:27.435730+0000","last_became_peered":"2024-04-14T09:58:27.435730+0000","last_unstale":"2024-04-14T09:58:28.719243+0000","last_undegraded":"2024-04-14T09:58:28.719243+0000","last_fullsized":"2024-04-14T09:58:28.719243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717989+0000","last_change":"2024-04-14T09:58:23.395456+0000","last_active":"2024-04-14T09:58:28.717989+0000","last_peered":"2024-04-14T09:58:28.717989+0000","last_clean":"2024-04-14T09:58:28.717989+0000","last_became_active":"2024-04-14T09:58:23.394235+0000","last_became_peered":"2024-04-14T09:58:23.394235+0000","last_unstale":"2024-04-14T09:58:28.717989+0000","last_undegraded":"2024-04-14T09:58:28.717989+0000","last_fullsized":"2024-04-14T09:58:28.717989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718058+0000","last_change":"2024-04-14T09:58:22.394128+0000","last_active":"2024-04-14T09:58:28.718058+0000","last_peered":"2024-04-14T09:58:28.718058+0000","last_clean":"2024-04-14T09:58:28.718058+0000","last_became_active":"2024-04-14T09:58:22.393765+0000","last_became_peered":"2024-04-14T09:58:22.393765+0000","last_unstale":"2024-04-14T09:58:28.718058+0000","last_undegraded":"2024-04-14T09:58:28.718058+0000","last_fullsized":"2024-04-14T09:58:28.718058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718551+0000","last_change":"2024-04-14T09:58:27.435923+0000","last_active":"2024-04-14T09:58:28.718551+0000","last_peered":"2024-04-14T09:58:28.718551+0000","last_clean":"2024-04-14T09:58:28.718551+0000","last_became_active":"2024-04-14T09:58:27.435542+0000","last_became_peered":"2024-04-14T09:58:27.435542+0000","last_unstale":"2024-04-14T09:58:28.718551+0000","last_undegraded":"2024-04-14T09:58:28.718551+0000","last_fullsized":"2024-04-14T09:58:28.718551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718022+0000","last_change":"2024-04-14T09:58:23.397634+0000","last_active":"2024-04-14T09:58:28.718022+0000","last_peered":"2024-04-14T09:58:28.718022+0000","last_clean":"2024-04-14T09:58:28.718022+0000","last_became_active":"2024-04-14T09:58:23.397351+0000","last_became_peered":"2024-04-14T09:58:23.397351+0000","last_unstale":"2024-04-14T09:58:28.718022+0000","last_undegraded":"2024-04-14T09:58:28.718022+0000","last_fullsized":"2024-04-14T09:58:28.718022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:17.852536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718440+0000","last_change":"2024-04-14T09:58:22.391011+0000","last_active":"2024-04-14T09:58:28.718440+0000","last_peered":"2024-04-14T09:58:28.718440+0000","last_clean":"2024-04-14T09:58:28.718440+0000","last_became_active":"2024-04-14T09:58:22.389916+0000","last_became_peered":"2024-04-14T09:58:22.389916+0000","last_unstale":"2024-04-14T09:58:28.718440+0000","last_undegraded":"2024-04-14T09:58:28.718440+0000","last_fullsized":"2024-04-14T09:58:28.718440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719004+0000","last_change":"2024-04-14T09:58:27.668355+0000","last_active":"2024-04-14T09:58:28.719004+0000","last_peered":"2024-04-14T09:58:28.719004+0000","last_clean":"2024-04-14T09:58:28.719004+0000","last_became_active":"2024-04-14T09:58:27.667937+0000","last_became_peered":"2024-04-14T09:58:27.667937+0000","last_unstale":"2024-04-14T09:58:28.719004+0000","last_undegraded":"2024-04-14T09:58:28.719004+0000","last_fullsized":"2024-04-14T09:58:28.719004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411503+0000","last_change":"2024-04-14T09:58:23.402580+0000","last_active":"2024-04-14T09:58:28.411503+0000","last_peered":"2024-04-14T09:58:28.411503+0000","last_clean":"2024-04-14T09:58:28.411503+0000","last_became_active":"2024-04-14T09:58:23.401893+0000","last_became_peered":"2024-04-14T09:58:23.401893+0000","last_unstale":"2024-04-14T09:58:28.411503+0000","last_undegraded":"2024-04-14T09:58:28.411503+0000","last_fullsized":"2024-04-14T09:58:28.411503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717978+0000","last_change":"2024-04-14T09:58:22.384644+0000","last_active":"2024-04-14T09:58:28.717978+0000","last_peered":"2024-04-14T09:58:28.717978+0000","last_clean":"2024-04-14T09:58:28.717978+0000","last_became_active":"2024-04-14T09:58:22.384367+0000","last_became_peered":"2024-04-14T09:58:22.384367+0000","last_unstale":"2024-04-14T09:58:28.717978+0000","last_undegraded":"2024-04-14T09:58:28.717978+0000","last_fullsized":"2024-04-14T09:58:28.717978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718493+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:58:28.718493+0000","last_peered":"2024-04-14T09:58:28.718493+0000","last_clean":"2024-04-14T09:58:28.718493+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:58:28.718493+0000","last_undegraded":"2024-04-14T09:58:28.718493+0000","last_fullsized":"2024-04-14T09:58:28.718493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717982+0000","last_change":"2024-04-14T09:58:27.668840+0000","last_active":"2024-04-14T09:58:28.717982+0000","last_peered":"2024-04-14T09:58:28.717982+0000","last_clean":"2024-04-14T09:58:28.717982+0000","last_became_active":"2024-04-14T09:58:27.668471+0000","last_became_peered":"2024-04-14T09:58:27.668471+0000","last_unstale":"2024-04-14T09:58:28.717982+0000","last_undegraded":"2024-04-14T09:58:28.717982+0000","last_fullsized":"2024-04-14T09:58:28.717982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719240+0000","last_change":"2024-04-14T09:58:23.409162+0000","last_active":"2024-04-14T09:58:28.719240+0000","last_peered":"2024-04-14T09:58:28.719240+0000","last_clean":"2024-04-14T09:58:28.719240+0000","last_became_active":"2024-04-14T09:58:23.408850+0000","last_became_peered":"2024-04-14T09:58:23.408850+0000","last_unstale":"2024-04-14T09:58:28.719240+0000","last_undegraded":"2024-04-14T09:58:28.719240+0000","last_fullsized":"2024-04-14T09:58:28.719240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:22.384829+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:22.383935+0000","last_became_peered":"2024-04-14T09:58:22.383935+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717969+0000","last_change":"2024-04-14T09:58:27.667909+0000","last_active":"2024-04-14T09:58:28.717969+0000","last_peered":"2024-04-14T09:58:28.717969+0000","last_clean":"2024-04-14T09:58:28.717969+0000","last_became_active":"2024-04-14T09:58:27.667550+0000","last_became_peered":"2024-04-14T09:58:27.667550+0000","last_unstale":"2024-04-14T09:58:28.717969+0000","last_undegraded":"2024-04-14T09:58:28.717969+0000","last_fullsized":"2024-04-14T09:58:28.717969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717961+0000","last_change":"2024-04-14T09:58:23.408028+0000","last_active":"2024-04-14T09:58:28.717961+0000","last_peered":"2024-04-14T09:58:28.717961+0000","last_clean":"2024-04-14T09:58:28.717961+0000","last_became_active":"2024-04-14T09:58:23.407386+0000","last_became_peered":"2024-04-14T09:58:23.407386+0000","last_unstale":"2024-04-14T09:58:28.717961+0000","last_undegraded":"2024-04-14T09:58:28.717961+0000","last_fullsized":"2024-04-14T09:58:28.717961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719337+0000","last_change":"2024-04-14T09:58:22.390083+0000","last_active":"2024-04-14T09:58:28.719337+0000","last_peered":"2024-04-14T09:58:28.719337+0000","last_clean":"2024-04-14T09:58:28.719337+0000","last_became_active":"2024-04-14T09:58:22.389814+0000","last_became_peered":"2024-04-14T09:58:22.389814+0000","last_unstale":"2024-04-14T09:58:28.719337+0000","last_undegraded":"2024-04-14T09:58:28.719337+0000","last_fullsized":"2024-04-14T09:58:28.719337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718671+0000","last_change":"2024-04-14T09:58:27.428137+0000","last_active":"2024-04-14T09:58:28.718671+0000","last_peered":"2024-04-14T09:58:28.718671+0000","last_clean":"2024-04-14T09:58:28.718671+0000","last_became_active":"2024-04-14T09:58:27.427703+0000","last_became_peered":"2024-04-14T09:58:27.427703+0000","last_unstale":"2024-04-14T09:58:28.718671+0000","last_undegraded":"2024-04-14T09:58:28.718671+0000","last_fullsized":"2024-04-14T09:58:28.718671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719613+0000","last_change":"2024-04-14T09:58:23.404910+0000","last_active":"2024-04-14T09:58:28.719613+0000","last_peered":"2024-04-14T09:58:28.719613+0000","last_clean":"2024-04-14T09:58:28.719613+0000","last_became_active":"2024-04-14T09:58:23.404674+0000","last_became_peered":"2024-04-14T09:58:23.404674+0000","last_unstale":"2024-04-14T09:58:28.719613+0000","last_undegraded":"2024-04-14T09:58:28.719613+0000","last_fullsized":"2024-04-14T09:58:28.719613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:55.269064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718569+0000","last_change":"2024-04-14T09:58:22.394100+0000","last_active":"2024-04-14T09:58:28.718569+0000","last_peered":"2024-04-14T09:58:28.718569+0000","last_clean":"2024-04-14T09:58:28.718569+0000","last_became_active":"2024-04-14T09:58:22.393802+0000","last_became_peered":"2024-04-14T09:58:22.393802+0000","last_unstale":"2024-04-14T09:58:28.718569+0000","last_undegraded":"2024-04-14T09:58:28.718569+0000","last_fullsized":"2024-04-14T09:58:28.718569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717532+0000","last_change":"2024-04-14T09:58:27.667932+0000","last_active":"2024-04-14T09:58:28.717532+0000","last_peered":"2024-04-14T09:58:28.717532+0000","last_clean":"2024-04-14T09:58:28.717532+0000","last_became_active":"2024-04-14T09:58:27.667573+0000","last_became_peered":"2024-04-14T09:58:27.667573+0000","last_unstale":"2024-04-14T09:58:28.717532+0000","last_undegraded":"2024-04-14T09:58:28.717532+0000","last_fullsized":"2024-04-14T09:58:28.717532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719102+0000","last_change":"2024-04-14T09:58:23.404327+0000","last_active":"2024-04-14T09:58:28.719102+0000","last_peered":"2024-04-14T09:58:28.719102+0000","last_clean":"2024-04-14T09:58:28.719102+0000","last_became_active":"2024-04-14T09:58:23.403839+0000","last_became_peered":"2024-04-14T09:58:23.403839+0000","last_unstale":"2024-04-14T09:58:28.719102+0000","last_undegraded":"2024-04-14T09:58:28.719102+0000","last_fullsized":"2024-04-14T09:58:28.719102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412068+0000","last_change":"2024-04-14T09:58:22.399651+0000","last_active":"2024-04-14T09:58:28.412068+0000","last_peered":"2024-04-14T09:58:28.412068+0000","last_clean":"2024-04-14T09:58:28.412068+0000","last_became_active":"2024-04-14T09:58:22.399360+0000","last_became_peered":"2024-04-14T09:58:22.399360+0000","last_unstale":"2024-04-14T09:58:28.412068+0000","last_undegraded":"2024-04-14T09:58:28.412068+0000","last_fullsized":"2024-04-14T09:58:28.412068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411723+0000","last_change":"2024-04-14T09:58:27.428173+0000","last_active":"2024-04-14T09:58:28.411723+0000","last_peered":"2024-04-14T09:58:28.411723+0000","last_clean":"2024-04-14T09:58:28.411723+0000","last_became_active":"2024-04-14T09:58:27.427578+0000","last_became_peered":"2024-04-14T09:58:27.427578+0000","last_unstale":"2024-04-14T09:58:28.411723+0000","last_undegraded":"2024-04-14T09:58:28.411723+0000","last_fullsized":"2024-04-14T09:58:28.411723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:22.952495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718706+0000","last_change":"2024-04-14T09:58:23.401131+0000","last_active":"2024-04-14T09:58:28.718706+0000","last_peered":"2024-04-14T09:58:28.718706+0000","last_clean":"2024-04-14T09:58:28.718706+0000","last_became_active":"2024-04-14T09:58:23.400782+0000","last_became_peered":"2024-04-14T09:58:23.400782+0000","last_unstale":"2024-04-14T09:58:28.718706+0000","last_undegraded":"2024-04-14T09:58:28.718706+0000","last_fullsized":"2024-04-14T09:58:28.718706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718236+0000","last_change":"2024-04-14T09:58:22.384480+0000","last_active":"2024-04-14T09:58:28.718236+0000","last_peered":"2024-04-14T09:58:28.718236+0000","last_clean":"2024-04-14T09:58:28.718236+0000","last_became_active":"2024-04-14T09:58:22.384218+0000","last_became_peered":"2024-04-14T09:58:22.384218+0000","last_unstale":"2024-04-14T09:58:28.718236+0000","last_undegraded":"2024-04-14T09:58:28.718236+0000","last_fullsized":"2024-04-14T09:58:28.718236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:27.426500+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:27.426031+0000","last_became_peered":"2024-04-14T09:58:27.426031+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718325+0000","last_change":"2024-04-14T09:58:23.405791+0000","last_active":"2024-04-14T09:58:28.718325+0000","last_peered":"2024-04-14T09:58:28.718325+0000","last_clean":"2024-04-14T09:58:28.718325+0000","last_became_active":"2024-04-14T09:58:23.405500+0000","last_became_peered":"2024-04-14T09:58:23.405500+0000","last_unstale":"2024-04-14T09:58:28.718325+0000","last_undegraded":"2024-04-14T09:58:28.718325+0000","last_fullsized":"2024-04-14T09:58:28.718325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718933+0000","last_change":"2024-04-14T09:58:22.390322+0000","last_active":"2024-04-14T09:58:28.718933+0000","last_peered":"2024-04-14T09:58:28.718933+0000","last_clean":"2024-04-14T09:58:28.718933+0000","last_became_active":"2024-04-14T09:58:22.390024+0000","last_became_peered":"2024-04-14T09:58:22.390024+0000","last_unstale":"2024-04-14T09:58:28.718933+0000","last_undegraded":"2024-04-14T09:58:28.718933+0000","last_fullsized":"2024-04-14T09:58:28.718933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412180+0000","last_change":"2024-04-14T09:58:27.670485+0000","last_active":"2024-04-14T09:58:28.412180+0000","last_peered":"2024-04-14T09:58:28.412180+0000","last_clean":"2024-04-14T09:58:28.412180+0000","last_became_active":"2024-04-14T09:58:27.670080+0000","last_became_peered":"2024-04-14T09:58:27.670080+0000","last_unstale":"2024-04-14T09:58:28.412180+0000","last_undegraded":"2024-04-14T09:58:28.412180+0000","last_fullsized":"2024-04-14T09:58:28.412180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:09.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:23.404680+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:23.404418+0000","last_became_peered":"2024-04-14T09:58:23.404418+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718090+0000","last_change":"2024-04-14T09:58:22.393671+0000","last_active":"2024-04-14T09:58:28.718090+0000","last_peered":"2024-04-14T09:58:28.718090+0000","last_clean":"2024-04-14T09:58:28.718090+0000","last_became_active":"2024-04-14T09:58:22.393431+0000","last_became_peered":"2024-04-14T09:58:22.393431+0000","last_unstale":"2024-04-14T09:58:28.718090+0000","last_undegraded":"2024-04-14T09:58:28.718090+0000","last_fullsized":"2024-04-14T09:58:28.718090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412086+0000","last_change":"2024-04-14T09:58:27.668347+0000","last_active":"2024-04-14T09:58:28.412086+0000","last_peered":"2024-04-14T09:58:28.412086+0000","last_clean":"2024-04-14T09:58:28.412086+0000","last_became_active":"2024-04-14T09:58:27.667469+0000","last_became_peered":"2024-04-14T09:58:27.667469+0000","last_unstale":"2024-04-14T09:58:28.412086+0000","last_undegraded":"2024-04-14T09:58:28.412086+0000","last_fullsized":"2024-04-14T09:58:28.412086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718924+0000","last_change":"2024-04-14T09:58:23.408574+0000","last_active":"2024-04-14T09:58:28.718924+0000","last_peered":"2024-04-14T09:58:28.718924+0000","last_clean":"2024-04-14T09:58:28.718924+0000","last_became_active":"2024-04-14T09:58:23.408295+0000","last_became_peered":"2024-04-14T09:58:23.408295+0000","last_unstale":"2024-04-14T09:58:28.718924+0000","last_undegraded":"2024-04-14T09:58:28.718924+0000","last_fullsized":"2024-04-14T09:58:28.718924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718923+0000","last_change":"2024-04-14T09:58:22.398210+0000","last_active":"2024-04-14T09:58:28.718923+0000","last_peered":"2024-04-14T09:58:28.718923+0000","last_clean":"2024-04-14T09:58:28.718923+0000","last_became_active":"2024-04-14T09:58:22.397939+0000","last_became_peered":"2024-04-14T09:58:22.397939+0000","last_unstale":"2024-04-14T09:58:28.718923+0000","last_undegraded":"2024-04-14T09:58:28.718923+0000","last_fullsized":"2024-04-14T09:58:28.718923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:32:05.174642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718300+0000","last_change":"2024-04-14T09:58:27.668858+0000","last_active":"2024-04-14T09:58:28.718300+0000","last_peered":"2024-04-14T09:58:28.718300+0000","last_clean":"2024-04-14T09:58:28.718300+0000","last_became_active":"2024-04-14T09:58:27.668509+0000","last_became_peered":"2024-04-14T09:58:27.668509+0000","last_unstale":"2024-04-14T09:58:28.718300+0000","last_undegraded":"2024-04-14T09:58:28.718300+0000","last_fullsized":"2024-04-14T09:58:28.718300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719155+0000","last_change":"2024-04-14T09:58:23.403359+0000","last_active":"2024-04-14T09:58:28.719155+0000","last_peered":"2024-04-14T09:58:28.719155+0000","last_clean":"2024-04-14T09:58:28.719155+0000","last_became_active":"2024-04-14T09:58:23.403105+0000","last_became_peered":"2024-04-14T09:58:23.403105+0000","last_unstale":"2024-04-14T09:58:28.719155+0000","last_undegraded":"2024-04-14T09:58:28.719155+0000","last_fullsized":"2024-04-14T09:58:28.719155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:32.895716+0000","last_change":"2024-04-14T09:58:22.393783+0000","last_active":"2024-04-14T09:58:32.895716+0000","last_peered":"2024-04-14T09:58:32.895716+0000","last_clean":"2024-04-14T09:58:32.895716+0000","last_became_active":"2024-04-14T09:58:22.393497+0000","last_became_peered":"2024-04-14T09:58:22.393497+0000","last_unstale":"2024-04-14T09:58:32.895716+0000","last_undegraded":"2024-04-14T09:58:32.895716+0000","last_fullsized":"2024-04-14T09:58:32.895716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718743+0000","last_change":"2024-04-14T09:58:27.435279+0000","last_active":"2024-04-14T09:58:28.718743+0000","last_peered":"2024-04-14T09:58:28.718743+0000","last_clean":"2024-04-14T09:58:28.718743+0000","last_became_active":"2024-04-14T09:58:27.434860+0000","last_became_peered":"2024-04-14T09:58:27.434860+0000","last_unstale":"2024-04-14T09:58:28.718743+0000","last_undegraded":"2024-04-14T09:58:28.718743+0000","last_fullsized":"2024-04-14T09:58:28.718743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412292+0000","last_change":"2024-04-14T09:58:23.406709+0000","last_active":"2024-04-14T09:58:28.412292+0000","last_peered":"2024-04-14T09:58:28.412292+0000","last_clean":"2024-04-14T09:58:28.412292+0000","last_became_active":"2024-04-14T09:58:23.406119+0000","last_became_peered":"2024-04-14T09:58:23.406119+0000","last_unstale":"2024-04-14T09:58:28.412292+0000","last_undegraded":"2024-04-14T09:58:28.412292+0000","last_fullsized":"2024-04-14T09:58:28.412292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:34.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719263+0000","last_change":"2024-04-14T09:58:22.383968+0000","last_active":"2024-04-14T09:58:28.719263+0000","last_peered":"2024-04-14T09:58:28.719263+0000","last_clean":"2024-04-14T09:58:28.719263+0000","last_became_active":"2024-04-14T09:58:22.383573+0000","last_became_peered":"2024-04-14T09:58:22.383573+0000","last_unstale":"2024-04-14T09:58:28.719263+0000","last_undegraded":"2024-04-14T09:58:28.719263+0000","last_fullsized":"2024-04-14T09:58:28.719263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412330+0000","last_change":"2024-04-14T09:58:27.428066+0000","last_active":"2024-04-14T09:58:28.412330+0000","last_peered":"2024-04-14T09:58:28.412330+0000","last_clean":"2024-04-14T09:58:28.412330+0000","last_became_active":"2024-04-14T09:58:27.427579+0000","last_became_peered":"2024-04-14T09:58:27.427579+0000","last_unstale":"2024-04-14T09:58:28.412330+0000","last_undegraded":"2024-04-14T09:58:28.412330+0000","last_fullsized":"2024-04-14T09:58:28.412330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718449+0000","last_change":"2024-04-14T09:58:23.404342+0000","last_active":"2024-04-14T09:58:28.718449+0000","last_peered":"2024-04-14T09:58:28.718449+0000","last_clean":"2024-04-14T09:58:28.718449+0000","last_became_active":"2024-04-14T09:58:23.403726+0000","last_became_peered":"2024-04-14T09:58:23.403726+0000","last_unstale":"2024-04-14T09:58:28.718449+0000","last_undegraded":"2024-04-14T09:58:28.718449+0000","last_fullsized":"2024-04-14T09:58:28.718449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718147+0000","last_change":"2024-04-14T09:58:22.392609+0000","last_active":"2024-04-14T09:58:28.718147+0000","last_peered":"2024-04-14T09:58:28.718147+0000","last_clean":"2024-04-14T09:58:28.718147+0000","last_became_active":"2024-04-14T09:58:22.392332+0000","last_became_peered":"2024-04-14T09:58:22.392332+0000","last_unstale":"2024-04-14T09:58:28.718147+0000","last_undegraded":"2024-04-14T09:58:28.718147+0000","last_fullsized":"2024-04-14T09:58:28.718147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411427+0000","last_change":"2024-04-14T09:58:27.434042+0000","last_active":"2024-04-14T09:58:28.411427+0000","last_peered":"2024-04-14T09:58:28.411427+0000","last_clean":"2024-04-14T09:58:28.411427+0000","last_became_active":"2024-04-14T09:58:27.433635+0000","last_became_peered":"2024-04-14T09:58:27.433635+0000","last_unstale":"2024-04-14T09:58:28.411427+0000","last_undegraded":"2024-04-14T09:58:28.411427+0000","last_fullsized":"2024-04-14T09:58:28.411427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:25.171487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717663+0000","last_change":"2024-04-14T09:58:23.410881+0000","last_active":"2024-04-14T09:58:28.717663+0000","last_peered":"2024-04-14T09:58:28.717663+0000","last_clean":"2024-04-14T09:58:28.717663+0000","last_became_active":"2024-04-14T09:58:23.410383+0000","last_became_peered":"2024-04-14T09:58:23.410383+0000","last_unstale":"2024-04-14T09:58:28.717663+0000","last_undegraded":"2024-04-14T09:58:28.717663+0000","last_fullsized":"2024-04-14T09:58:28.717663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719207+0000","last_change":"2024-04-14T09:58:22.392621+0000","last_active":"2024-04-14T09:58:28.719207+0000","last_peered":"2024-04-14T09:58:28.719207+0000","last_clean":"2024-04-14T09:58:28.719207+0000","last_became_active":"2024-04-14T09:58:22.390883+0000","last_became_peered":"2024-04-14T09:58:22.390883+0000","last_unstale":"2024-04-14T09:58:28.719207+0000","last_undegraded":"2024-04-14T09:58:28.719207+0000","last_fullsized":"2024-04-14T09:58:28.719207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411485+0000","last_change":"2024-04-14T09:58:27.668298+0000","last_active":"2024-04-14T09:58:28.411485+0000","last_peered":"2024-04-14T09:58:28.411485+0000","last_clean":"2024-04-14T09:58:28.411485+0000","last_became_active":"2024-04-14T09:58:27.667944+0000","last_became_peered":"2024-04-14T09:58:27.667944+0000","last_unstale":"2024-04-14T09:58:28.411485+0000","last_undegraded":"2024-04-14T09:58:28.411485+0000","last_fullsized":"2024-04-14T09:58:28.411485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718701+0000","last_change":"2024-04-14T09:58:27.669462+0000","last_active":"2024-04-14T09:58:28.718701+0000","last_peered":"2024-04-14T09:58:28.718701+0000","last_clean":"2024-04-14T09:58:28.718701+0000","last_became_active":"2024-04-14T09:58:27.669027+0000","last_became_peered":"2024-04-14T09:58:27.669027+0000","last_unstale":"2024-04-14T09:58:28.718701+0000","last_undegraded":"2024-04-14T09:58:28.718701+0000","last_fullsized":"2024-04-14T09:58:28.718701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717917+0000","last_change":"2024-04-14T09:58:23.398529+0000","last_active":"2024-04-14T09:58:28.717917+0000","last_peered":"2024-04-14T09:58:28.717917+0000","last_clean":"2024-04-14T09:58:28.717917+0000","last_became_active":"2024-04-14T09:58:23.397726+0000","last_became_peered":"2024-04-14T09:58:23.397726+0000","last_unstale":"2024-04-14T09:58:28.717917+0000","last_undegraded":"2024-04-14T09:58:28.717917+0000","last_fullsized":"2024-04-14T09:58:28.717917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717881+0000","last_change":"2024-04-14T09:58:22.384888+0000","last_active":"2024-04-14T09:58:28.717881+0000","last_peered":"2024-04-14T09:58:28.717881+0000","last_clean":"2024-04-14T09:58:28.717881+0000","last_became_active":"2024-04-14T09:58:22.383944+0000","last_became_peered":"2024-04-14T09:58:22.383944+0000","last_unstale":"2024-04-14T09:58:28.717881+0000","last_undegraded":"2024-04-14T09:58:28.717881+0000","last_fullsized":"2024-04-14T09:58:28.717881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719260+0000","last_change":"2024-04-14T09:58:27.429696+0000","last_active":"2024-04-14T09:58:28.719260+0000","last_peered":"2024-04-14T09:58:28.719260+0000","last_clean":"2024-04-14T09:58:28.719260+0000","last_became_active":"2024-04-14T09:58:27.429288+0000","last_became_peered":"2024-04-14T09:58:27.429288+0000","last_unstale":"2024-04-14T09:58:28.719260+0000","last_undegraded":"2024-04-14T09:58:28.719260+0000","last_fullsized":"2024-04-14T09:58:28.719260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411313+0000","last_change":"2024-04-14T09:58:23.400094+0000","last_active":"2024-04-14T09:58:28.411313+0000","last_peered":"2024-04-14T09:58:28.411313+0000","last_clean":"2024-04-14T09:58:28.411313+0000","last_became_active":"2024-04-14T09:58:23.399785+0000","last_became_peered":"2024-04-14T09:58:23.399785+0000","last_unstale":"2024-04-14T09:58:28.411313+0000","last_undegraded":"2024-04-14T09:58:28.411313+0000","last_fullsized":"2024-04-14T09:58:28.411313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411504+0000","last_change":"2024-04-14T09:58:22.397732+0000","last_active":"2024-04-14T09:58:28.411504+0000","last_peered":"2024-04-14T09:58:28.411504+0000","last_clean":"2024-04-14T09:58:28.411504+0000","last_became_active":"2024-04-14T09:58:22.397449+0000","last_became_peered":"2024-04-14T09:58:22.397449+0000","last_unstale":"2024-04-14T09:58:28.411504+0000","last_undegraded":"2024-04-14T09:58:28.411504+0000","last_fullsized":"2024-04-14T09:58:28.411504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718183+0000","last_change":"2024-04-14T09:58:22.393706+0000","last_active":"2024-04-14T09:58:28.718183+0000","last_peered":"2024-04-14T09:58:28.718183+0000","last_clean":"2024-04-14T09:58:28.718183+0000","last_became_active":"2024-04-14T09:58:22.393405+0000","last_became_peered":"2024-04-14T09:58:22.393405+0000","last_unstale":"2024-04-14T09:58:28.718183+0000","last_undegraded":"2024-04-14T09:58:28.718183+0000","last_fullsized":"2024-04-14T09:58:28.718183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:23.402551+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:23.402184+0000","last_became_peered":"2024-04-14T09:58:23.402184+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717894+0000","last_change":"2024-04-14T09:58:27.432957+0000","last_active":"2024-04-14T09:58:28.717894+0000","last_peered":"2024-04-14T09:58:28.717894+0000","last_clean":"2024-04-14T09:58:28.717894+0000","last_became_active":"2024-04-14T09:58:27.432530+0000","last_became_peered":"2024-04-14T09:58:27.432530+0000","last_unstale":"2024-04-14T09:58:28.717894+0000","last_undegraded":"2024-04-14T09:58:28.717894+0000","last_fullsized":"2024-04-14T09:58:28.717894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:57.757589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411784+0000","last_change":"2024-04-14T09:58:22.391395+0000","last_active":"2024-04-14T09:58:28.411784+0000","last_peered":"2024-04-14T09:58:28.411784+0000","last_clean":"2024-04-14T09:58:28.411784+0000","last_became_active":"2024-04-14T09:58:22.391132+0000","last_became_peered":"2024-04-14T09:58:22.391132+0000","last_unstale":"2024-04-14T09:58:28.411784+0000","last_undegraded":"2024-04-14T09:58:28.411784+0000","last_fullsized":"2024-04-14T09:58:28.411784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:45.950958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411949+0000","last_change":"2024-04-14T09:58:23.396095+0000","last_active":"2024-04-14T09:58:28.411949+0000","last_peered":"2024-04-14T09:58:28.411949+0000","last_clean":"2024-04-14T09:58:28.411949+0000","last_became_active":"2024-04-14T09:58:23.395823+0000","last_became_peered":"2024-04-14T09:58:23.395823+0000","last_unstale":"2024-04-14T09:58:28.411949+0000","last_undegraded":"2024-04-14T09:58:28.411949+0000","last_fullsized":"2024-04-14T09:58:28.411949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:06.520353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412451+0000","last_change":"2024-04-14T09:58:27.432961+0000","last_active":"2024-04-14T09:58:28.412451+0000","last_peered":"2024-04-14T09:58:28.412451+0000","last_clean":"2024-04-14T09:58:28.412451+0000","last_became_active":"2024-04-14T09:58:27.432561+0000","last_became_peered":"2024-04-14T09:58:27.432561+0000","last_unstale":"2024-04-14T09:58:28.412451+0000","last_undegraded":"2024-04-14T09:58:28.412451+0000","last_fullsized":"2024-04-14T09:58:28.412451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:05.795116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718199+0000","last_change":"2024-04-14T09:58:23.407620+0000","last_active":"2024-04-14T09:58:28.718199+0000","last_peered":"2024-04-14T09:58:28.718199+0000","last_clean":"2024-04-14T09:58:28.718199+0000","last_became_active":"2024-04-14T09:58:23.407229+0000","last_became_peered":"2024-04-14T09:58:23.407229+0000","last_unstale":"2024-04-14T09:58:28.718199+0000","last_undegraded":"2024-04-14T09:58:28.718199+0000","last_fullsized":"2024-04-14T09:58:28.718199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717968+0000","last_change":"2024-04-14T09:58:23.401653+0000","last_active":"2024-04-14T09:58:28.717968+0000","last_peered":"2024-04-14T09:58:28.717968+0000","last_clean":"2024-04-14T09:58:28.717968+0000","last_became_active":"2024-04-14T09:58:23.401364+0000","last_became_peered":"2024-04-14T09:58:23.401364+0000","last_unstale":"2024-04-14T09:58:28.717968+0000","last_undegraded":"2024-04-14T09:58:28.717968+0000","last_fullsized":"2024-04-14T09:58:28.717968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718067+0000","last_change":"2024-04-14T09:58:23.408171+0000","last_active":"2024-04-14T09:58:28.718067+0000","last_peered":"2024-04-14T09:58:28.718067+0000","last_clean":"2024-04-14T09:58:28.718067+0000","last_became_active":"2024-04-14T09:58:23.407239+0000","last_became_peered":"2024-04-14T09:58:23.407239+0000","last_unstale":"2024-04-14T09:58:28.718067+0000","last_undegraded":"2024-04-14T09:58:28.718067+0000","last_fullsized":"2024-04-14T09:58:28.718067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718730+0000","last_change":"2024-04-14T09:58:23.404101+0000","last_active":"2024-04-14T09:58:28.718730+0000","last_peered":"2024-04-14T09:58:28.718730+0000","last_clean":"2024-04-14T09:58:28.718730+0000","last_became_active":"2024-04-14T09:58:23.403370+0000","last_became_peered":"2024-04-14T09:58:23.403370+0000","last_unstale":"2024-04-14T09:58:28.718730+0000","last_undegraded":"2024-04-14T09:58:28.718730+0000","last_fullsized":"2024-04-14T09:58:28.718730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:17:06.376909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412345+0000","last_change":"2024-04-14T09:58:23.404808+0000","last_active":"2024-04-14T09:58:28.412345+0000","last_peered":"2024-04-14T09:58:28.412345+0000","last_clean":"2024-04-14T09:58:28.412345+0000","last_became_active":"2024-04-14T09:58:23.404405+0000","last_became_peered":"2024-04-14T09:58:23.404405+0000","last_unstale":"2024-04-14T09:58:28.412345+0000","last_undegraded":"2024-04-14T09:58:28.412345+0000","last_fullsized":"2024-04-14T09:58:28.412345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719094+0000","last_change":"2024-04-14T09:58:23.404182+0000","last_active":"2024-04-14T09:58:28.719094+0000","last_peered":"2024-04-14T09:58:28.719094+0000","last_clean":"2024-04-14T09:58:28.719094+0000","last_became_active":"2024-04-14T09:58:23.403910+0000","last_became_peered":"2024-04-14T09:58:23.403910+0000","last_unstale":"2024-04-14T09:58:28.719094+0000","last_undegraded":"2024-04-14T09:58:28.719094+0000","last_fullsized":"2024-04-14T09:58:28.719094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719413+0000","last_change":"2024-04-14T09:58:23.408207+0000","last_active":"2024-04-14T09:58:28.719413+0000","last_peered":"2024-04-14T09:58:28.719413+0000","last_clean":"2024-04-14T09:58:28.719413+0000","last_became_active":"2024-04-14T09:58:23.406767+0000","last_became_peered":"2024-04-14T09:58:23.406767+0000","last_unstale":"2024-04-14T09:58:28.719413+0000","last_undegraded":"2024-04-14T09:58:28.719413+0000","last_fullsized":"2024-04-14T09:58:28.719413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412204+0000","last_change":"2024-04-14T09:58:23.406514+0000","last_active":"2024-04-14T09:58:28.412204+0000","last_peered":"2024-04-14T09:58:28.412204+0000","last_clean":"2024-04-14T09:58:28.412204+0000","last_became_active":"2024-04-14T09:58:23.405465+0000","last_became_peered":"2024-04-14T09:58:23.405465+0000","last_unstale":"2024-04-14T09:58:28.412204+0000","last_undegraded":"2024-04-14T09:58:28.412204+0000","last_fullsized":"2024-04-14T09:58:28.412204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717813+0000","last_change":"2024-04-14T09:58:23.406224+0000","last_active":"2024-04-14T09:58:28.717813+0000","last_peered":"2024-04-14T09:58:28.717813+0000","last_clean":"2024-04-14T09:58:28.717813+0000","last_became_active":"2024-04-14T09:58:23.405960+0000","last_became_peered":"2024-04-14T09:58:23.405960+0000","last_unstale":"2024-04-14T09:58:28.717813+0000","last_undegraded":"2024-04-14T09:58:28.717813+0000","last_fullsized":"2024-04-14T09:58:28.717813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411302+0000","last_change":"2024-04-14T09:58:23.397512+0000","last_active":"2024-04-14T09:58:28.411302+0000","last_peered":"2024-04-14T09:58:28.411302+0000","last_clean":"2024-04-14T09:58:28.411302+0000","last_became_active":"2024-04-14T09:58:23.397243+0000","last_became_peered":"2024-04-14T09:58:23.397243+0000","last_unstale":"2024-04-14T09:58:28.411302+0000","last_undegraded":"2024-04-14T09:58:28.411302+0000","last_fullsized":"2024-04-14T09:58:28.411302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718006+0000","last_change":"2024-04-14T09:58:23.397450+0000","last_active":"2024-04-14T09:58:28.718006+0000","last_peered":"2024-04-14T09:58:28.718006+0000","last_clean":"2024-04-14T09:58:28.718006+0000","last_became_active":"2024-04-14T09:58:23.397165+0000","last_became_peered":"2024-04-14T09:58:23.397165+0000","last_unstale":"2024-04-14T09:58:28.718006+0000","last_undegraded":"2024-04-14T09:58:28.718006+0000","last_fullsized":"2024-04-14T09:58:28.718006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718469+0000","last_change":"2024-04-14T09:58:23.407381+0000","last_active":"2024-04-14T09:58:28.718469+0000","last_peered":"2024-04-14T09:58:28.718469+0000","last_clean":"2024-04-14T09:58:28.718469+0000","last_became_active":"2024-04-14T09:58:23.407118+0000","last_became_peered":"2024-04-14T09:58:23.407118+0000","last_unstale":"2024-04-14T09:58:28.718469+0000","last_undegraded":"2024-04-14T09:58:28.718469+0000","last_fullsized":"2024-04-14T09:58:28.718469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718613+0000","last_change":"2024-04-14T09:58:23.404570+0000","last_active":"2024-04-14T09:58:28.718613+0000","last_peered":"2024-04-14T09:58:28.718613+0000","last_clean":"2024-04-14T09:58:28.718613+0000","last_became_active":"2024-04-14T09:58:23.404262+0000","last_became_peered":"2024-04-14T09:58:23.404262+0000","last_unstale":"2024-04-14T09:58:28.718613+0000","last_undegraded":"2024-04-14T09:58:28.718613+0000","last_fullsized":"2024-04-14T09:58:28.718613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719427+0000","last_change":"2024-04-14T09:58:23.404295+0000","last_active":"2024-04-14T09:58:28.719427+0000","last_peered":"2024-04-14T09:58:28.719427+0000","last_clean":"2024-04-14T09:58:28.719427+0000","last_became_active":"2024-04-14T09:58:23.404005+0000","last_became_peered":"2024-04-14T09:58:23.404005+0000","last_unstale":"2024-04-14T09:58:28.719427+0000","last_undegraded":"2024-04-14T09:58:28.719427+0000","last_fullsized":"2024-04-14T09:58:28.719427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718467+0000","last_change":"2024-04-14T09:58:23.407616+0000","last_active":"2024-04-14T09:58:28.718467+0000","last_peered":"2024-04-14T09:58:28.718467+0000","last_clean":"2024-04-14T09:58:28.718467+0000","last_became_active":"2024-04-14T09:58:23.407260+0000","last_became_peered":"2024-04-14T09:58:23.407260+0000","last_unstale":"2024-04-14T09:58:28.718467+0000","last_undegraded":"2024-04-14T09:58:28.718467+0000","last_fullsized":"2024-04-14T09:58:28.718467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718039+0000","last_change":"2024-04-14T09:58:23.410650+0000","last_active":"2024-04-14T09:58:28.718039+0000","last_peered":"2024-04-14T09:58:28.718039+0000","last_clean":"2024-04-14T09:58:28.718039+0000","last_became_active":"2024-04-14T09:58:23.410379+0000","last_became_peered":"2024-04-14T09:58:23.410379+0000","last_unstale":"2024-04-14T09:58:28.718039+0000","last_undegraded":"2024-04-14T09:58:28.718039+0000","last_fullsized":"2024-04-14T09:58:28.718039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717749+0000","last_change":"2024-04-14T09:58:23.398466+0000","last_active":"2024-04-14T09:58:28.717749+0000","last_peered":"2024-04-14T09:58:28.717749+0000","last_clean":"2024-04-14T09:58:28.717749+0000","last_became_active":"2024-04-14T09:58:23.398189+0000","last_became_peered":"2024-04-14T09:58:23.398189+0000","last_unstale":"2024-04-14T09:58:28.717749+0000","last_undegraded":"2024-04-14T09:58:28.717749+0000","last_fullsized":"2024-04-14T09:58:28.717749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718017+0000","last_change":"2024-04-14T09:58:23.393259+0000","last_active":"2024-04-14T09:58:28.718017+0000","last_peered":"2024-04-14T09:58:28.718017+0000","last_clean":"2024-04-14T09:58:28.718017+0000","last_became_active":"2024-04-14T09:58:23.392971+0000","last_became_peered":"2024-04-14T09:58:23.392971+0000","last_unstale":"2024-04-14T09:58:28.718017+0000","last_undegraded":"2024-04-14T09:58:28.718017+0000","last_fullsized":"2024-04-14T09:58:28.718017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718832+0000","last_change":"2024-04-14T09:58:23.398828+0000","last_active":"2024-04-14T09:58:28.718832+0000","last_peered":"2024-04-14T09:58:28.718832+0000","last_clean":"2024-04-14T09:58:28.718832+0000","last_became_active":"2024-04-14T09:58:23.398386+0000","last_became_peered":"2024-04-14T09:58:23.398386+0000","last_unstale":"2024-04-14T09:58:28.718832+0000","last_undegraded":"2024-04-14T09:58:28.718832+0000","last_fullsized":"2024-04-14T09:58:28.718832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411945+0000","last_change":"2024-04-14T09:58:23.407691+0000","last_active":"2024-04-14T09:58:28.411945+0000","last_peered":"2024-04-14T09:58:28.411945+0000","last_clean":"2024-04-14T09:58:28.411945+0000","last_became_active":"2024-04-14T09:58:23.407271+0000","last_became_peered":"2024-04-14T09:58:23.407271+0000","last_unstale":"2024-04-14T09:58:28.411945+0000","last_undegraded":"2024-04-14T09:58:28.411945+0000","last_fullsized":"2024-04-14T09:58:28.411945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412261+0000","last_change":"2024-04-14T09:58:23.405452+0000","last_active":"2024-04-14T09:58:28.412261+0000","last_peered":"2024-04-14T09:58:28.412261+0000","last_clean":"2024-04-14T09:58:28.412261+0000","last_became_active":"2024-04-14T09:58:23.404804+0000","last_became_peered":"2024-04-14T09:58:23.404804+0000","last_unstale":"2024-04-14T09:58:28.412261+0000","last_undegraded":"2024-04-14T09:58:28.412261+0000","last_fullsized":"2024-04-14T09:58:28.412261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718106+0000","last_change":"2024-04-14T09:58:23.413350+0000","last_active":"2024-04-14T09:58:28.718106+0000","last_peered":"2024-04-14T09:58:28.718106+0000","last_clean":"2024-04-14T09:58:28.718106+0000","last_became_active":"2024-04-14T09:58:23.413030+0000","last_became_peered":"2024-04-14T09:58:23.413030+0000","last_unstale":"2024-04-14T09:58:28.718106+0000","last_undegraded":"2024-04-14T09:58:28.718106+0000","last_fullsized":"2024-04-14T09:58:28.718106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719331+0000","last_change":"2024-04-14T09:58:23.411335+0000","last_active":"2024-04-14T09:58:28.719331+0000","last_peered":"2024-04-14T09:58:28.719331+0000","last_clean":"2024-04-14T09:58:28.719331+0000","last_became_active":"2024-04-14T09:58:23.409283+0000","last_became_peered":"2024-04-14T09:58:23.409283+0000","last_unstale":"2024-04-14T09:58:28.719331+0000","last_undegraded":"2024-04-14T09:58:28.719331+0000","last_fullsized":"2024-04-14T09:58:28.719331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719533+0000","last_change":"2024-04-14T09:58:23.408154+0000","last_active":"2024-04-14T09:58:28.719533+0000","last_peered":"2024-04-14T09:58:28.719533+0000","last_clean":"2024-04-14T09:58:28.719533+0000","last_became_active":"2024-04-14T09:58:23.407848+0000","last_became_peered":"2024-04-14T09:58:23.407848+0000","last_unstale":"2024-04-14T09:58:28.719533+0000","last_undegraded":"2024-04-14T09:58:28.719533+0000","last_fullsized":"2024-04-14T09:58:28.719533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411189+0000","last_change":"2024-04-14T09:58:23.399466+0000","last_active":"2024-04-14T09:58:28.411189+0000","last_peered":"2024-04-14T09:58:28.411189+0000","last_clean":"2024-04-14T09:58:28.411189+0000","last_became_active":"2024-04-14T09:58:23.399192+0000","last_became_peered":"2024-04-14T09:58:23.399192+0000","last_unstale":"2024-04-14T09:58:28.411189+0000","last_undegraded":"2024-04-14T09:58:28.411189+0000","last_fullsized":"2024-04-14T09:58:28.411189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718615+0000","last_change":"2024-04-14T09:58:23.402089+0000","last_active":"2024-04-14T09:58:28.718615+0000","last_peered":"2024-04-14T09:58:28.718615+0000","last_clean":"2024-04-14T09:58:28.718615+0000","last_became_active":"2024-04-14T09:58:23.401791+0000","last_became_peered":"2024-04-14T09:58:23.401791+0000","last_unstale":"2024-04-14T09:58:28.718615+0000","last_undegraded":"2024-04-14T09:58:28.718615+0000","last_fullsized":"2024-04-14T09:58:28.718615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717901+0000","last_change":"2024-04-14T09:58:23.400405+0000","last_active":"2024-04-14T09:58:28.717901+0000","last_peered":"2024-04-14T09:58:28.717901+0000","last_clean":"2024-04-14T09:58:28.717901+0000","last_became_active":"2024-04-14T09:58:23.400094+0000","last_became_peered":"2024-04-14T09:58:23.400094+0000","last_unstale":"2024-04-14T09:58:28.717901+0000","last_undegraded":"2024-04-14T09:58:28.717901+0000","last_fullsized":"2024-04-14T09:58:28.717901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718700+0000","last_change":"2024-04-14T09:58:23.401268+0000","last_active":"2024-04-14T09:58:28.718700+0000","last_peered":"2024-04-14T09:58:28.718700+0000","last_clean":"2024-04-14T09:58:28.718700+0000","last_became_active":"2024-04-14T09:58:23.400978+0000","last_became_peered":"2024-04-14T09:58:23.400978+0000","last_unstale":"2024-04-14T09:58:28.718700+0000","last_undegraded":"2024-04-14T09:58:28.718700+0000","last_fullsized":"2024-04-14T09:58:28.718700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717724+0000","last_change":"2024-04-14T09:58:23.410361+0000","last_active":"2024-04-14T09:58:28.717724+0000","last_peered":"2024-04-14T09:58:28.717724+0000","last_clean":"2024-04-14T09:58:28.717724+0000","last_became_active":"2024-04-14T09:58:23.407726+0000","last_became_peered":"2024-04-14T09:58:23.407726+0000","last_unstale":"2024-04-14T09:58:28.717724+0000","last_undegraded":"2024-04-14T09:58:28.717724+0000","last_fullsized":"2024-04-14T09:58:28.717724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719465+0000","last_change":"2024-04-14T09:58:23.402602+0000","last_active":"2024-04-14T09:58:28.719465+0000","last_peered":"2024-04-14T09:58:28.719465+0000","last_clean":"2024-04-14T09:58:28.719465+0000","last_became_active":"2024-04-14T09:58:23.402243+0000","last_became_peered":"2024-04-14T09:58:23.402243+0000","last_unstale":"2024-04-14T09:58:28.719465+0000","last_undegraded":"2024-04-14T09:58:28.719465+0000","last_fullsized":"2024-04-14T09:58:28.719465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:37.707556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719506+0000","last_change":"2024-04-14T09:58:23.399802+0000","last_active":"2024-04-14T09:58:28.719506+0000","last_peered":"2024-04-14T09:58:28.719506+0000","last_clean":"2024-04-14T09:58:28.719506+0000","last_became_active":"2024-04-14T09:58:23.399467+0000","last_became_peered":"2024-04-14T09:58:23.399467+0000","last_unstale":"2024-04-14T09:58:28.719506+0000","last_undegraded":"2024-04-14T09:58:28.719506+0000","last_fullsized":"2024-04-14T09:58:28.719506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719375+0000","last_change":"2024-04-14T09:58:23.406066+0000","last_active":"2024-04-14T09:58:28.719375+0000","last_peered":"2024-04-14T09:58:28.719375+0000","last_clean":"2024-04-14T09:58:28.719375+0000","last_became_active":"2024-04-14T09:58:23.405739+0000","last_became_peered":"2024-04-14T09:58:23.405739+0000","last_unstale":"2024-04-14T09:58:28.719375+0000","last_undegraded":"2024-04-14T09:58:28.719375+0000","last_fullsized":"2024-04-14T09:58:28.719375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:58:46.831 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T09:58:46.831 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-14T09:58:46.832 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-14T09:58:46.832 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-14T09:58:46.832 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-14T09:58:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.969+0000 7f3e79d1e640 1 Processor -- start 2024-04-14T09:58:46.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.969+0000 7f3e79d1e640 1 -- start start 2024-04-14T09:58:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e79d1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e7415e370 0x7f3e740d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e79d1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7406c760 con 0x7f3e7406d800 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e79d1e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7406ca40 con 0x7f3e7409b150 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e79d1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7406d370 con 0x7f3e7415e370 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e737fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3e7415e370 0x7f3e740d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e72ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3e7406d800 0x7f3e7409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40850/0 (socket says 172.21.15.40:40850) 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.970+0000 7f3e72ffd640 1 -- 172.21.15.40:0/3552123373 learned_addr learned my addr 172.21.15.40:0/3552123373 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.971+0000 7f3e737fe640 1 -- 172.21.15.40:0/3552123373 >> v1:172.21.15.136:6789/0 conn(0x7f3e7409b150 legacy=0x7f3e74168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.971+0000 7f3e727fc640 1 -- 172.21.15.40:0/3552123373 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566607083 0 0) 0x7f3e7406ca40 con 0x7f3e7409b150 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.971+0000 7f3e737fe640 1 -- 172.21.15.40:0/3552123373 >> v1:172.21.15.40:6789/0 conn(0x7f3e7406d800 legacy=0x7f3e7409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.971+0000 7f3e737fe640 1 -- 172.21.15.40:0/3552123373 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7406cd20 con 0x7f3e7415e370 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.971+0000 7f3e737fe640 1 --2- 172.21.15.40:0/3552123373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740d0db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e640097a0 tx=0x7f3e6402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e71024338d349089 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e727fc640 1 -- 172.21.15.40:0/3552123373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64037070 con 0x7f3e7415e370 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e727fc640 1 -- 172.21.15.40:0/3552123373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e64030710 con 0x7f3e7415e370 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e727fc640 1 -- 172.21.15.40:0/3552123373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64030ae0 con 0x7f3e7415e370 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 -- 172.21.15.40:0/3552123373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 msgr2=0x7f3e740d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/3552123373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740d0db0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3e640097a0 tx=0x7f3e6402b790 comp rx=0 tx=0).stop 2024-04-14T09:58:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 -- 172.21.15.40:0/3552123373 shutdown_connections 2024-04-14T09:58:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/3552123373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740d0db0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 -- 172.21.15.40:0/3552123373 >> 172.21.15.40:0/3552123373 conn(0x7f3e740b3ba0 msgr2=0x7f3e740b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 -- 172.21.15.40:0/3552123373 shutdown_connections 2024-04-14T09:58:46.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.972+0000 7f3e79d1e640 1 -- 172.21.15.40:0/3552123373 wait complete. 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.973+0000 7f3e79d1e640 1 Processor -- start 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 -- start start 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e7406d800 0x7f3e741553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7409b150 0x7f3e740b7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7415e8d0 con 0x7f3e7415e370 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7415e750 con 0x7f3e7406d800 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e79d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e740d12f0 con 0x7f3e7409b150 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54814/0 (socket says 172.21.15.40:54814) 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e73fff640 1 -- 172.21.15.40:0/903048329 learned_addr learned my addr 172.21.15.40:0/903048329 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e737fe640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e7406d800 0x7f3e741553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.974+0000 7f3e72ffd640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7409b150 0x7f3e740b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 -- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7409b150 msgr2=0x7f3e740b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7409b150 0x7f3e740b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 -- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e7406d800 msgr2=0x7f3e741553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e7406d800 0x7f3e741553d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:46.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 -- 172.21.15.40:0/903048329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e74161120 con 0x7f3e7415e370 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e73fff640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c790 tx=0x7f3e6c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c003da0 con 0x7f3e7415e370 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c005070 con 0x7f3e7415e370 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e74161400 con 0x7f3e7415e370 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c005460 con 0x7f3e7415e370 2024-04-14T09:58:46.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.975+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e74155910 con 0x7f3e7415e370 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.976+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e740756f0 con 0x7f3e7415e370 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.977+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e6c005600 con 0x7f3e7415e370 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.977+0000 7f3e5bfff640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 0x7f3e6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.977+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e6c08bc20 con 0x7f3e7415e370 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.977+0000 7f3e737fe640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 0x7f3e6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:46.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.978+0000 7f3e737fe640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 0x7f3e6006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e6402f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:46.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:46.981+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3e6c059750 con 0x7f3e7415e370 2024-04-14T09:58:47.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.216+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f3e740b3670 con 0x7f3e7415e370 2024-04-14T09:58:47.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.219+0000 7f3e5bfff640 1 -- 172.21.15.40:0/903048329 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174143 (secure 0 0 0) 0x7f3e6c05da50 con 0x7f3e7415e370 2024-04-14T09:58:47.221 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:47.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 msgr2=0x7f3e6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 0x7f3e6006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3e64034000 tx=0x7f3e6402f000 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 msgr2=0x7f3e740c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c790 tx=0x7f3e6c00cc50 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 shutdown_connections 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e6006c8f0 0x7f3e6006edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e7415e370 0x7f3e740c6c30 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7409b150 0x7f3e740b7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 --2- 172.21.15.40:0/903048329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e7406d800 0x7f3e741553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 >> 172.21.15.40:0/903048329 conn(0x7f3e740b3ba0 msgr2=0x7f3e7409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 shutdown_connections 2024-04-14T09:58:47.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.222+0000 7f3e79d1e640 1 -- 172.21.15.40:0/903048329 wait complete. 2024-04-14T09:58:47.232 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":5,"flags":0,"active_gid":4114,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":2043813119},{"type":"v1","addr":"172.21.15.136:6833","nonce":2043813119}]},"active_addr":"172.21.15.136:6833/2043813119","active_change":"2024-04-14T09:58:02.794493+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1485686086}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":288547601}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":1594056944}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.136:0","nonce":4050514892}]}]} 2024-04-14T09:58:47.235 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-14T09:58:47.236 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-14T09:58:47.236 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:47.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.337+0000 7fdf5d1c8640 1 Processor -- start 2024-04-14T09:58:47.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.337+0000 7fdf5d1c8640 1 -- start start 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5d1c8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf5815e2b0 0x7fdf5815e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5d1c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf580b1bc0 0x7fdf580b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5d1c8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5815ed10 con 0x7fdf581584a0 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5d1c8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdf5815acc0 con 0x7fdf5815e2b0 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5d1c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdf5815eff0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf5815e2b0 0x7fdf5815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdf5815e2b0 0x7fdf5815e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54820/0 (socket says 172.21.15.40:54820) 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.338+0000 7fdf5659c640 1 -- 172.21.15.40:0/3910080263 learned_addr learned my addr 172.21.15.40:0/3910080263 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5759e640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf580b1bc0 0x7fdf580b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5659c640 1 -- 172.21.15.40:0/3910080263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf580b1bc0 msgr2=0x7fdf580b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf580b1bc0 0x7fdf580b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5659c640 1 -- 172.21.15.40:0/3910080263 >> v1:172.21.15.136:6789/0 conn(0x7fdf581584a0 legacy=0x7fdf5815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5659c640 1 -- 172.21.15.40:0/3910080263 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5815af10 con 0x7fdf5815e2b0 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.339+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf5815e2b0 0x7fdf5815e710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb036f58b0fc3c48 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf55d9b640 1 -- 172.21.15.40:0/3910080263 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c035020 con 0x7fdf5815e2b0 2024-04-14T09:58:47.340 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf55d9b640 1 -- 172.21.15.40:0/3910080263 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf4c031640 con 0x7fdf5815e2b0 2024-04-14T09:58:47.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf55d9b640 1 -- 172.21.15.40:0/3910080263 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c02d040 con 0x7fdf5815e2b0 2024-04-14T09:58:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3910080263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf5815e2b0 msgr2=0x7fdf5815e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf5815e2b0 0x7fdf5815e710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c009870 tx=0x7fdf4c02b8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3910080263 shutdown_connections 2024-04-14T09:58:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf580b1bc0 0x7fdf580b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3910080263 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf5815e2b0 0x7fdf5815e710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3910080263 >> 172.21.15.40:0/3910080263 conn(0x7fdf5806ebf0 msgr2=0x7fdf5806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3910080263 shutdown_connections 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.340+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3910080263 wait complete. 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 Processor -- start 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 -- start start 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 0x7fdf5815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf5815e2b0 0x7fdf581f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdf580b4a80 con 0x7fdf580b1bc0 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5806bc30 con 0x7fdf581584a0 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf5d1c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdf58156950 con 0x7fdf5815e2b0 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf56d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf56d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54832/0 (socket says 172.21.15.40:54832) 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.342+0000 7fdf56d9d640 1 -- 172.21.15.40:0/3432699852 learned_addr learned my addr 172.21.15.40:0/3432699852 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf5759e640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf5815e2b0 0x7fdf581f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 0x7fdf5815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 -- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf5815e2b0 msgr2=0x7fdf581f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf5815e2b0 0x7fdf581f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 -- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 msgr2=0x7fdf5815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 0x7fdf5815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 -- 172.21.15.40:0/3432699852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf58156b80 con 0x7fdf580b1bc0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 0x7fdf5815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf56d9d640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c400 tx=0x7fdf4800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf480052d0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf48005490 con 0x7fdf580b1bc0 2024-04-14T09:58:47.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf48007260 con 0x7fdf580b1bc0 2024-04-14T09:58:47.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf58156e60 con 0x7fdf580b1bc0 2024-04-14T09:58:47.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.343+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf58157420 con 0x7fdf580b1bc0 2024-04-14T09:58:47.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.344+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf580756f0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.345+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf48007400 con 0x7fdf580b1bc0 2024-04-14T09:58:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.345+0000 7fdf3f7fe640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 0x7fdf4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.345+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdf4808b310 con 0x7fdf580b1bc0 2024-04-14T09:58:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.345+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 0x7fdf4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.346+0000 7fdf5659c640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 0x7fdf4406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c036000 tx=0x7fdf4c03c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.349+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdf48058db0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.538+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf580725e0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.539+0000 7fdf3f7fe640 1 -- 172.21.15.40:0/3432699852 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fdf4805d0b0 con 0x7fdf580b1bc0 2024-04-14T09:58:47.539 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:47.539 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 msgr2=0x7fdf4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 0x7fdf4406edb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c036000 tx=0x7fdf4c03c040 comp rx=0 tx=0).stop 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 msgr2=0x7fdf58156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdf4800c400 tx=0x7fdf4800c8c0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 shutdown_connections 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdf4406c8f0 0x7fdf4406edb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdf5815e2b0 0x7fdf581f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdf581584a0 0x7fdf5815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 --2- 172.21.15.40:0/3432699852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdf580b1bc0 0x7fdf58156410 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 >> 172.21.15.40:0/3432699852 conn(0x7fdf5806ebf0 msgr2=0x7fdf580b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:47.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 shutdown_connections 2024-04-14T09:58:47.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.541+0000 7fdf5d1c8640 1 -- 172.21.15.40:0/3432699852 wait complete. 2024-04-14T09:58:47.552 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-14T09:58:47.552 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:47.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.654+0000 7fdd53d1e640 1 Processor -- start 2024-04-14T09:58:47.653 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.654+0000 7fdd53d1e640 1 -- start start 2024-04-14T09:58:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd53d1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd4c1414e0 0x7fdd4c15eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd53d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 0x7fdd4c06bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd53d1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd4c15f510 con 0x7fdd4c15f040 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd53d1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fdd4c15f7f0 con 0x7fdd4c1414e0 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd53d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c06b6c0 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd51aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fdd4c1414e0 0x7fdd4c15eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd512b9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fdd4c15f040 0x7fdd4c0b3760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40860/0 (socket says 172.21.15.40:40860) 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd512b9640 1 -- 172.21.15.40:0/632220008 learned_addr learned my addr 172.21.15.40:0/632220008 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd522bb640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 0x7fdd4c06bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd51aba640 1 -- 172.21.15.40:0/632220008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 msgr2=0x7fdd4c06bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd51aba640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 0x7fdd4c06bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd51aba640 1 -- 172.21.15.40:0/632220008 >> v1:172.21.15.40:6789/0 conn(0x7fdd4c15f040 legacy=0x7fdd4c0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd50ab8640 1 -- 172.21.15.40:0/632220008 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976018778 0 0) 0x7fdd4c15f510 con 0x7fdd4c15f040 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd51aba640 1 -- 172.21.15.40:0/632220008 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c1418c0 con 0x7fdd4c1414e0 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.655+0000 7fdd522bb640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 0x7fdd4c06bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:47.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd51aba640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c15eb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ba20f8fab0d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd50ab8640 1 -- 172.21.15.40:0/632220008 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48035020 con 0x7fdd4c1414e0 2024-04-14T09:58:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd50ab8640 1 -- 172.21.15.40:0/632220008 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd48031830 con 0x7fdd4c1414e0 2024-04-14T09:58:47.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd50ab8640 1 -- 172.21.15.40:0/632220008 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48031c00 con 0x7fdd4c1414e0 2024-04-14T09:58:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 -- 172.21.15.40:0/632220008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c1414e0 msgr2=0x7fdd4c15eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c15eb00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdd480097a0 tx=0x7fdd4802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 -- 172.21.15.40:0/632220008 shutdown_connections 2024-04-14T09:58:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c0b3e70 0x7fdd4c06bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/632220008 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c15eb00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.656+0000 7fdd53d1e640 1 -- 172.21.15.40:0/632220008 >> 172.21.15.40:0/632220008 conn(0x7fdd4c0d0790 msgr2=0x7fdd4c0d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.657+0000 7fdd53d1e640 1 -- 172.21.15.40:0/632220008 shutdown_connections 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.657+0000 7fdd53d1e640 1 -- 172.21.15.40:0/632220008 wait complete. 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 Processor -- start 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 -- start start 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c15f040 0x7fdd4c15d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b4560 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdd4c0b43e0 con 0x7fdd4c1414e0 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd53d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdd4c06c400 con 0x7fdd4c15f040 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd51aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd51aba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54846/0 (socket says 172.21.15.40:54846) 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd51aba640 1 -- 172.21.15.40:0/712483198 learned_addr learned my addr 172.21.15.40:0/712483198 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.658+0000 7fdd522bb640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c15f040 0x7fdd4c15d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd512b9640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 -- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c15f040 msgr2=0x7fdd4c15d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c15f040 0x7fdd4c15d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 -- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 msgr2=0x7fdd4c144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 -- 172.21.15.40:0/712483198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd4c15dde0 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd512b9640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd51aba640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098c0 tx=0x7fdd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48041070 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd4803aa30 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd4c1431a0 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd48035040 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.659+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd4c143760 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.660+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd4c0756f0 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.660+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd4804c060 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.661+0000 7fdd427fc640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.661+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdd480ad770 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.661+0000 7fdd512b9640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.661+0000 7fdd512b9640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 0x7fdd3006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c143ca0 tx=0x7fdd3c007ca0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:47.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.665+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fdd4c15dde0 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.853+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdd4c067800 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.854+0000 7fdd427fc640 1 -- 172.21.15.40:0/712483198 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fdd4807b860 con 0x7fdd4c0b3e70 2024-04-14T09:58:47.854 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:47.854 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:47.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 msgr2=0x7fdd3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 0x7fdd3006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c143ca0 tx=0x7fdd3c007ca0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 msgr2=0x7fdd4c0c56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:47.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdd480098c0 tx=0x7fdd480046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 shutdown_connections 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdd3006c8f0 0x7fdd3006edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdd4c15f040 0x7fdd4c15d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdd4c1414e0 0x7fdd4c144710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 --2- 172.21.15.40:0/712483198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fdd4c0b3e70 0x7fdd4c0c56d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 >> 172.21.15.40:0/712483198 conn(0x7fdd4c0d0790 msgr2=0x7fdd4c0b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 shutdown_connections 2024-04-14T09:58:47.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:47.856+0000 7fdd53d1e640 1 -- 172.21.15.40:0/712483198 wait complete. 2024-04-14T09:58:47.867 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-14T09:58:47.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-14T09:58:47.868 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-14T09:58:47.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-14T09:58:47.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-14T09:58:47.869 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-14T09:58:47.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-14T09:58:47.870 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-14T09:58:48.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f2206959640 1 Processor -- start 2024-04-14T09:58:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f49b8a66640 1 Processor -- start 2024-04-14T09:58:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f3b5126f640 1 Processor -- start 2024-04-14T09:58:48.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f3b5126f640 1 -- start start 2024-04-14T09:58:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f504671e640 1 Processor -- start 2024-04-14T09:58:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f2206959640 1 -- start start 2024-04-14T09:58:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f504671e640 1 -- start start 2024-04-14T09:58:48.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7fabeadd4640 1 Processor -- start 2024-04-14T09:58:48.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f92c2f5e640 1 Processor -- start 2024-04-14T09:58:48.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f79cd436640 1 Processor -- start 2024-04-14T09:58:48.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.044+0000 7f49b8a66640 1 -- start start 2024-04-14T09:58:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7fe4d4355640 1 Processor -- start 2024-04-14T09:58:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f92c2f5e640 1 -- start start 2024-04-14T09:58:48.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7fe4d4355640 1 -- start start 2024-04-14T09:58:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f2206959640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f79cd436640 1 -- start start 2024-04-14T09:58:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f2206959640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 0x7f22000ad610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.045+0000 7f2205156640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f22000730e0 0x7f220006d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56286/0 (socket says 172.21.15.40:56286) 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b8a66640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f49ac058a90 0x7f49ac0eb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b37fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f49ac03aa60 0x7f49ac03ae40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56300/0 (socket says 172.21.15.40:56300) 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b37fe640 1 -- 172.21.15.40:0/484788605 learned_addr learned my addr 172.21.15.40:0/484788605 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b5126f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3b44038ba0 0x7f3b44039f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b5126f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b44038f80 0x7f3b440e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b4b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3b440364d0 0x7f3b44056330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40878/0 (socket says 172.21.15.40:40878) 2024-04-14T09:58:48.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b4b7fe640 1 -- 172.21.15.40:0/3068635915 learned_addr learned my addr 172.21.15.40:0/3068635915 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b524d1640 1 --2- 172.21.15.40:0/3068635915 >> v2:172.21.15.136:3300/0 conn(0x7f3b44038f80 0x7f3b440e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b4403c840 con 0x7f3b440364d0 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3b44055ea0 con 0x7f3b44038ba0 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4403cae0 con 0x7f3b44038f80 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f79cd436640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f79c80721d0 0x7f79c8072630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f79cd436640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f79c806d820 0x7f79c806dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f79cd436640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79c81665f0 con 0x7f79c80cc730 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f79cd436640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f79c8072e90 con 0x7f79c806d820 2024-04-14T09:58:48.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f79cd436640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f79c8073170 con 0x7f79c80721d0 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f79c7fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f79c80cc730 0x7f79c80ccb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56336/0 (socket says 172.21.15.40:56336) 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f79c7fff640 1 -- 172.21.15.40:0/2236497748 learned_addr learned my addr 172.21.15.40:0/2236497748 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ac055860 con 0x7f49ac04cb30 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49ac0ebfd0 con 0x7f49ac03aa60 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f49ac0eb730 con 0x7f49ac058a90 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104148363 0 0) 0x7f49ac0ebfd0 con 0x7f49ac03aa60 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49a4003520 con 0x7f49ac03aa60 2024-04-14T09:58:48.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f49b3fff640 1 --2- 172.21.15.40:0/484788605 >> v2:172.21.15.40:3300/0 conn(0x7f49ac058a90 0x7f49ac0eb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d4355640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d4355640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4cc073390 0x7fe4cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d18f0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d20f1640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe4cc15f460 0x7fe4cc15fbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56312/0 (socket says 172.21.15.40:56312) 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d28f2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4cc073390 0x7fe4cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d18f0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc072e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:56972/0 (socket says 172.21.15.40:56972) 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d28f2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe4cc073390 0x7fe4cc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51036/0 (socket says 172.21.15.40:51036) 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d4355640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc160630 con 0x7fe4cc15f460 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7fe4d20f1640 1 -- 172.21.15.40:0/172996714 learned_addr learned my addr 172.21.15.40:0/172996714 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe4cc06db40 con 0x7fe4cc073390 2024-04-14T09:58:48.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc160910 con 0x7fe4cc06dfd0 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f504671e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50380df220 0x7f5038038080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f503f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5038053c70 0x7f503804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56302/0 (socket says 172.21.15.40:56302) 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f503f7fe640 1 -- 172.21.15.40:0/2979875702 learned_addr learned my addr 172.21.15.40:0/2979875702 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f504671e640 1 --2- 172.21.15.40:0/2979875702 >> v2:172.21.15.40:3300/0 conn(0x7f50380501a0 0x7f5038006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f503ffff640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50380df220 0x7f5038038080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2979875702 >> v2:172.21.15.40:3300/0 conn(0x7f50380501a0 0x7f5038006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50380544c0 con 0x7f5038053c70 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f50380541e0 con 0x7f50380501a0 2024-04-14T09:58:48.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5038005f30 con 0x7f50380df220 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c2f5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92bc15e5d0 0x7f92bc0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c2f5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f92bc0d4880 0x7f92bc0d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c0cfa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92bc15e5d0 0x7f92bc0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c0cfa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92bc15e5d0 0x7f92bc0cecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51032/0 (socket says 172.21.15.40:51032) 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2655172529 learned_addr learned my addr 172.21.15.40:0/2655172529 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92bc0cf7b0 con 0x7f92bc0cf210 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc15e9b0 con 0x7f92bc0d4880 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f92bc0d03c0 con 0x7f92bc15e5d0 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92bb7fe640 1 -- 172.21.15.40:0/2655172529 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998900170 0 0) 0x7f92bc0cf7b0 con 0x7f92bc0cf210 2024-04-14T09:58:48.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92bb7fe640 1 -- 172.21.15.40:0/2655172529 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92ac003520 con 0x7f92bc0cf210 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2655172529 >> v2:172.21.15.40:3300/0 conn(0x7f92bc0d4880 msgr2=0x7f92bc0d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92c0cfa640 1 --2- 172.21.15.40:0/2655172529 >> v2:172.21.15.40:3300/0 conn(0x7f92bc0d4880 0x7f92bc0d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2655172529 >> v1:172.21.15.136:6789/0 conn(0x7f92bc0cf210 legacy=0x7f92bc0d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f2205957640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.046+0000 7f2205957640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51012/0 (socket says 172.21.15.40:51012) 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f2206959640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2200163430 con 0x7f22000730e0 2024-04-14T09:58:48.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f2206959640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f220015d020 con 0x7f220015cc40 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f2206959640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2200163710 con 0x7f220006d8e0 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d10ef640 1 -- 172.21.15.40:0/172996714 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892474939 0 0) 0x7fe4cc160630 con 0x7fe4cc15f460 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d10ef640 1 -- 172.21.15.40:0/172996714 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b8007930 con 0x7fe4cc15f460 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f5044cbb640 1 -- 172.21.15.40:0/2979875702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50380df220 msgr2=0x7f5038038080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50380df220 0x7f5038038080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f5044cbb640 1 -- 172.21.15.40:0/2979875702 >> v1:172.21.15.136:6789/0 conn(0x7f5038053c70 legacy=0x7f503804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f5044cbb640 1 -- 172.21.15.40:0/2979875702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50380077e0 con 0x7f50380501a0 2024-04-14T09:58:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f79c77fe640 1 --2- 172.21.15.40:0/2236497748 >> v2:172.21.15.136:3300/0 conn(0x7f79c80721d0 0x7f79c8072630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2655172529 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0cfa90 con 0x7f92bc15e5d0 2024-04-14T09:58:48.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f79ccc35640 1 --2- 172.21.15.40:0/2236497748 >> v2:172.21.15.40:3300/0 conn(0x7f79c806d820 0x7f79c806dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3536474946 0 0) 0x7f49a4003520 con 0x7f49ac03aa60 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 >> v2:172.21.15.40:3300/0 conn(0x7f49ac058a90 msgr2=0x7f49ac0eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 --2- 172.21.15.40:0/484788605 >> v2:172.21.15.40:3300/0 conn(0x7f49ac058a90 0x7f49ac0eb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 >> v1:172.21.15.40:6789/0 conn(0x7f49ac04cb30 legacy=0x7f49ac0572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac0eba10 con 0x7f49ac03aa60 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f49a0001670 con 0x7f49ac03aa60 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 >> v1:172.21.15.136:6789/0 conn(0x7f49ac03aa60 legacy=0x7f49ac03ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a40039b0 0x7f49a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 0x7f49a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a40052e0 0x7f49a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0eb730 con 0x7f49a4004800 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49a400c1b0 con 0x7f49a40039b0 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f49a400c3b0 con 0x7f49a40052e0 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b37fe640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a40039b0 0x7f49a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b3fff640 1 --2- 172.21.15.40:0/484788605 >> v2:172.21.15.40:3300/0 conn(0x7f49ac058a90 0x7f49ac0eb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 0x7f49a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2205156640 1 -- 172.21.15.40:0/2517370361 learned_addr learned my addr 172.21.15.40:0/2517370361 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2206158640 1 --2- 172.21.15.40:0/2517370361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 0x7f22000ad610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fabeadd4640 1 -- start start 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b2ffd640 1 -- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a40052e0 msgr2=0x7f49a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a40052e0 0x7f49a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b2ffd640 1 -- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a40039b0 msgr2=0x7f49a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49a40039b0 0x7f49a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b2ffd640 1 -- 172.21.15.40:0/484788605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a4003520 con 0x7f49a4004800 2024-04-14T09:58:48.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d28f2640 1 -- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 msgr2=0x7fe4cc072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc072e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d28f2640 1 -- 172.21.15.40:0/172996714 >> v1:172.21.15.136:6789/0 conn(0x7fe4cc15f460 legacy=0x7fe4cc15fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7fe4d28f2640 1 -- 172.21.15.40:0/172996714 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc06d7d0 con 0x7fe4cc073390 2024-04-14T09:58:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f49b3fff640 1 -- 172.21.15.40:0/484788605 reap_dead start 2024-04-14T09:58:48.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f92c0cfa640 1 --2- 172.21.15.40:0/2655172529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0cecd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92bc08dc70 tx=0x7f92b002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5444721d622f7210 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f79c6ffd640 1 -- 172.21.15.40:0/2236497748 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527305830 0 0) 0x7f79c81665f0 con 0x7f79c80cc730 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f79c6ffd640 1 -- 172.21.15.40:0/2236497748 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79b0003520 con 0x7f79c80cc730 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f3b524d1640 1 -- 172.21.15.40:0/3068635915 >> v2:172.21.15.40:3300/0 conn(0x7f3b44038ba0 msgr2=0x7f3b44039f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f3b524d1640 1 --2- 172.21.15.40:0/3068635915 >> v2:172.21.15.40:3300/0 conn(0x7f3b44038ba0 0x7f3b44039f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f3b524d1640 1 -- 172.21.15.40:0/3068635915 >> v1:172.21.15.40:6789/0 conn(0x7f3b440364d0 legacy=0x7f3b44056330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.047+0000 7f3b524d1640 1 -- 172.21.15.40:0/3068635915 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4403cdc0 con 0x7f3b44038f80 2024-04-14T09:58:48.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7fabeadd4640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 0x7fabdc057d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7fabeadd4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7fabeadd4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc0582d0 con 0x7fabdc03e840 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7fabeadd4640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fabdc058570 con 0x7fabdc0e30c0 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7fabeadd4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc058850 con 0x7fabdc054300 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f5038006a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f504004fd80 tx=0x7f50400a6c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4eb79a26b52694e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f79c77fe640 1 -- 172.21.15.40:0/2236497748 >> v2:172.21.15.40:3300/0 conn(0x7f79c806d820 msgr2=0x7f79c806dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f79c77fe640 1 --2- 172.21.15.40:0/2236497748 >> v2:172.21.15.40:3300/0 conn(0x7f79c806d820 0x7f79c806dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f79c77fe640 1 -- 172.21.15.40:0/2236497748 >> v1:172.21.15.136:6789/0 conn(0x7f79c80cc730 legacy=0x7f79c80ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f79c77fe640 1 -- 172.21.15.40:0/2236497748 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c806d020 con 0x7f79c80721d0 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0cb970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a479e333ee2669 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f92bb7fe640 1 -- 172.21.15.40:0/2655172529 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0035020 con 0x7f92bc15e5d0 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f92bb7fe640 1 -- 172.21.15.40:0/2655172529 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b0031870 con 0x7f92bc15e5d0 2024-04-14T09:58:48.064 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f92bb7fe640 1 -- 172.21.15.40:0/2655172529 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0031c40 con 0x7f92bc15e5d0 2024-04-14T09:58:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:56992/0 (socket says 172.21.15.40:56992) 2024-04-14T09:58:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 -- 172.21.15.40:0/3523132831 learned_addr learned my addr 172.21.15.40:0/3523132831 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f3b524d1640 1 --2- 172.21.15.40:0/3068635915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038f80 0x7f3b440e51f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c051160 tx=0x7f3b4c0a6e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=118671c35d1440a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2206158640 1 -- 172.21.15.40:0/2517370361 >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 msgr2=0x7f2200162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2206158640 1 --2- 172.21.15.40:0/2517370361 >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2206158640 1 -- 172.21.15.40:0/2517370361 >> v1:172.21.15.136:6789/0 conn(0x7f22000730e0 legacy=0x7f220006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2206158640 1 -- 172.21.15.40:0/2517370361 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22001639f0 con 0x7f220006d8e0 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.048+0000 7f2205957640 1 --2- 172.21.15.40:0/2517370361 >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-14T09:58:48.066 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f3b4affd640 1 -- 172.21.15.40:0/3068635915 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b4070 con 0x7f3b44038f80 2024-04-14T09:58:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/3523132831 >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 0x7fabdc057d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 -- 172.21.15.40:0/3523132831 >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 msgr2=0x7fabdc057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 --2- 172.21.15.40:0/3523132831 >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 0x7fabdc057d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f3b4affd640 1 -- 172.21.15.40:0/3068635915 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0a7d30 con 0x7f3b44038f80 2024-04-14T09:58:48.067 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f3b4affd640 1 -- 172.21.15.40:0/3068635915 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0af660 con 0x7f3b44038f80 2024-04-14T09:58:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 -- 172.21.15.40:0/3523132831 >> v1:172.21.15.40:6789/0 conn(0x7fabdc03e840 legacy=0x7fabdc053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabea5d3640 1 -- 172.21.15.40:0/3523132831 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc058b30 con 0x7fabdc054300 2024-04-14T09:58:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/3523132831 >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 0x7fabdc057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 0x7f49a4004c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49b4064ff0 tx=0x7f49a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ccf552c2cbd0d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f2206158640 1 --2- 172.21.15.40:0/2517370361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 0x7f22000ad610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009d90 tx=0x7f21f802bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8650786d00e4ebd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.049+0000 7f503effd640 1 -- 172.21.15.40:0/2979875702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50400b4070 con 0x7f50380501a0 2024-04-14T09:58:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f503effd640 1 -- 172.21.15.40:0/2979875702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50400a7a40 con 0x7f50380501a0 2024-04-14T09:58:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f503effd640 1 -- 172.21.15.40:0/2979875702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50400af440 con 0x7f50380501a0 2024-04-14T09:58:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 msgr2=0x7f92bc0cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 --2- 172.21.15.40:0/2655172529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0cecd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92bc08dc70 tx=0x7f92b002b910 comp rx=0 tx=0).stop 2024-04-14T09:58:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f2204955640 1 -- 172.21.15.40:0/2517370361 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8039070 con 0x7f220006d8e0 2024-04-14T09:58:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f2204955640 1 -- 172.21.15.40:0/2517370361 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f802cb40 con 0x7f220006d8e0 2024-04-14T09:58:48.070 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f2204955640 1 -- 172.21.15.40:0/2517370361 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8034440 con 0x7f220006d8e0 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7fe4d10ef640 1 -- 172.21.15.40:0/172996714 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4039070 con 0x7fe4cc073390 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7fe4d10ef640 1 -- 172.21.15.40:0/172996714 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c402cc80 con 0x7fe4cc073390 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7fe4d10ef640 1 -- 172.21.15.40:0/172996714 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4034660 con 0x7fe4cc073390 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b40b4070 con 0x7f49a4004800 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49b40a7af0 con 0x7f49a4004800 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f49b27fc640 1 -- 172.21.15.40:0/484788605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49b404fdd0 con 0x7f49a4004800 2024-04-14T09:58:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 shutdown_connections 2024-04-14T09:58:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 --2- 172.21.15.40:0/2655172529 >> v2:172.21.15.40:3300/0 conn(0x7f92bc0d4880 0x7f92bc0d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 --2- 172.21.15.40:0/2655172529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0cecd0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f79c77fe640 1 --2- 172.21.15.40:0/2236497748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 0x7f79c8072630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c806c5f0 tx=0x7f79c002bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c29f2f75b7503096 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 >> 172.21.15.40:0/2655172529 conn(0x7f92bc08dce0 msgr2=0x7f92bc09d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038f80 msgr2=0x7f3b440e51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 --2- 172.21.15.40:0/3068635915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038f80 0x7f3b440e51f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c051160 tx=0x7f3b4c0a6e80 comp rx=0 tx=0).stop 2024-04-14T09:58:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f79c6ffd640 1 -- 172.21.15.40:0/2236497748 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0039070 con 0x7f79c80721d0 2024-04-14T09:58:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 shutdown_connections 2024-04-14T09:58:48.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7fabea5d3640 1 --2- 172.21.15.40:0/3523132831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabe406b390 tx=0x7fabe40a6f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d50066404673fb1f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 --2- 172.21.15.40:0/3068635915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038f80 0x7f3b440e51f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 --2- 172.21.15.40:0/3068635915 >> v2:172.21.15.40:3300/0 conn(0x7f3b44038ba0 0x7f3b44039f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 >> 172.21.15.40:0/3068635915 conn(0x7f3b44053930 msgr2=0x7f3b44053d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f79c6ffd640 1 -- 172.21.15.40:0/2236497748 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c002cc70 con 0x7f79c80721d0 2024-04-14T09:58:48.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f79c6ffd640 1 -- 172.21.15.40:0/2236497748 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c0034660 con 0x7f79c80721d0 2024-04-14T09:58:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 shutdown_connections 2024-04-14T09:58:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f3b5126f640 1 -- 172.21.15.40:0/3068635915 wait complete. 2024-04-14T09:58:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7fabe8dd0640 1 -- 172.21.15.40:0/3523132831 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe40b4070 con 0x7fabdc054300 2024-04-14T09:58:48.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 msgr2=0x7fe4cc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fabe8dd0640 1 -- 172.21.15.40:0/3523132831 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe40a7db0 con 0x7fabdc054300 2024-04-14T09:58:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 msgr2=0x7f49a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f49b8a66640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 0x7f49a4004c80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f49b4064ff0 tx=0x7f49a4005830 comp rx=0 tx=0).stop 2024-04-14T09:58:48.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 --2- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0cb970 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4009d90 tx=0x7fe4c402bed0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 -- 172.21.15.40:0/2517370361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 msgr2=0x7f22000ad610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 msgr2=0x7f5038006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 --2- 172.21.15.40:0/2517370361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 0x7f22000ad610 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009d90 tx=0x7f21f802bd90 comp rx=0 tx=0).stop 2024-04-14T09:58:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f5038006a10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f504004fd80 tx=0x7f50400a6c10 comp rx=0 tx=0).stop 2024-04-14T09:58:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 shutdown_connections 2024-04-14T09:58:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f49b8a66640 1 --2- 172.21.15.40:0/484788605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49a4004800 0x7f49a4004c80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 >> 172.21.15.40:0/484788605 conn(0x7f49ac058fe0 msgr2=0x7f49ac0593c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 -- 172.21.15.40:0/2517370361 shutdown_connections 2024-04-14T09:58:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 --2- 172.21.15.40:0/2517370361 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f220006d8e0 0x7f22000ad610 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 --2- 172.21.15.40:0/2517370361 >> v2:172.21.15.136:3300/0 conn(0x7f220015cc40 0x7f2200162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 -- 172.21.15.40:0/2517370361 >> 172.21.15.40:0/2517370361 conn(0x7f220006b700 msgr2=0x7f220006bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 shutdown_connections 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f5038006a10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 --2- 172.21.15.40:0/2979875702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50380df220 0x7f5038038080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 >> 172.21.15.40:0/2979875702 conn(0x7f5038009fb0 msgr2=0x7f503800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 -- 172.21.15.40:0/2517370361 shutdown_connections 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f2206959640 1 -- 172.21.15.40:0/2517370361 wait complete. 2024-04-14T09:58:48.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.050+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 shutdown_connections 2024-04-14T09:58:48.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2655172529 wait complete. 2024-04-14T09:58:48.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 shutdown_connections 2024-04-14T09:58:48.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f504671e640 1 -- 172.21.15.40:0/2979875702 wait complete. 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 shutdown_connections 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 --2- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0cb970 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 --2- 172.21.15.40:0/172996714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 >> 172.21.15.40:0/172996714 conn(0x7fe4cc0b1c50 msgr2=0x7fe4cc0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fabe8dd0640 1 -- 172.21.15.40:0/3523132831 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe40af640 con 0x7fabdc054300 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7fabeadd4640 1 -- 172.21.15.40:0/3523132831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 msgr2=0x7fabdc0068d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 --2- 172.21.15.40:0/3523132831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fabe406b390 tx=0x7fabe40a6f00 comp rx=0 tx=0).stop 2024-04-14T09:58:48.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 -- 172.21.15.40:0/3523132831 shutdown_connections 2024-04-14T09:58:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 --2- 172.21.15.40:0/3523132831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc054300 0x7fabdc0068d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 --2- 172.21.15.40:0/3523132831 >> v2:172.21.15.40:3300/0 conn(0x7fabdc0e30c0 0x7fabdc057d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 -- 172.21.15.40:0/3523132831 >> 172.21.15.40:0/3523132831 conn(0x7fabdc0559e0 msgr2=0x7fabdc055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 shutdown_connections 2024-04-14T09:58:48.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fe4d4355640 1 -- 172.21.15.40:0/172996714 wait complete. 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 -- 172.21.15.40:0/2236497748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 msgr2=0x7f79c8072630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 --2- 172.21.15.40:0/2236497748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 0x7f79c8072630 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c806c5f0 tx=0x7f79c002bec0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 -- 172.21.15.40:0/2236497748 shutdown_connections 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7f3b5126f640 1 Processor -- start 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f3b5126f640 1 -- start start 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 --2- 172.21.15.40:0/2236497748 >> v2:172.21.15.40:3300/0 conn(0x7f79c806d820 0x7f79c806dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 --2- 172.21.15.40:0/2236497748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 0x7f79c8072630 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 -- 172.21.15.40:0/2236497748 >> 172.21.15.40:0/2236497748 conn(0x7f79c80b20c0 msgr2=0x7f79c80cfd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 -- 172.21.15.40:0/2236497748 shutdown_connections 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.051+0000 7f79cd436640 1 -- 172.21.15.40:0/2236497748 wait complete. 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 -- 172.21.15.40:0/3523132831 shutdown_connections 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7f92c2f5e640 1 Processor -- start 2024-04-14T09:58:48.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7fabeadd4640 1 -- 172.21.15.40:0/3523132831 wait complete. 2024-04-14T09:58:48.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f2206959640 1 Processor -- start 2024-04-14T09:58:48.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 shutdown_connections 2024-04-14T09:58:48.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f49b8a66640 1 -- 172.21.15.40:0/484788605 wait complete. 2024-04-14T09:58:48.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f2206959640 1 -- start start 2024-04-14T09:58:48.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f504671e640 1 Processor -- start 2024-04-14T09:58:48.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7fe4d4355640 1 Processor -- start 2024-04-14T09:58:48.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f504671e640 1 -- start start 2024-04-14T09:58:48.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 0x7f3b4404cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7fabeadd4640 1 Processor -- start 2024-04-14T09:58:48.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.052+0000 7f92c2f5e640 1 -- start start 2024-04-14T09:58:48.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92c2f5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 0x7f92bc15cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038ba0 0x7f3b440dbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b44038f80 0x7f3b440543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4400df70 con 0x7f3b440364d0 2024-04-14T09:58:48.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4400ddf0 con 0x7f3b44038ba0 2024-04-14T09:58:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b5126f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3b44056a40 con 0x7f3b44038f80 2024-04-14T09:58:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 0x7f3b4404cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92c2f5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc0d4880 0x7f92bc0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b4bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 0x7f3b4404cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54926/0 (socket says 172.21.15.40:54926) 2024-04-14T09:58:48.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f3b4bfff640 1 -- 172.21.15.40:0/2021140862 learned_addr learned my addr 172.21.15.40:0/2021140862 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92c2f5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92c0cfa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 0x7f92bc15cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92c0cfa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 0x7f92bc15cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57000/0 (socket says 172.21.15.40:57000) 2024-04-14T09:58:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc0d4880 0x7f92bc0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f92bbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc0d4880 0x7f92bc0b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54930/0 (socket says 172.21.15.40:54930) 2024-04-14T09:58:48.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f2206959640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220006d8e0 0x7f2200147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2081360384 learned_addr learned my addr 172.21.15.40:0/2081360384 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f49b8a66640 1 Processor -- start 2024-04-14T09:58:48.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fe4d4355640 1 -- start start 2024-04-14T09:58:48.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0b5820 con 0x7f92bc0d4880 2024-04-14T09:58:48.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc0d0050 con 0x7f92bc15e5d0 2024-04-14T09:58:48.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c14fb640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f2206959640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 0x7f220009c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7fabeadd4640 1 -- start start 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f49b8a66640 1 -- start start 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc03e840 0x7fabdc1807d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabdc054300 0x7fabdc0e1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabdc0e30c0 0x7fabdc0d7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc0e34a0 con 0x7fabdc054300 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc03bfc0 con 0x7fabdc0e30c0 2024-04-14T09:58:48.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabeadd4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc006e10 con 0x7fabdc03e840 2024-04-14T09:58:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f504671e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f503804ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc0b59a0 con 0x7f92bc0cf210 2024-04-14T09:58:48.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7fabe95d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabdc054300 0x7fabdc0e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f504671e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5038053c70 0x7f503804bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f503ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f503804ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f2206959640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f220015cc40 0x7f220009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f2205957640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220006d8e0 0x7f2200147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205957640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220006d8e0 0x7f2200147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54964/0 (socket says 172.21.15.40:54964) 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f503ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f503804ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54966/0 (socket says 172.21.15.40:54966) 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 msgr2=0x7f92bc0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92bc15e5d0 0x7f92bc0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2081360384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc0d4880 msgr2=0x7f92bc0b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f92bc0d4880 0x7f92bc0b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f92c0cfa640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc0cde50 con 0x7f92bc0cf210 2024-04-14T09:58:48.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2206959640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2200163060 con 0x7f220006d8e0 2024-04-14T09:58:48.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b4b7fe640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038ba0 0x7f3b440dbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b44038f80 0x7f3b440543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 -- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038ba0 msgr2=0x7f3b440dbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b44038ba0 0x7f3b440dbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 -- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 msgr2=0x7f3b4404cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 0x7f3b4404cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b524d1640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4404e3d0 con 0x7f3b44038f80 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f3b4bfff640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3b440364d0 0x7f3b4404cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f503ffff640 1 -- 172.21.15.40:0/2702642630 learned_addr learned my addr 172.21.15.40:0/2702642630 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f3b524d1640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b44038f80 0x7f3b440543a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c073ed0 tx=0x7f3b4c06b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 0x7f220009c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2206158640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f220015cc40 0x7f220009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 0x7f220009c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57034/0 (socket says 172.21.15.40:57034) 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2206158640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f220015cc40 0x7f220009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51088/0 (socket says 172.21.15.40:51088) 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 -- 172.21.15.40:0/2424847485 learned_addr learned my addr 172.21.15.40:0/2424847485 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22000ad0f0 con 0x7f220015cc40 2024-04-14T09:58:48.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f22001631e0 con 0x7f22000730e0 2024-04-14T09:58:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92c0cfa640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 0x7f92bc15cbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c00 tx=0x7f92b00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f504671e640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50380df220 0x7f503804c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7fabea5d3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabdc0e30c0 0x7fabdc0d7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7fabe95d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabdc054300 0x7fabdc0e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:54948/0 (socket says 172.21.15.40:54948) 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7fabe95d1640 1 -- 172.21.15.40:0/1319451102 learned_addr learned my addr 172.21.15.40:0/1319451102 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f79cd436640 1 Processor -- start 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.053+0000 7f79cd436640 1 -- start start 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f79cd436640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c806d820 0x7f79c815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.054+0000 7f79cd436640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 0x7f79c81ec820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79cd436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 0x7f79c81ecd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79cd436640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8073450 con 0x7f79c806d820 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79cd436640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79c8072b70 con 0x7f79c80721d0 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79cd436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79c8162a50 con 0x7f79c80cc730 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 0x7f79c81ecd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 0x7f79c81ecd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57016/0 (socket says 172.21.15.40:57016) 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 -- 172.21.15.40:0/283309785 learned_addr learned my addr 172.21.15.40:0/283309785 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0040070 con 0x7f92bc0cf210 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92b0030ce0 con 0x7f92bc0cf210 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92b0035040 con 0x7f92bc0cf210 2024-04-14T09:58:48.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92bc0cdb70 con 0x7f92bc0cf210 2024-04-14T09:58:48.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79c7fff640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c806d820 0x7f79c815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 -- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 msgr2=0x7f79c81ec820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-14T09:58:48.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc03e840 0x7fabdc1807d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92bc0b8150 con 0x7f92bc0cf210 2024-04-14T09:58:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79c80721d0 0x7f79c81ec820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 -- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c806d820 msgr2=0x7f79c815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.055+0000 7f79ccc35640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c806d820 0x7f79c815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f79ccc35640 1 -- 172.21.15.40:0/283309785 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79c8163e80 con 0x7f79c80cc730 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f79c7fff640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f79c806d820 0x7f79c815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f79ccc35640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 0x7f79c81ecd60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79b800e820 tx=0x7f79b800ec20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0c3070 con 0x7f3b44038f80 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b4c0bdc60 con 0x7f3b44038f80 2024-04-14T09:58:48.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b4c0b4040 con 0x7f3b44038f80 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a4004800 0x7f49ac04f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49ac0d86a0 0x7f49ac0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 0x7f49ac0cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0eb0c0 con 0x7f49ac0d86a0 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f49ac0e7880 con 0x7f49ac0d8b20 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b8a66640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f49ac0eb240 con 0x7f49a4004800 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fabe9dd2640 1 -- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabdc0e30c0 msgr2=0x7fabdc0d7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fabdc0e30c0 0x7fabdc0d7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fabe9dd2640 1 -- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabdc054300 msgr2=0x7fabdc0e1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fabdc054300 0x7fabdc0e1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fabe9dd2640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc0e2390 con 0x7fabdc03e840 2024-04-14T09:58:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b4404e6b0 con 0x7f3b44038f80 2024-04-14T09:58:48.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b4404ec70 con 0x7f3b44038f80 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 -- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f220015cc40 msgr2=0x7f220009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f220015cc40 0x7f220009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 -- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220006d8e0 msgr2=0x7f2200147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f220006d8e0 0x7f2200147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f2205156640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f220009c920 con 0x7f22000730e0 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f2205156640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 0x7f220009c3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c490 tx=0x7f21f000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f504671e640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5038037910 con 0x7f50380501a0 2024-04-14T09:58:48.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 0x7f49ac0cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0c5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 0x7f49ac0cebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51106/0 (socket says 172.21.15.40:51106) 2024-04-14T09:58:48.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b3fff640 1 -- 172.21.15.40:0/3193473440 learned_addr learned my addr 172.21.15.40:0/3193473440 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b8017070 con 0x7f79c80cc730 2024-04-14T09:58:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79b800ee70 con 0x7f79c80cc730 2024-04-14T09:58:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79c815bf30 con 0x7f79c80cc730 2024-04-14T09:58:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f79c8164400 con 0x7f79c80cc730 2024-04-14T09:58:48.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0005ce0 con 0x7f22000730e0 2024-04-14T09:58:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79b800cb60 con 0x7f79c80cc730 2024-04-14T09:58:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f49b37fe640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a4004800 0x7f49ac04f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b4404efe0 con 0x7f3b44038f80 2024-04-14T09:58:48.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f220009b340 con 0x7f22000730e0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f220009b900 con 0x7f22000730e0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21f0007070 con 0x7f22000730e0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f0007460 con 0x7f22000730e0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f21e8001030 con 0x7f22000730e0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fabe9dd2640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc03e840 0x7fabdc1807d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c610 tx=0x7fabe000cad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 -- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a4004800 msgr2=0x7f49ac04f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f49a4004800 0x7f49ac04f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 -- 172.21.15.40:0/3193473440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49ac0d86a0 msgr2=0x7f49ac0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f49ac0d86a0 0x7f49ac0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49ac04fa80 con 0x7f49ac0d8b20 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f49b3fff640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 0x7f49ac0cebd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49ac053530 tx=0x7f49a800eba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a800f040 con 0x7f49ac0d8b20 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49a800ecd0 con 0x7f49ac0d8b20 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8004240 con 0x7f49ac0d8b20 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49ac1795a0 con 0x7f49ac0d8b20 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15f460 0x7fe4cc0ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc1602f0 con 0x7fe4cc15f460 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc06e430 con 0x7fe4cc073390 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d4355640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc0717c0 con 0x7fe4cc06dfd0 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7fe4d18f0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0c5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d20f1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d18f0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0c5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51120/0 (socket says 172.21.15.40:51120) 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d18f0640 1 -- 172.21.15.40:0/2667555888 learned_addr learned my addr 172.21.15.40:0/2667555888 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15f460 0x7fe4cc0ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 -- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 msgr2=0x7fe4cc1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc06dfd0 0x7fe4cc1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 -- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 msgr2=0x7fe4cc0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc073390 0x7fe4cc0c5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7fe4d28f2640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0c4080 con 0x7fe4cc15f460 2024-04-14T09:58:48.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4d28f2640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15f460 0x7fe4cc0ae870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4033000 tx=0x7fe4c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f504671e640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f50380064f0 con 0x7f50380df220 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f504671e640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5038037a90 con 0x7f5038053c70 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.056+0000 7f503f7fe640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5038053c70 0x7f503804bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.057+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50380df220 0x7f503804c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 -- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50380df220 msgr2=0x7f503804c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50380df220 0x7f503804c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 -- 172.21.15.40:0/2702642630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 msgr2=0x7f503804ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50380501a0 0x7f503804ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50380cc010 con 0x7f5038053c70 2024-04-14T09:58:48.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f503f7fe640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5038053c70 0x7f503804bb90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f502c001cf0 tx=0x7f502c00a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.058+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f92bc075760 con 0x7f92bc0cf210 2024-04-14T09:58:48.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49ac04ea60 con 0x7f49ac0d8b20 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4044020 con 0x7fe4cc15f460 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc0c4360 con 0x7fe4cc15f460 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc0c4920 con 0x7fe4cc15f460 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c403f470 con 0x7fe4cc15f460 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c4039040 con 0x7fe4cc15f460 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c007170 con 0x7f5038053c70 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f502c007310 con 0x7f5038053c70 2024-04-14T09:58:48.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502c0138e0 con 0x7f5038053c70 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f92b0038020 con 0x7f92bc0cf210 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f92b97fa640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f92a006c9c0 0x7f92a006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f92b00adcf0 con 0x7f92bc0cf210 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f92b97fa640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f92a00760b0 0x7f92a00784f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.059+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92b0031870 con 0x7f92a00760b0 2024-04-14T09:58:48.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f504671e640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50380cc2d0 con 0x7f5038053c70 2024-04-14T09:58:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f21f001b400 con 0x7f22000730e0 2024-04-14T09:58:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f92b0077aa0 con 0x7f92bc0cf210 2024-04-14T09:58:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f504671e640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f50380cc890 con 0x7f5038053c70 2024-04-14T09:58:48.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f92c14fb640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f92a00760b0 0x7f92a00784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0015070 con 0x7fabdc03e840 2024-04-14T09:58:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b4c0e67e0 con 0x7f3b44038f80 2024-04-14T09:58:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b48ff9640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3b3006c9c0 0x7f3b3006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79b801a070 con 0x7f79c80cc730 2024-04-14T09:58:48.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f79c4ff9640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f79b406c9c0 0x7f79b406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f21f67fc640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f21e406c9c0 0x7f21e406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f21f008b9d0 con 0x7f22000730e0 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f21f67fc640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7f21e4076140 0x7f21e4078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc0e06b0 con 0x7fabdc03e840 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc0e0950 con 0x7fabdc03e840 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe0011800 con 0x7fabdc03e840 2024-04-14T09:58:48.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49ac005390 con 0x7f49ac0d8b20 2024-04-14T09:58:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe4b4001030 con 0x7fe4cc15f460 2024-04-14T09:58:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f50380cd090 con 0x7f5038053c70 2024-04-14T09:58:48.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.060+0000 7f92bbfff640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f92a006c9c0 0x7f92a006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3b4c131230 con 0x7f3b44038f80 2024-04-14T09:58:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b4bfff640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3b3006c9c0 0x7f3b3006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f92c14fb640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f92a00760b0 0x7f92a00784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b48ff9640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7f3b30076140 0x7f3b30078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f79b808bd30 con 0x7f79c80cc730 2024-04-14T09:58:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b4c0bde50 con 0x7f3b30076140 2024-04-14T09:58:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.061+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b4c131620 con 0x7f3b44038f80 2024-04-14T09:58:48.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f79cd436640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7f79a8001650 0x7f79a8003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f3b4b7fe640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7f3b30076140 0x7f3b30078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f2205957640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f21e406c9c0 0x7f21e406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 --> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f79a8006bb0 con 0x7f79a8001650 2024-04-14T09:58:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f79c7fff640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f79b406c9c0 0x7f79b406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49a801c020 con 0x7f49ac0d8b20 2024-04-14T09:58:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f3b4bfff640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3b3006c9c0 0x7f3b3006ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009e10 tx=0x7f3b400091c0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f92bbfff640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f92a006c9c0 0x7f92a006ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1eccc0 tx=0x7f92a8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f79c77fe640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7f79a8001650 0x7f79a8003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7f3b4b7fe640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7f3b30076140 0x7f3b30078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4c4047020 con 0x7fe4cc15f460 2024-04-14T09:58:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== osd.7 v2:172.21.15.136:6824/2810716504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f92b0031870 con 0x7f92a00760b0 2024-04-14T09:58:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f502c013a80 con 0x7f5038053c70 2024-04-14T09:58:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f21f000ae50 con 0x7f21e4076140 2024-04-14T09:58:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f21f00902a0 con 0x7f22000730e0 2024-04-14T09:58:48.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe0011bd0 con 0x7fabdc03e840 2024-04-14T09:58:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f2206158640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7f21e4076140 0x7f21e4078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.062+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabcc001030 con 0x7fabdc03e840 2024-04-14T09:58:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabe0018070 con 0x7fabdc03e840 2024-04-14T09:58:48.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f499ffff640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f499806c8f0 0x7f499806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fe4c2ffd640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b006c8f0 0x7fe4b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f502406c940 0x7f502406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f49a808bb60 con 0x7f49ac0d8b20 2024-04-14T09:58:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f502c094240 con 0x7f5038053c70 2024-04-14T09:58:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe4c40aede0 con 0x7fe4cc15f460 2024-04-14T09:58:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f50240760c0 0x7f5024078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5024078bd0 con 0x7f50240760c0 2024-04-14T09:58:48.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f502c0945f0 con 0x7f5038053c70 2024-04-14T09:58:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f499ffff640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f4998076070 0x7f49980784b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4998078b80 con 0x7f4998076070 2024-04-14T09:58:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fe4c2ffd640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7fe4b0076070 0x7fe4b00784b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4c402cc80 con 0x7fe4b0076070 2024-04-14T09:58:48.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fe4c40af1d0 con 0x7fe4cc15f460 2024-04-14T09:58:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f49a808bf50 con 0x7f49ac0d8b20 2024-04-14T09:58:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f4998076070 0x7f49980784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f49b37fe640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f499806c8f0 0x7f499806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f503ffff640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f502406c940 0x7f502406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7fabda7fc640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fabc806c9c0 0x7fabc806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f2206158640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7f21e4076140 0x7f21e4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fabe95d1640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fabc806c9c0 0x7fabc806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f49b2ffd640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f4998076070 0x7f49980784b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f79c77fe640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7f79a8001650 0x7f79a8003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fe4d20f1640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b006c8f0 0x7fe4b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.063+0000 7f79c7fff640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f79b406c9c0 0x7f79b406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0011e0 tx=0x7f79bc007a00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fe4d18f0640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7fe4b0076070 0x7fe4b00784b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f503ffff640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f502406c940 0x7f502406ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5034009af0 tx=0x7f5034008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f49b37fe640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f499806c8f0 0x7f499806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49a00010e0 tx=0x7f49a0001e30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fabe008bed0 con 0x7fabdc03e840 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fabda7fc640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fabc8076140 0x7fabc8078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabe0006810 con 0x7fabc8076140 2024-04-14T09:58:48.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fabe008c2c0 con 0x7fabdc03e840 2024-04-14T09:58:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== osd.1 v2:172.21.15.40:6808/1198121083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f79a8006bb0 con 0x7f79a8001650 2024-04-14T09:58:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== osd.0 v2:172.21.15.40:6800/1123590082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b4c0bde50 con 0x7f3b30076140 2024-04-14T09:58:48.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f2205957640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f21e406c9c0 0x7f21e406ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00ab60 tx=0x7f21fc008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.064+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f50240760c0 0x7f5024078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7fabea5d3640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fabc8076140 0x7fabc8078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== osd.4 v2:172.21.15.136:6800/3007411045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4998078b80 con 0x7f4998076070 2024-04-14T09:58:48.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== osd.2 v2:172.21.15.40:6816/3712336313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f21f000ae50 con 0x7f21e4076140 2024-04-14T09:58:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7fabe95d1640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fabc806c9c0 0x7fabc806ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006090 tx=0x7fabd4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7fe4d18f0640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7fe4b0076070 0x7fe4b00784b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7fe4d20f1640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b006c8f0 0x7fe4b006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000f60 tx=0x7fe4c8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.065+0000 7f5044cbb640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f50240760c0 0x7f5024078500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.066+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== osd.5 v2:172.21.15.136:6816/265445102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe4c402cc80 con 0x7fe4b0076070 2024-04-14T09:58:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.066+0000 7fabea5d3640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fabc8076140 0x7fabc8078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.067+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== osd.6 v2:172.21.15.136:6808/829650642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5024078bd0 con 0x7f50240760c0 2024-04-14T09:58:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.067+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== osd.3 v2:172.21.15.40:6817/852135294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabe0006810 con 0x7fabc8076140 2024-04-14T09:58:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.096+0000 7f92c2f5e640 1 -- 172.21.15.40:0/2081360384 --> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f92bc160e70 con 0x7f92a00760b0 2024-04-14T09:58:48.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.096+0000 7f92b97fa640 1 -- 172.21.15.40:0/2081360384 <== osd.7 v2:172.21.15.136:6824/2810716504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f92bc160e70 con 0x7f92a00760b0 2024-04-14T09:58:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.097+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f92a00760b0 msgr2=0x7f92a00784f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.097+0000 7f92a6ffd640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f92a00760b0 0x7f92a00784f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.097+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f92a006c9c0 msgr2=0x7f92a006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.097+0000 7f92a6ffd640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f92a006c9c0 0x7f92a006ee80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f92bc1eccc0 tx=0x7f92a8009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 msgr2=0x7f92bc15cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 --2- 172.21.15.40:0/2081360384 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92bc0cf210 0x7f92bc15cbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000c00 tx=0x7f92b00046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92c14fb640 1 -- 172.21.15.40:0/2081360384 reap_dead start 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 shutdown_connections 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 >> 172.21.15.40:0/2081360384 conn(0x7f92bc08dce0 msgr2=0x7f92bc0d3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 --> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f79a8005c40 con 0x7f79a8001650 2024-04-14T09:58:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b440059c0 con 0x7f3b30076140 2024-04-14T09:58:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 --> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe4b4002d50 con 0x7fe4b0076070 2024-04-14T09:58:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 shutdown_connections 2024-04-14T09:58:48.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f92a6ffd640 1 -- 172.21.15.40:0/2081360384 wait complete. 2024-04-14T09:58:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.098+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 --> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49ac005390 con 0x7f4998076070 2024-04-14T09:58:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 --> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f21e8002dd0 con 0x7f21e4076140 2024-04-14T09:58:48.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7fe4c2ffd640 1 -- 172.21.15.40:0/2667555888 <== osd.5 v2:172.21.15.136:6816/265445102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe4b4002d50 con 0x7fe4b0076070 2024-04-14T09:58:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f79c4ff9640 1 -- 172.21.15.40:0/283309785 <== osd.1 v2:172.21.15.40:6808/1198121083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f79a8005c40 con 0x7f79a8001650 2024-04-14T09:58:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f499ffff640 1 -- 172.21.15.40:0/3193473440 <== osd.4 v2:172.21.15.136:6800/3007411045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49ac005390 con 0x7f4998076070 2024-04-14T09:58:48.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f3b48ff9640 1 -- 172.21.15.40:0/2021140862 <== osd.0 v2:172.21.15.40:6800/1123590082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b440059c0 con 0x7f3b30076140 2024-04-14T09:58:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f21f67fc640 1 -- 172.21.15.40:0/2424847485 <== osd.2 v2:172.21.15.40:6816/3712336313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f21e8002dd0 con 0x7f21e4076140 2024-04-14T09:58:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7f79a8001650 msgr2=0x7f79a8003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f79cd436640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7f79a8001650 0x7f79a8003b10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f79b406c9c0 msgr2=0x7f79b406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7f79cd436640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f79b406c9c0 0x7f79b406ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0011e0 tx=0x7f79bc007a00 comp rx=0 tx=0).stop 2024-04-14T09:58:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 --> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fabcc002dd0 con 0x7fabc8076140 2024-04-14T09:58:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7fe4b0076070 msgr2=0x7fe4b00784b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7fe4d4355640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7fe4b0076070 0x7fe4b00784b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.099+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b006c8f0 msgr2=0x7fe4b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7f3b30076140 msgr2=0x7f3b30078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7f3b30076140 0x7f3b30078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 msgr2=0x7f79c81ecd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 --2- 172.21.15.40:0/283309785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79c80cc730 0x7f79c81ecd60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79b800e820 tx=0x7f79b800ec20 comp rx=0 tx=0).stop 2024-04-14T09:58:48.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7f21e4076140 msgr2=0x7f21e4078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79ccc35640 1 -- 172.21.15.40:0/283309785 reap_dead start 2024-04-14T09:58:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7f21e4076140 0x7f21e4078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f4998076070 msgr2=0x7f49980784b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f4998076070 0x7f49980784b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 shutdown_connections 2024-04-14T09:58:48.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 >> 172.21.15.40:0/283309785 conn(0x7f79c80b20c0 msgr2=0x7f79c80b4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 --> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5038005390 con 0x7f50240760c0 2024-04-14T09:58:48.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f21e406c9c0 msgr2=0x7f21e406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f21e406c9c0 0x7f21e406ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00ab60 tx=0x7f21fc008040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d4355640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b006c8f0 0x7fe4b006edb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8000f60 tx=0x7fe4c8009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15f460 msgr2=0x7fe4cc0ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d4355640 1 --2- 172.21.15.40:0/2667555888 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15f460 0x7fe4cc0ae870 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe4c4033000 tx=0x7fe4c4004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3b3006c9c0 msgr2=0x7f3b3006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3b3006c9c0 0x7f3b3006ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3b40009e10 tx=0x7f3b400091c0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b44038f80 msgr2=0x7f3b440543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 msgr2=0x7f220009c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f499806c8f0 msgr2=0x7f499806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 --2- 172.21.15.40:0/2021140862 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b44038f80 0x7f3b440543a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c073ed0 tx=0x7f3b4c06b3e0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 --2- 172.21.15.40:0/2424847485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22000730e0 0x7f220009c3e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c490 tx=0x7f21f000c950 comp rx=0 tx=0).stop 2024-04-14T09:58:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f499806c8f0 0x7f499806edb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49a00010e0 tx=0x7f49a0001e30 comp rx=0 tx=0).stop 2024-04-14T09:58:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 shutdown_connections 2024-04-14T09:58:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206158640 1 -- 172.21.15.40:0/2424847485 reap_dead start 2024-04-14T09:58:48.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 msgr2=0x7f49ac0cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f79cd436640 1 -- 172.21.15.40:0/283309785 wait complete. 2024-04-14T09:58:48.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 --2- 172.21.15.40:0/3193473440 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f49ac0d8b20 0x7f49ac0cebd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f49ac053530 tx=0x7f49a800eba0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b524d1640 1 -- 172.21.15.40:0/2021140862 reap_dead start 2024-04-14T09:58:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 shutdown_connections 2024-04-14T09:58:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 >> 172.21.15.40:0/2021140862 conn(0x7f3b44053930 msgr2=0x7f3b44055340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fabda7fc640 1 -- 172.21.15.40:0/1319451102 <== osd.3 v2:172.21.15.40:6817/852135294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fabcc002dd0 con 0x7fabc8076140 2024-04-14T09:58:48.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d28f2640 1 -- 172.21.15.40:0/2667555888 reap_dead start 2024-04-14T09:58:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 shutdown_connections 2024-04-14T09:58:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 >> 172.21.15.40:0/2424847485 conn(0x7f220006b700 msgr2=0x7f22000b0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 shutdown_connections 2024-04-14T09:58:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 >> 172.21.15.40:0/2667555888 conn(0x7fe4cc0b1c50 msgr2=0x7fe4cc0b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b3fff640 1 -- 172.21.15.40:0/3193473440 reap_dead start 2024-04-14T09:58:48.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 shutdown_connections 2024-04-14T09:58:48.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 >> 172.21.15.40:0/3193473440 conn(0x7f49ac058fe0 msgr2=0x7f49ac03ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 shutdown_connections 2024-04-14T09:58:48.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 shutdown_connections 2024-04-14T09:58:48.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f49b8a66640 1 -- 172.21.15.40:0/3193473440 wait complete. 2024-04-14T09:58:48.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 shutdown_connections 2024-04-14T09:58:48.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.100+0000 7f2206959640 1 -- 172.21.15.40:0/2424847485 wait complete. 2024-04-14T09:58:48.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f503cff9640 1 -- 172.21.15.40:0/2702642630 <== osd.6 v2:172.21.15.136:6808/829650642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5038005390 con 0x7f50240760c0 2024-04-14T09:58:48.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 shutdown_connections 2024-04-14T09:58:48.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fe4d4355640 1 -- 172.21.15.40:0/2667555888 wait complete. 2024-04-14T09:58:48.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f3b5126f640 1 -- 172.21.15.40:0/2021140862 wait complete. 2024-04-14T09:58:48.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fabc8076140 msgr2=0x7fabc8078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fabc8076140 0x7fabc8078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fabc806c9c0 msgr2=0x7fabc806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fabc806c9c0 0x7fabc806ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fabdc006090 tx=0x7fabd4009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc03e840 msgr2=0x7fabdc1807d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 --2- 172.21.15.40:0/1319451102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fabdc03e840 0x7fabdc1807d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fabe000c610 tx=0x7fabe000cad0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabea5d3640 1 -- 172.21.15.40:0/1319451102 reap_dead start 2024-04-14T09:58:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 shutdown_connections 2024-04-14T09:58:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 >> 172.21.15.40:0/1319451102 conn(0x7fabdc0559e0 msgr2=0x7fabdc0076b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f50240760c0 msgr2=0x7f5024078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f50240760c0 0x7f5024078500 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 shutdown_connections 2024-04-14T09:58:48.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f502406c940 msgr2=0x7f502406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f502406c940 0x7f502406ee00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5034009af0 tx=0x7f5034008040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7fabeadd4640 1 -- 172.21.15.40:0/1319451102 wait complete. 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5038053c70 msgr2=0x7f503804bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f502a7fc640 1 --2- 172.21.15.40:0/2702642630 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5038053c70 0x7f503804bb90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f502c001cf0 tx=0x7f502c00a430 comp rx=0 tx=0).stop 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.101+0000 7f5044cbb640 1 -- 172.21.15.40:0/2702642630 reap_dead start 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.102+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 shutdown_connections 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.102+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 >> 172.21.15.40:0/2702642630 conn(0x7f5038009fb0 msgr2=0x7f50380d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.102+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 shutdown_connections 2024-04-14T09:58:48.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.102+0000 7f502a7fc640 1 -- 172.21.15.40:0/2702642630 wait complete. 2024-04-14T09:58:48.168 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2024-04-14T09:58:48.168 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T09:58:48.169 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:48.170 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T09:58:48.170 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:48.171 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.171 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T09:58:48.172 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T09:58:48.172 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.173 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T09:58:48.173 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2024-04-14T09:58:48.174 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T09:58:48.174 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T09:58:48.175 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:48.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T09:58:48.381 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.382+0000 7fe0ecc36640 1 Processor -- start 2024-04-14T09:58:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.381+0000 7f8b38c7c640 1 Processor -- start 2024-04-14T09:58:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.382+0000 7f8b38c7c640 1 -- start start 2024-04-14T09:58:48.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.382+0000 7fd55951e640 1 Processor -- start 2024-04-14T09:58:48.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.382+0000 7fd55951e640 1 -- start start 2024-04-14T09:58:48.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.382+0000 7fe0ecc36640 1 -- start start 2024-04-14T09:58:48.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7fc77359e640 1 Processor -- start 2024-04-14T09:58:48.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b38c7c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8b34072940 0x7f8b340aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b38c7c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b340af320 con 0x7f8b3415eb20 2024-04-14T09:58:48.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b38c7c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b340af600 con 0x7f8b340707c0 2024-04-14T09:58:48.384 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b38c7c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8b340aff30 con 0x7f8b34072940 2024-04-14T09:58:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7fd55951e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd554144bd0 0x7fd554072340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b33fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8b3415eb20 0x7f8b3415b290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40892/0 (socket says 172.21.15.40:40892) 2024-04-14T09:58:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7fd55951e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5540b33c0 0x7fd5540ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7f8b33fff640 1 -- 172.21.15.40:0/3168690852 learned_addr learned my addr 172.21.15.40:0/3168690852 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7fd55951e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd554073350 con 0x7fd5540b58b0 2024-04-14T09:58:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd67656d640 1 Processor -- start 2024-04-14T09:58:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd5537fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5540b33c0 0x7fd5540ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd5527fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd5540b58b0 0x7fd5540b2cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40898/0 (socket says 172.21.15.40:40898) 2024-04-14T09:58:48.387 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd5527fc640 1 -- 172.21.15.40:0/1186871484 learned_addr learned my addr 172.21.15.40:0/1186871484 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0ecc36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0e0055d00 0x7fe0e0036690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe1e2aa6640 1 Processor -- start 2024-04-14T09:58:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd5540ce760 con 0x7fd554144bd0 2024-04-14T09:58:48.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0ecc36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 0x7fe0e0006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd554072880 con 0x7fd5540b33c0 2024-04-14T09:58:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0e0055d00 0x7fe0e0036690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe0e0055d00 0x7fe0e0036690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51136/0 (socket says 172.21.15.40:51136) 2024-04-14T09:58:48.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 -- 172.21.15.40:0/1205412285 learned_addr learned my addr 172.21.15.40:0/1205412285 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357640225 0 0) 0x7f8b340af320 con 0x7f8b3415eb20 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b1c003520 con 0x7f8b3415eb20 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0e0036bd0 con 0x7fe0e00df760 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e0050140 con 0x7fe0e0006210 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe0e0006c20 con 0x7fe0e0055d00 2024-04-14T09:58:48.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd67656d640 1 -- start start 2024-04-14T09:58:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e6d9d640 1 --2- 172.21.15.40:0/1205412285 >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 0x7fe0e0006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 -- 172.21.15.40:0/1205412285 >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 msgr2=0x7fe0e0006620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 --2- 172.21.15.40:0/1205412285 >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 0x7fe0e0006620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 -- 172.21.15.40:0/1205412285 >> v1:172.21.15.40:6789/0 conn(0x7fe0e00df760 legacy=0x7fe0e004fa30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:58:48.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2292392145 0 0) 0x7f8b1c003520 con 0x7f8b3415eb20 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 >> v2:172.21.15.136:3300/0 conn(0x7f8b34072940 msgr2=0x7f8b340aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7f8b32ffd640 1 --2- 172.21.15.40:0/3168690852 >> v2:172.21.15.136:3300/0 conn(0x7f8b34072940 0x7f8b340aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.383+0000 7fc77359e640 1 -- start start 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fc77359e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc77406bc30 0x7fc7740b4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fc77359e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fc77359e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7740b3da0 con 0x7fc774162680 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fc77359e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc7740b43b0 con 0x7fc77406bc30 2024-04-14T09:58:48.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fc77359e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740ade20 con 0x7fc774070a10 2024-04-14T09:58:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 --2- 172.21.15.40:0/3168690852 >> v2:172.21.15.136:3300/0 conn(0x7f8b34072940 0x7f8b340aed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768997770 0 0) 0x7fd53c001110 con 0x7fd5540b58b0 2024-04-14T09:58:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd540005730 con 0x7fd5540b58b0 2024-04-14T09:58:48.393 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 >> v1:172.21.15.136:6789/0 conn(0x7f8b340707c0 legacy=0x7f8b34072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b34161e80 con 0x7f8b3415eb20 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2913769151 0 0) 0x7fd540005730 con 0x7fd5540b58b0 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5540b33c0 msgr2=0x7fd5540ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5540b33c0 0x7fd5540ceeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 >> v2:172.21.15.136:3300/0 conn(0x7fd554144bd0 msgr2=0x7fd554072340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 --2- 172.21.15.40:0/1186871484 >> v2:172.21.15.136:3300/0 conn(0x7fd554144bd0 0x7fd554072340 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd554072ab0 con 0x7fd5540b58b0 2024-04-14T09:58:48.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7fd53c001840 con 0x7fd5540b58b0 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 >> v1:172.21.15.40:6789/0 conn(0x7fd5540b58b0 legacy=0x7fd5540b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540005be0 0x7fd540006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540006a10 0x7fd540006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5400074f0 0x7fd54000dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd54000e2f0 con 0x7fd540006a10 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd540003550 con 0x7fd540005be0 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd540003750 con 0x7fd5400074f0 2024-04-14T09:58:48.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe0e659c640 1 -- 172.21.15.40:0/1205412285 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e0006f00 con 0x7fe0e0055d00 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fe0e6d9d640 1 --2- 172.21.15.40:0/1205412285 >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 0x7fe0e0006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f8b2c0019f0 con 0x7f8b3415eb20 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b32ffd640 1 --2- 172.21.15.40:0/3168690852 >> v2:172.21.15.136:3300/0 conn(0x7f8b34072940 0x7f8b340aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 >> v1:172.21.15.40:6789/0 conn(0x7f8b3415eb20 legacy=0x7f8b3415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b327fc640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004800 0x7f8b1c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b337fe640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7f8b32ffd640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004800 0x7f8b1c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f8b327fc640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0053c0 0x7f8b1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc772d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc772d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57074/0 (socket says 172.21.15.40:57074) 2024-04-14T09:58:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc772d9d640 1 -- 172.21.15.40:0/324164187 learned_addr learned my addr 172.21.15.40:0/324164187 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc771d9b640 1 --2- 172.21.15.40:0/324164187 >> v2:172.21.15.136:3300/0 conn(0x7fc77406bc30 0x7fc7740b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fde01b3a640 1 Processor -- start 2024-04-14T09:58:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fd67656d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd668050270 0x7fd6680506f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd67656d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd668039dd0 con 0x7fd6680398d0 2024-04-14T09:58:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540005be0 0x7fd540006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f9250abc640 1 Processor -- start 2024-04-14T09:58:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b340aff30 con 0x7f8b1c0053c0 2024-04-14T09:58:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c00c250 con 0x7f8b1c004800 2024-04-14T09:58:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f9250abc640 1 -- start start 2024-04-14T09:58:48.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c00c450 con 0x7f8b1c0039b0 2024-04-14T09:58:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.384+0000 7fe1e2aa6640 1 -- start start 2024-04-14T09:58:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fe1e2aa6640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe1d40069e0 0x7fe1d4006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd5537fe640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5540b33c0 0x7fd5540ceeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe0e659c640 1 --2- 172.21.15.40:0/1205412285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0055d00 0x7fe0e0036690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000dc50 tx=0x7fe0d802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684a2e921b47df6c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fe1e2aa6640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d4053720 con 0x7fe1d40ead00 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 -- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5400074f0 msgr2=0x7fd54000dbd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5400074f0 0x7fd54000dbd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 -- 172.21.15.40:0/1186871484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540006a10 msgr2=0x7fd540006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd540006a10 0x7fd540006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fe1e2aa6640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1d4053a00 con 0x7fe1d4005e90 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fe1e2aa6640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d4054330 con 0x7fe1d40069e0 2024-04-14T09:58:48.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe1e12a3640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe1d4005e90 0x7fe1d40062d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56366/0 (socket says 172.21.15.40:56366) 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe1e12a3640 1 -- 172.21.15.40:0/383072155 learned_addr learned my addr 172.21.15.40:0/383072155 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd552ffd640 1 -- 172.21.15.40:0/1186871484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd554072ab0 con 0x7fd540005be0 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd674d6a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd6680398d0 0x7fd66804fb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40936/0 (socket says 172.21.15.40:40936) 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd674d6a640 1 -- 172.21.15.40:0/3739986149 learned_addr learned my addr 172.21.15.40:0/3739986149 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66803a0b0 con 0x7fd6680dfec0 2024-04-14T09:58:48.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd66804f080 con 0x7fd668050270 2024-04-14T09:58:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc771d9b640 1 -- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 msgr2=0x7fc7740b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc771d9b640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc771d9b640 1 -- 172.21.15.40:0/324164187 >> v1:172.21.15.136:6789/0 conn(0x7fc774162680 legacy=0x7fc77406b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fc771d9b640 1 -- 172.21.15.40:0/324164187 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7740ae100 con 0x7fc77406bc30 2024-04-14T09:58:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe1e22a5640 1 --2- 172.21.15.40:0/383072155 >> v2:172.21.15.40:3300/0 conn(0x7fe1d40069e0 0x7fe1d4006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fc772d9d640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe0e559a640 1 -- 172.21.15.40:0/1205412285 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8034070 con 0x7fe0e0055d00 2024-04-14T09:58:48.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.386+0000 7fe0e559a640 1 -- 172.21.15.40:0/1205412285 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d8030860 con 0x7fe0e0055d00 2024-04-14T09:58:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fc771d9b640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bc30 0x7fc7740b4840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009d90 tx=0x7fc76c02bd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbaa5ffbee618720 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fe1e22a5640 1 -- 172.21.15.40:0/383072155 >> v1:172.21.15.136:6789/0 conn(0x7fe1d4005e90 legacy=0x7fe1d40062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b33fff640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0053c0 0x7f8b1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fc77159a640 1 -- 172.21.15.40:0/324164187 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c039070 con 0x7fc77406bc30 2024-04-14T09:58:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fe0e559a640 1 -- 172.21.15.40:0/1205412285 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8030c30 con 0x7fe0e0055d00 2024-04-14T09:58:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b337fe640 1 -- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004800 msgr2=0x7f8b1c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b337fe640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b1c004800 0x7f8b1c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fc77159a640 1 -- 172.21.15.40:0/324164187 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c02ca30 con 0x7fc77406bc30 2024-04-14T09:58:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b337fe640 1 -- 172.21.15.40:0/3168690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0053c0 msgr2=0x7f8b1c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b337fe640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b1c0053c0 0x7f8b1c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b33fff640 1 -- 172.21.15.40:0/3168690852 reap_dead start 2024-04-14T09:58:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f9250abc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c15a2e0 0x7f924c073110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f8b337fe640 1 -- 172.21.15.40:0/3168690852 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c003520 con 0x7f8b1c0039b0 2024-04-14T09:58:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408372248 0 0) 0x7fd668039dd0 con 0x7fd6680398d0 2024-04-14T09:58:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd65c005730 con 0x7fd6680398d0 2024-04-14T09:58:48.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd675d6c640 1 --2- 172.21.15.40:0/3739986149 >> v2:172.21.15.136:3300/0 conn(0x7fd668050270 0x7fd6680506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1608135200 0 0) 0x7fd66803a0b0 con 0x7fd6680dfec0 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd65c005a90 con 0x7fd6680dfec0 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0055d00 msgr2=0x7fe0e0036690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/1205412285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0055d00 0x7fe0e0036690 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0e000dc50 tx=0x7fe0d802b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.385+0000 7fde01b3a640 1 -- start start 2024-04-14T09:58:48.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01b3a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fddfc15fea0 0x7fddfc0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01b3a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 0x7fddfc0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01b3a640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc163a20 con 0x7fddfc160280 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01b3a640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fddfc162c60 con 0x7fddfc166a10 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01b3a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fddfc162f40 con 0x7fddfc15fea0 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3596306539 0 0) 0x7fd65c005730 con 0x7fd6680398d0 2024-04-14T09:58:48.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 >> v2:172.21.15.136:3300/0 conn(0x7fd668050270 msgr2=0x7fd6680506f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 --2- 172.21.15.40:0/3739986149 >> v2:172.21.15.136:3300/0 conn(0x7fd668050270 0x7fd6680506f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 >> v1:172.21.15.136:6789/0 conn(0x7fd6680dfec0 legacy=0x7fd668052600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540005be0 0x7fd540006020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd544009e60 tx=0x7fd540007a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=550a821f75a1196f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f9250abc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f924c06c080 0x7f924c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7f9250abc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924c0af430 con 0x7f924c0aefa0 2024-04-14T09:58:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66804f360 con 0x7fd6680398d0 2024-04-14T09:58:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 shutdown_connections 2024-04-14T09:58:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/1205412285 >> v2:172.21.15.40:3300/0 conn(0x7fe0e0006210 0x7fe0e0006620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/1205412285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0055d00 0x7fe0e0036690 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 >> 172.21.15.40:0/1205412285 conn(0x7fe0e001e6b0 msgr2=0x7fe0e00553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.387+0000 7fde01339640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 0x7fddfc0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde01339640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 0x7fddfc0ca7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55014/0 (socket says 172.21.15.40:55014) 2024-04-14T09:58:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7fd66c001650 con 0x7fd6680398d0 2024-04-14T09:58:48.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde01339640 1 -- 172.21.15.40:0/791698988 learned_addr learned my addr 172.21.15.40:0/791698988 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f924affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f924c0aefa0 0x7f924c06b970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40954/0 (socket says 172.21.15.40:40954) 2024-04-14T09:58:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f924affd640 1 -- 172.21.15.40:0/3819443833 learned_addr learned my addr 172.21.15.40:0/3819443833 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f924c0af710 con 0x7f924c06c080 2024-04-14T09:58:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f924c15aae0 con 0x7f924c15a2e0 2024-04-14T09:58:48.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544039070 con 0x7fd540005be0 2024-04-14T09:58:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 >> v1:172.21.15.40:6789/0 conn(0x7fd6680398d0 legacy=0x7fd66804fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54402cdb0 con 0x7fd540005be0 2024-04-14T09:58:48.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 shutdown_connections 2024-04-14T09:58:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c005f70 0x7fd65c006350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f924bfff640 1 --2- 172.21.15.40:0/3819443833 >> v2:172.21.15.136:3300/0 conn(0x7f924c06c080 0x7f924c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd551ffb640 1 -- 172.21.15.40:0/1186871484 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544039070 con 0x7fd540005be0 2024-04-14T09:58:48.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65c006a10 0x7fd65c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 -- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bc30 msgr2=0x7fc7740b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bc30 0x7fc7740b4840 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009d90 tx=0x7fc76c02bd00 comp rx=0 tx=0).stop 2024-04-14T09:58:48.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 0x7fd65c0143d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd66804f080 con 0x7fd65c005f70 2024-04-14T09:58:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd65c014ba0 con 0x7fd65c007440 2024-04-14T09:58:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd65c014da0 con 0x7fd65c006a10 2024-04-14T09:58:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe1e0aa2640 1 -- 172.21.15.40:0/383072155 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261256391 0 0) 0x7fe1d4053a00 con 0x7fe1d4005e90 2024-04-14T09:58:48.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd674d6a640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65c006a10 0x7fd65c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe1e22a5640 1 -- 172.21.15.40:0/383072155 >> v1:172.21.15.40:6789/0 conn(0x7fe1d40ead00 legacy=0x7fe1d404fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe1e22a5640 1 -- 172.21.15.40:0/383072155 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d4053ce0 con 0x7fe1d40069e0 2024-04-14T09:58:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 -- 172.21.15.40:0/324164187 shutdown_connections 2024-04-14T09:58:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774070a10 0x7fc7740b4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 --2- 172.21.15.40:0/324164187 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc77406bc30 0x7fc7740b4840 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fc77359e640 1 -- 172.21.15.40:0/324164187 >> 172.21.15.40:0/324164187 conn(0x7fc7740d0eb0 msgr2=0x7fc7740d12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7f924b7fe640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c15a2e0 0x7f924c073110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7f924bfff640 1 -- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c15a2e0 msgr2=0x7f924c073110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fe0ecc36640 1 -- 172.21.15.40:0/1205412285 wait complete. 2024-04-14T09:58:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7f924bfff640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c15a2e0 0x7f924c073110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7f924bfff640 1 -- 172.21.15.40:0/3819443833 >> v1:172.21.15.40:6789/0 conn(0x7f924c0aefa0 legacy=0x7f924c06b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7f924bfff640 1 -- 172.21.15.40:0/3819443833 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c15adc0 con 0x7f924c06c080 2024-04-14T09:58:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde00b38640 1 --2- 172.21.15.40:0/791698988 >> v2:172.21.15.136:3300/0 conn(0x7fddfc15fea0 0x7fddfc0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde00b38640 1 -- 172.21.15.40:0/791698988 >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 msgr2=0x7fddfc0ca7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde00b38640 1 --2- 172.21.15.40:0/791698988 >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 0x7fddfc0ca7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde00b38640 1 -- 172.21.15.40:0/791698988 >> v1:172.21.15.40:6789/0 conn(0x7fddfc160280 legacy=0x7fddfc166300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fde00b38640 1 -- 172.21.15.40:0/791698988 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc163220 con 0x7fddfc15fea0 2024-04-14T09:58:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540005be0 msgr2=0x7fd540006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd55951e640 1 --2- 172.21.15.40:0/1186871484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd540005be0 0x7fd540006020 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd544009e60 tx=0x7fd540007a40 comp rx=0 tx=0).stop 2024-04-14T09:58:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fc77359e640 1 -- 172.21.15.40:0/324164187 shutdown_connections 2024-04-14T09:58:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fc77359e640 1 -- 172.21.15.40:0/324164187 wait complete. 2024-04-14T09:58:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd5537fe640 1 -- 172.21.15.40:0/1186871484 reap_dead start 2024-04-14T09:58:48.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.388+0000 7fd675d6c640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 0x7fd65c0143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7f8b337fe640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001860 tx=0x7f8b1c005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41d1d0e4e48c99a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 shutdown_connections 2024-04-14T09:58:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 >> 172.21.15.40:0/1186871484 conn(0x7fd55406e6c0 msgr2=0x7fd55406eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 shutdown_connections 2024-04-14T09:58:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd67556b640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c005f70 0x7fd65c006350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd675d6c640 1 -- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65c006a10 msgr2=0x7fd65c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd675d6c640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65c006a10 0x7fd65c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd675d6c640 1 -- 172.21.15.40:0/3739986149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c005f70 msgr2=0x7fd65c006350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:48.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd675d6c640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c005f70 0x7fd65c006350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fe1e22a5640 1 --2- 172.21.15.40:0/383072155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4006e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097a0 tx=0x7fe1cc02b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1322d8265df225 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fd55951e640 1 -- 172.21.15.40:0/1186871484 wait complete. 2024-04-14T09:58:48.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.389+0000 7fd675d6c640 1 -- 172.21.15.40:0/3739986149 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66804f360 con 0x7fd65c007440 2024-04-14T09:58:48.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fd67556b640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c005f70 0x7fd65c006350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24038070 con 0x7f8b1c0039b0 2024-04-14T09:58:48.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b24033410 con 0x7f8b1c0039b0 2024-04-14T09:58:48.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f8b327fc640 1 -- 172.21.15.40:0/3168690852 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24001430 con 0x7f8b1c0039b0 2024-04-14T09:58:48.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fde00b38640 1 --2- 172.21.15.40:0/791698988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc15fea0 0x7fddfc0ca2a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0cd7d0 tx=0x7fddec02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c793cafe51a4bcb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.428 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f924bfff640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c15dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f924400b160 tx=0x7f924402c140 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9effb28d4e4a740a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fd674d6a640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd65c006a10 0x7fd65c006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fe1e0aa2640 1 -- 172.21.15.40:0/383072155 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc039070 con 0x7fe1d40069e0 2024-04-14T09:58:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fe1e0aa2640 1 -- 172.21.15.40:0/383072155 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1cc0316f0 con 0x7fe1d40069e0 2024-04-14T09:58:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fe1e0aa2640 1 -- 172.21.15.40:0/383072155 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1cc031ac0 con 0x7fe1d40069e0 2024-04-14T09:58:48.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fe0ecc36640 1 Processor -- start 2024-04-14T09:58:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fddfb7fe640 1 -- 172.21.15.40:0/791698988 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec037070 con 0x7fddfc15fea0 2024-04-14T09:58:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fe0ecc36640 1 -- start start 2024-04-14T09:58:48.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fddfb7fe640 1 -- 172.21.15.40:0/791698988 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec030710 con 0x7fddfc15fea0 2024-04-14T09:58:48.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f924a7fc640 1 -- 172.21.15.40:0/3819443833 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244039070 con 0x7f924c06c080 2024-04-14T09:58:48.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f924a7fc640 1 -- 172.21.15.40:0/3819443833 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9244034440 con 0x7f924c06c080 2024-04-14T09:58:48.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7f924a7fc640 1 -- 172.21.15.40:0/3819443833 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244034810 con 0x7f924c06c080 2024-04-14T09:58:48.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fddfb7fe640 1 -- 172.21.15.40:0/791698988 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec030ae0 con 0x7fddfc15fea0 2024-04-14T09:58:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.390+0000 7fd675d6c640 1 -- 172.21.15.40:0/3739986149 reap_dead start 2024-04-14T09:58:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fc77359e640 1 Processor -- start 2024-04-14T09:58:48.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 -- 172.21.15.40:0/791698988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc15fea0 msgr2=0x7fddfc0ca2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/383072155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 msgr2=0x7fe1d4006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/383072155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4006e50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1cc0097a0 tx=0x7fe1cc02b810 comp rx=0 tx=0).stop 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 --2- 172.21.15.40:0/791698988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc15fea0 0x7fddfc0ca2a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0cd7d0 tx=0x7fddec02b710 comp rx=0 tx=0).stop 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/383072155 shutdown_connections 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/383072155 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4006e50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.433 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/383072155 >> 172.21.15.40:0/383072155 conn(0x7fe1d4009fb0 msgr2=0x7fe1d400a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 msgr2=0x7f924c15dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c15dea0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f924400b160 tx=0x7f924402c140 comp rx=0 tx=0).stop 2024-04-14T09:58:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fc77359e640 1 -- start start 2024-04-14T09:58:48.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 -- 172.21.15.40:0/791698988 shutdown_connections 2024-04-14T09:58:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 shutdown_connections 2024-04-14T09:58:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 --2- 172.21.15.40:0/791698988 >> v2:172.21.15.40:3300/0 conn(0x7fddfc166a10 0x7fddfc0ca7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 --2- 172.21.15.40:0/791698988 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc15fea0 0x7fddfc0ca2a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.435 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c15dea0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 --2- 172.21.15.40:0/3819443833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c15a2e0 0x7f924c073110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 -- 172.21.15.40:0/791698988 >> 172.21.15.40:0/791698988 conn(0x7fddfc06b520 msgr2=0x7fddfc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 -- 172.21.15.40:0/791698988 shutdown_connections 2024-04-14T09:58:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7fde01b3a640 1 -- 172.21.15.40:0/791698988 wait complete. 2024-04-14T09:58:48.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 >> 172.21.15.40:0/3819443833 conn(0x7f924c0b1c70 msgr2=0x7f924c0b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f8b38c7c640 1 -- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 msgr2=0x7f8b1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001860 tx=0x7f8b1c005830 comp rx=0 tx=0).stop 2024-04-14T09:58:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f8b38c7c640 1 -- 172.21.15.40:0/3168690852 shutdown_connections 2024-04-14T09:58:48.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/383072155 shutdown_connections 2024-04-14T09:58:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0006210 0x7fe0e0178cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 shutdown_connections 2024-04-14T09:58:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7f9250abc640 1 -- 172.21.15.40:0/3819443833 wait complete. 2024-04-14T09:58:48.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/3168690852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b1c003d90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.391+0000 7f8b38c7c640 1 -- 172.21.15.40:0/3168690852 >> 172.21.15.40:0/3168690852 conn(0x7f8b340d0de0 msgr2=0x7f8b340d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 0x7fe0e017cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd675d6c640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 0x7fd65c0143d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd670050610 tx=0x7fd65c007a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70e022fb52b391e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00560e0 con 0x7fe0e00df760 2024-04-14T09:58:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe0e00074c0 con 0x7fe0e0006210 2024-04-14T09:58:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe0ecc36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe0e00dfbd0 con 0x7fe0e0055d00 2024-04-14T09:58:48.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd55951e640 1 Processor -- start 2024-04-14T09:58:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c007c60 con 0x7fd65c007440 2024-04-14T09:58:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/383072155 wait complete. 2024-04-14T09:58:48.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd55951e640 1 -- start start 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6700ab070 con 0x7fd65c007440 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 0x7fc774151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 0x7fc774150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774162680 0x7fc7740cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc774162be0 con 0x7fc77406bc30 2024-04-14T09:58:48.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc774162a60 con 0x7fc774070a10 2024-04-14T09:58:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77359e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc7740aefc0 con 0x7fc774162680 2024-04-14T09:58:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fd667fff640 1 -- 172.21.15.40:0/3739986149 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c007c60 con 0x7fd65c007440 2024-04-14T09:58:48.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7f8b38c7c640 1 -- 172.21.15.40:0/3168690852 shutdown_connections 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc77259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 0x7fc774151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc771d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 0x7fc774150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7fc771d9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 0x7fc774150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51238/0 (socket says 172.21.15.40:51238) 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc771d9b640 1 -- 172.21.15.40:0/2971583704 learned_addr learned my addr 172.21.15.40:0/2971583704 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fde01b3a640 1 Processor -- start 2024-04-14T09:58:48.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fde01b3a640 1 -- start start 2024-04-14T09:58:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fe1e2aa6640 1 Processor -- start 2024-04-14T09:58:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fe1e2aa6640 1 -- start start 2024-04-14T09:58:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc77259c640 1 -- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774162680 msgr2=0x7fc7740cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 msgr2=0x7fd65c0143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc77259c640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774162680 0x7fc7740cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc77259c640 1 -- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 msgr2=0x7fc774150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc77259c640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 0x7fc774150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fc77259c640 1 -- 172.21.15.40:0/2971583704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc774151630 con 0x7fc77406bc30 2024-04-14T09:58:48.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fd67656d640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 0x7fd65c0143d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd670050610 tx=0x7fd65c007a40 comp rx=0 tx=0).stop 2024-04-14T09:58:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 0x7fd5541408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7f9250abc640 1 Processor -- start 2024-04-14T09:58:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 shutdown_connections 2024-04-14T09:58:48.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd67656d640 1 --2- 172.21.15.40:0/3739986149 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd65c007440 0x7fd65c0143d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 >> 172.21.15.40:0/3739986149 conn(0x7fd668009fb0 msgr2=0x7fd66800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 0x7fd554140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 0x7fd55413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 shutdown_connections 2024-04-14T09:58:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7f9250abc640 1 -- start start 2024-04-14T09:58:48.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd67656d640 1 -- 172.21.15.40:0/3739986149 wait complete. 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5540ce990 con 0x7fd55415a370 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd554073070 con 0x7fd55415a750 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd552ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 0x7fd5541408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd55951e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd5540b5d10 con 0x7fd55413d9b0 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd552ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 0x7fd5541408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55040/0 (socket says 172.21.15.40:55040) 2024-04-14T09:58:48.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd552ffd640 1 -- 172.21.15.40:0/1680792439 learned_addr learned my addr 172.21.15.40:0/1680792439 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.392+0000 7f8b38c7c640 1 -- 172.21.15.40:0/3168690852 wait complete. 2024-04-14T09:58:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7f8b38c7c640 1 Processor -- start 2024-04-14T09:58:48.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fc77259c640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 0x7fc774151c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c760 tx=0x7fc76400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fde01b3a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 0x7fddfc0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fde01b3a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 0x7fddfc0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd5537fe640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 0x7fd55413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde00b38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 0x7fddfc0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde00b38640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 0x7fddfc0b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55046/0 (socket says 172.21.15.40:55046) 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde00b38640 1 -- 172.21.15.40:0/3947784696 learned_addr learned my addr 172.21.15.40:0/3947784696 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddfc166a10 0x7fddfc1608d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fddfbfff640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 0x7fddfc0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc14b750 con 0x7fddfc15fea0 2024-04-14T09:58:48.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc14b5d0 con 0x7fddfc160280 2024-04-14T09:58:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fddfc14b8d0 con 0x7fddfc166a10 2024-04-14T09:58:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f9250abc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f9250abc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 0x7f924c14d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fe1e2aa6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fe1e2aa6640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4034930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fd5527fc640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 0x7fd554140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 -- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 msgr2=0x7fd554140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 0x7fd554140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 -- 172.21.15.40:0/1680792439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 msgr2=0x7fd5541408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 0x7fd5541408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 -- 172.21.15.40:0/1680792439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd55413e770 con 0x7fd55413d9b0 2024-04-14T09:58:48.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5527fc640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 0x7fd554140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fd5537fe640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 0x7fd55413de40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd554050230 tx=0x7fd54c00c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f9250abc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 0x7f924c0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc764017070 con 0x7fc77406bc30 2024-04-14T09:58:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc764005270 con 0x7fc77406bc30 2024-04-14T09:58:48.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76400a860 con 0x7fc77406bc30 2024-04-14T09:58:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f9250abc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f924c0cf570 con 0x7f924c15a2e0 2024-04-14T09:58:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f9250abc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f924c0cf3f0 con 0x7f924c06c080 2024-04-14T09:58:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f9250abc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f924c15a6c0 con 0x7f924c14dd20 2024-04-14T09:58:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f924affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 0x7f924c14d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7f924b7fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f924affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 0x7f924c14d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55054/0 (socket says 172.21.15.40:55054) 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f924affd640 1 -- 172.21.15.40:0/2040351117 learned_addr learned my addr 172.21.15.40:0/2040351117 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f924bfff640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 0x7f924c0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7f8b38c7c640 1 -- start start 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b3415d760 0x7f8b340c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b3415a7e0 0x7f8b340c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c022070 con 0x7fd55413d9b0 2024-04-14T09:58:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b340aed20 con 0x7f8b3415d760 2024-04-14T09:58:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b340afbc0 con 0x7f8b3415a7e0 2024-04-14T09:58:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b38c7c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8b340aeea0 con 0x7f8b1c0039b0 2024-04-14T09:58:48.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e1aa4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b337fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e1aa4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51268/0 (socket says 172.21.15.40:51268) 2024-04-14T09:58:48.460 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b337fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57170/0 (socket says 172.21.15.40:57170) 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b337fe640 1 -- 172.21.15.40:0/2398893371 learned_addr learned my addr 172.21.15.40:0/2398893371 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fde01339640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddfc166a10 0x7fddfc1608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 -- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddfc166a10 msgr2=0x7fddfc1608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddfc166a10 0x7fddfc1608d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 -- 172.21.15.40:0/3947784696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 msgr2=0x7fddfc0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 0x7fddfc0b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc13e770 con 0x7fddfc160280 2024-04-14T09:58:48.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd67656d640 1 Processor -- start 2024-04-14T09:58:48.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f8b33fff640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b3415a7e0 0x7f8b340c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd67656d640 1 -- start start 2024-04-14T09:58:48.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fddfbfff640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 0x7fddfc0b4950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddf400caf0 tx=0x7fddf40020a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f924b7fe640 1 -- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 msgr2=0x7f924c0ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7f924b7fe640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 0x7f924c0ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.393+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e659c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0006210 0x7fe0e0178cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55030/0 (socket says 172.21.15.40:55030) 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f924b7fe640 1 -- 172.21.15.40:0/2040351117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 msgr2=0x7f924c14d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 -- 172.21.15.40:0/3057670285 learned_addr learned my addr 172.21.15.40:0/3057670285 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e5d9b640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 0x7fe0e017cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 -- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 msgr2=0x7fe0e017cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f924b7fe640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 0x7f924c14d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 0x7fe0e017cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 -- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0006210 msgr2=0x7fe0e0178cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0006210 0x7fe0e0178cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e6d9d640 1 -- 172.21.15.40:0/3057670285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0e017d260 con 0x7fe0e00df760 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.394+0000 7fe0e5d9b640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 0x7fe0e017cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.395+0000 7fe0e6d9d640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8073ed0 tx=0x7fe0e80759a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f924b7fe640 1 -- 172.21.15.40:0/2040351117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c157350 con 0x7f924c06c080 2024-04-14T09:58:48.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd54c015de0 con 0x7fd55413d9b0 2024-04-14T09:58:48.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd55951e640 1 -- 172.21.15.40:0/1680792439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd55413ea50 con 0x7fd55413d9b0 2024-04-14T09:58:48.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fd55951e640 1 -- 172.21.15.40:0/1680792439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd55413f010 con 0x7fd55413d9b0 2024-04-14T09:58:48.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd54c022070 con 0x7fd55413d9b0 2024-04-14T09:58:48.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f924bfff640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 0x7f924c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:48.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f8b337fe640 1 -- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b3415a7e0 msgr2=0x7f8b340c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f8b337fe640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b3415a7e0 0x7f8b340c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e1aa4640 1 -- 172.21.15.40:0/3369592497 learned_addr learned my addr 172.21.15.40:0/3369592497 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1d40ead00 0x7fe1d404d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f8b337fe640 1 -- 172.21.15.40:0/2398893371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b3415d760 msgr2=0x7f8b340c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f8b337fe640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b3415d760 0x7f8b340c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7f8b337fe640 1 -- 172.21.15.40:0/2398893371 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b340c8070 con 0x7f8b1c0039b0 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40547c0 con 0x7fe1d40069e0 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d40501a0 con 0x7fe1d4005e90 2024-04-14T09:58:48.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d4054940 con 0x7fe1d40ead00 2024-04-14T09:58:48.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e22a5640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1d40ead00 0x7fe1d404d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.396+0000 7fe1e12a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4034930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8094a50 con 0x7fe0e00df760 2024-04-14T09:58:48.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8098030 con 0x7fe0e00df760 2024-04-14T09:58:48.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fc77359e640 1 -- 172.21.15.40:0/2971583704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7741533c0 con 0x7fc77406bc30 2024-04-14T09:58:48.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fc77359e640 1 -- 172.21.15.40:0/2971583704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc774153980 con 0x7fc77406bc30 2024-04-14T09:58:48.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e806c6a0 con 0x7fe0e00df760 2024-04-14T09:58:48.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e1aa4640 1 -- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1d40ead00 msgr2=0x7fe1d404d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e1aa4640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1d40ead00 0x7fe1d404d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e1aa4640 1 -- 172.21.15.40:0/3369592497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 msgr2=0x7fe1d4034930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0e004fec0 con 0x7fe0e00df760 2024-04-14T09:58:48.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fd55951e640 1 -- 172.21.15.40:0/1680792439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd554075760 con 0x7fd55413d9b0 2024-04-14T09:58:48.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd67656d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 0x7fd66804ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0e0179610 con 0x7fe0e00df760 2024-04-14T09:58:48.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd67656d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 0x7fd6680daf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd67656d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6680d8240 0x7fd6680d86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7f924b7fe640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c156e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f923c007e60 tx=0x7f923c00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd674d6a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 0x7fd6680daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e1aa4640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4034930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e1aa4640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d4049f50 con 0x7fe1d4005e90 2024-04-14T09:58:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.397+0000 7fe1e12a3640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4034930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fe1e1aa4640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc074810 tx=0x7fe1dc068ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc06c8a0 con 0x7fe1d4005e90 2024-04-14T09:58:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1dc08f030 con 0x7fe1d4005e90 2024-04-14T09:58:48.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd674d6a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 0x7fd6680daf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57194/0 (socket says 172.21.15.40:57194) 2024-04-14T09:58:48.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd674d6a640 1 -- 172.21.15.40:0/2212813102 learned_addr learned my addr 172.21.15.40:0/2212813102 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:48.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd67556b640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 0x7fd66804ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fd675d6c640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6680d8240 0x7fd6680d86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc06cd80 con 0x7fe1d4005e90 2024-04-14T09:58:48.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d404cd40 con 0x7fe1d4005e90 2024-04-14T09:58:48.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd668054350 con 0x7fd65c007440 2024-04-14T09:58:48.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6680e02a0 con 0x7fd6680d8240 2024-04-14T09:58:48.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d4034e70 con 0x7fe1d4005e90 2024-04-14T09:58:48.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd6680544d0 con 0x7fd6680daac0 2024-04-14T09:58:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c014620 con 0x7f924c06c080 2024-04-14T09:58:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.398+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f923c019070 con 0x7f924c06c080 2024-04-14T09:58:48.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7f8b337fe640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001950 tx=0x7f8b24001230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd54c005990 con 0x7fd55413d9b0 2024-04-14T09:58:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fc77359e640 1 -- 172.21.15.40:0/2971583704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc77409f100 con 0x7fc77406bc30 2024-04-14T09:58:48.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0e00057d0 con 0x7fe0e00df760 2024-04-14T09:58:48.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd54b7fe640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 0x7fd53406f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67556b640 1 -- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 msgr2=0x7fd6680daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd54c015be0 con 0x7fd55413d9b0 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf4017070 con 0x7fddfc160280 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf4003da0 con 0x7fddfc160280 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67556b640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 0x7fd6680daf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67556b640 1 -- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6680d8240 msgr2=0x7fd6680d86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fd67556b640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6680d8240 0x7fd6680d86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fd67556b640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6680d9000 con 0x7fd65c007440 2024-04-14T09:58:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.399+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf40052f0 con 0x7fddfc160280 2024-04-14T09:58:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc0b2a60 con 0x7fddfc160280 2024-04-14T09:58:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc0b3020 con 0x7fddfc160280 2024-04-14T09:58:48.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fd67556b640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 0x7fd66804ac00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d820 tx=0x7fd66000dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 0x7fd53406f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f923c0149e0 con 0x7f924c06c080 2024-04-14T09:58:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924c0ae010 con 0x7f924c06c080 2024-04-14T09:58:48.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc76401a070 con 0x7fc77406bc30 2024-04-14T09:58:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924c0ae5d0 con 0x7f924c06c080 2024-04-14T09:58:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0e806c840 con 0x7fe0e00df760 2024-04-14T09:58:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.400+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d4005390 con 0x7fe1d4005e90 2024-04-14T09:58:48.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1dc0748d0 con 0x7fe1d4005e90 2024-04-14T09:58:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fd552ffd640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 0x7fd53406f1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd544009460 tx=0x7fd544030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fc762ffd640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 0x7fc75406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe0d6ffd640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 0x7fe0c806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe0e810ee20 con 0x7fe0e00df760 2024-04-14T09:58:48.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe1d27fc640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 0x7fe1c006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc76408b200 con 0x7fc77406bc30 2024-04-14T09:58:48.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe0e659c640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 0x7fe0c806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe1dc106620 con 0x7fe1d4005e90 2024-04-14T09:58:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc0756f0 con 0x7fddfc160280 2024-04-14T09:58:48.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.401+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924c09e0f0 con 0x7f924c06c080 2024-04-14T09:58:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fddf401a070 con 0x7fddfc160280 2024-04-14T09:58:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fe1e12a3640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 0x7fe1c006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fe0e659c640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 0x7fe0c806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8036000 tx=0x7fe0d803b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fddf97fa640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 0x7fdde806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fddf408b5b0 con 0x7fddfc160280 2024-04-14T09:58:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fe1e12a3640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 0x7fe1c006ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40ea1f0 tx=0x7fe1d801a040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.402+0000 7fde00b38640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 0x7fdde806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7fc771d9b640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 0x7fc75406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7fde00b38640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 0x7fdde806ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fddec009560 tx=0x7fddec008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24043030 con 0x7f8b1c0039b0 2024-04-14T09:58:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7fc771d9b640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 0x7fc75406ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc774070140 tx=0x7fc76c030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b24039040 con 0x7f8b1c0039b0 2024-04-14T09:58:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b3415fb60 con 0x7f8b1c0039b0 2024-04-14T09:58:48.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24038070 con 0x7f8b1c0039b0 2024-04-14T09:58:48.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd54c060c90 con 0x7fd55413d9b0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.403+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b34160120 con 0x7f8b1c0039b0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.404+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b340756f0 con 0x7f8b1c0039b0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.405+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b24046070 con 0x7f8b1c0039b0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.405+0000 7f8b1bfff640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 0x7f8b2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.405+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b240acc60 con 0x7f8b1c0039b0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.405+0000 7f8b32ffd640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 0x7f8b2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.406+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc764058d10 con 0x7fc77406bc30 2024-04-14T09:58:48.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.406+0000 7f8b32ffd640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 0x7f8b2006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b28006df0 tx=0x7f8b28006d80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.406+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660016070 con 0x7fd65c007440 2024-04-14T09:58:48.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.406+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6680d6b50 con 0x7fd65c007440 2024-04-14T09:58:48.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.406+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6680d7110 con 0x7fd65c007440 2024-04-14T09:58:48.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.408+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd668005390 con 0x7fd65c007440 2024-04-14T09:58:48.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.409+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe1dc0d4660 con 0x7fe1d4005e90 2024-04-14T09:58:48.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.410+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8b2407a790 con 0x7f8b1c0039b0 2024-04-14T09:58:48.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.410+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f923c014b80 con 0x7f924c06c080 2024-04-14T09:58:48.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.411+0000 7f9243fff640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 0x7f922c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.411+0000 7f924affd640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 0x7f922c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.412+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd66000b8b0 con 0x7fd65c007440 2024-04-14T09:58:48.495 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.412+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660020060 con 0x7fd65c007440 2024-04-14T09:58:48.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.412+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe0e017d260 con 0x7fe0e00df760 2024-04-14T09:58:48.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.413+0000 7f924affd640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 0x7f922c06ee00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f924c0cd560 tx=0x7f9234009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.496 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.413+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f923c058fe0 con 0x7f924c06c080 2024-04-14T09:58:48.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.414+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd660019070 con 0x7fd65c007440 2024-04-14T09:58:48.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.414+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fddf40590c0 con 0x7fddfc160280 2024-04-14T09:58:48.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.414+0000 7fd665ffb640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:48.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.415+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd66008c2c0 con 0x7fd65c007440 2024-04-14T09:58:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.417+0000 7fd674d6a640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.417+0000 7fd674d6a640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 0x7fd65406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001050 tx=0x7fd66c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.418+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f923c05af40 con 0x7f924c06c080 2024-04-14T09:58:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.421+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd66005a280 con 0x7fd65c007440 2024-04-14T09:58:48.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.837+0000 7fd55951e640 1 -- 172.21.15.40:0/1680792439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fd554070c70 con 0x7fd55413d9b0 2024-04-14T09:58:48.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.837+0000 7fd54b7fe640 1 -- 172.21.15.40:0/1680792439 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd54c064f90 con 0x7fd55413d9b0 2024-04-14T09:58:48.837 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:48.840 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8b3415f890 con 0x7f8b1c0039b0 2024-04-14T09:58:48.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 msgr2=0x7fd53406f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.841 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 0x7fd53406f1e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd544009460 tx=0x7fd544030000 comp rx=0 tx=0).stop 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 msgr2=0x7fd55413de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 0x7fd55413de40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd554050230 tx=0x7fd54c00c750 comp rx=0 tx=0).stop 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 shutdown_connections 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd53406cd20 0x7fd53406f1e0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd544009460 tx=0x7fd544030000 comp rx=0 tx=0).stop 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd55413d9b0 0x7fd55413de40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fc77359e640 1 -- 172.21.15.40:0/2971583704 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc7740d0c90 con 0x7fc77406bc30 2024-04-14T09:58:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd55415a750 0x7fd554140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.841+0000 7fd5497fa640 1 --2- 172.21.15.40:0/1680792439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd55415a370 0x7fd5541408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.842+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 >> 172.21.15.40:0/1680792439 conn(0x7fd55406e6c0 msgr2=0x7fd5540b42c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.843 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.842+0000 7f8b1bfff640 1 -- 172.21.15.40:0/2398893371 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b2407ea90 con 0x7f8b1c0039b0 2024-04-14T09:58:48.843 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2024-04-14T09:58:48.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.842+0000 7fc762ffd640 1 -- 172.21.15.40:0/2971583704 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc76405d010 con 0x7fc77406bc30 2024-04-14T09:58:48.844 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 shutdown_connections 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fd5497fa640 1 -- 172.21.15.40:0/1680792439 wait complete. 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 msgr2=0x7f8b2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 0x7f8b2006edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8b28006df0 tx=0x7f8b28006d80 comp rx=0 tx=0).stop 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 msgr2=0x7f8b3415a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b24001950 tx=0x7f8b24001230 comp rx=0 tx=0).stop 2024-04-14T09:58:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 msgr2=0x7fc75406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 shutdown_connections 2024-04-14T09:58:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b2006c8f0 0x7f8b2006edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 0x7fc75406ee80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc774070140 tx=0x7fc76c030000 comp rx=0 tx=0).stop 2024-04-14T09:58:48.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b3415a7e0 0x7f8b340c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b3415d760 0x7f8b340c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 --2- 172.21.15.40:0/2398893371 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b1c0039b0 0x7f8b3415a2a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 >> 172.21.15.40:0/2398893371 conn(0x7f8b340d0de0 msgr2=0x7f8b340d11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.847 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 msgr2=0x7fc774151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.845+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 0x7fc774151c90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c760 tx=0x7fc76400cc20 comp rx=0 tx=0).stop 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 shutdown_connections 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7f8b38c7c640 1 -- 172.21.15.40:0/2398893371 wait complete. 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 shutdown_connections 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc75406c9c0 0x7fc75406ee80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc774162680 0x7fc7740cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc774070a10 0x7fc774150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 --2- 172.21.15.40:0/2971583704 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc77406bc30 0x7fc774151c90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fddfc162a40 con 0x7fddfc160280 2024-04-14T09:58:48.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 >> 172.21.15.40:0/2971583704 conn(0x7fc7740d0eb0 msgr2=0x7fc77406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.846+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 shutdown_connections 2024-04-14T09:58:48.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.847+0000 7fc760ff9640 1 -- 172.21.15.40:0/2971583704 wait complete. 2024-04-14T09:58:48.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.847+0000 7fddf97fa640 1 -- 172.21.15.40:0/3947784696 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fddf405d3c0 con 0x7fddfc160280 2024-04-14T09:58:48.850 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.847+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe0e0055150 con 0x7fe0e00df760 2024-04-14T09:58:48.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.848+0000 7fe0d6ffd640 1 -- 172.21.15.40:0/3057670285 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe0e80dcef0 con 0x7fe0e00df760 2024-04-14T09:58:48.851 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2024-04-14T09:58:48.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 msgr2=0x7fdde806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 0x7fdde806ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fddec009560 tx=0x7fddec008030 comp rx=0 tx=0).stop 2024-04-14T09:58:48.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 msgr2=0x7fddfc0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 0x7fddfc0b4950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fddf400caf0 tx=0x7fddf40020a0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.850+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe1d4006370 con 0x7fe1d4005e90 2024-04-14T09:58:48.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 shutdown_connections 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fdde806c9c0 0x7fdde806ee80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fddfc166a10 0x7fddfc1608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fddfc160280 0x7fddfc0b4950 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 --2- 172.21.15.40:0/3947784696 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fddfc15fea0 0x7fddfc0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.851+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 >> 172.21.15.40:0/3947784696 conn(0x7fddfc06b520 msgr2=0x7fddfc072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 shutdown_connections 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fde01b3a640 1 -- 172.21.15.40:0/3947784696 wait complete. 2024-04-14T09:58:48.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe1d27fc640 1 -- 172.21.15.40:0/3369592497 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1dc0d3f60 con 0x7fe1d4005e90 2024-04-14T09:58:48.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 msgr2=0x7fe0c806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 0x7fe0c806ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8036000 tx=0x7fe0d803b040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 msgr2=0x7fe0e004f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8073ed0 tx=0x7fe0e80759a0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 shutdown_connections 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe0c806c9c0 0x7fe0c806ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe0e00df760 0x7fe0e004f980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe0e0055d00 0x7fe0e017cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 --2- 172.21.15.40:0/3057670285 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe0e0006210 0x7fe0e0178cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 >> 172.21.15.40:0/3057670285 conn(0x7fe0e001e6b0 msgr2=0x7fe0e00502c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.858 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.852+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 shutdown_connections 2024-04-14T09:58:48.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.853+0000 7fe0ecc36640 1 -- 172.21.15.40:0/3057670285 wait complete. 2024-04-14T09:58:48.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f924c04f940 con 0x7f924c06c080 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 msgr2=0x7fe1c006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 0x7fe1c006ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe1d40ea1f0 tx=0x7fe1d801a040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 msgr2=0x7fe1d40dc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc074810 tx=0x7fe1dc068ff0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 shutdown_connections 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.856+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1c006c9c0 0x7fe1c006ee80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1d40ead00 0x7fe1d404d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1d40069e0 0x7fe1d4034930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 --2- 172.21.15.40:0/3369592497 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1d4005e90 0x7fe1d40dc6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 >> 172.21.15.40:0/3369592497 conn(0x7fe1d4009fb0 msgr2=0x7fe1d404aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7f9243fff640 1 -- 172.21.15.40:0/2040351117 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f923c05f240 con 0x7f924c06c080 2024-04-14T09:58:48.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd66804ec50 con 0x7fd65c007440 2024-04-14T09:58:48.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 shutdown_connections 2024-04-14T09:58:48.862 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fe1e2aa6640 1 -- 172.21.15.40:0/3369592497 wait complete. 2024-04-14T09:58:48.863 INFO:teuthology.orchestra.run.smithi040.stdout:55834574856 2024-04-14T09:58:48.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.857+0000 7fd665ffb640 1 -- 172.21.15.40:0/2212813102 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd66008c080 con 0x7fd65c007440 2024-04-14T09:58:48.864 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:48.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 msgr2=0x7f922c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 0x7f922c06ee00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f924c0cd560 tx=0x7f9234009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 msgr2=0x7f924c156e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c156e10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f923c007e60 tx=0x7f923c00e4b0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 msgr2=0x7fd65406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 0x7fd65406edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd66c001050 tx=0x7fd66c009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 msgr2=0x7fd66804ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:48.867 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 0x7fd66804ac00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd66000d820 tx=0x7fd66000dce0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 shutdown_connections 2024-04-14T09:58:48.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f922c06c940 0x7f922c06ee00 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f924c0cd560 tx=0x7f9234009040 comp rx=0 tx=0).stop 2024-04-14T09:58:48.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f924c14dd20 0x7f924c0ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.868 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f924c15a2e0 0x7f924c14d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 --2- 172.21.15.40:0/2040351117 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f924c06c080 0x7f924c156e10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.861+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 >> 172.21.15.40:0/2040351117 conn(0x7f924c0b1c70 msgr2=0x7f924c0d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.862+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 shutdown_connections 2024-04-14T09:58:48.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.862+0000 7f9250abc640 1 -- 172.21.15.40:0/2040351117 wait complete. 2024-04-14T09:58:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 shutdown_connections 2024-04-14T09:58:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd65406c8f0 0x7fd65406edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd6680d8240 0x7fd6680d86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd6680daac0 0x7fd6680daf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 --2- 172.21.15.40:0/2212813102 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd65c007440 0x7fd66804ac00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 >> 172.21.15.40:0/2212813102 conn(0x7fd668009fb0 msgr2=0x7fd6680d3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 shutdown_connections 2024-04-14T09:58:48.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:48.863+0000 7fd67656d640 1 -- 172.21.15.40:0/2212813102 wait complete. 2024-04-14T09:58:48.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.1 2024-04-14T09:58:48.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2024-04-14T09:58:48.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.5 2024-04-14T09:58:48.877 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-14T09:58:48.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2024-04-14T09:58:48.879 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-14T09:58:48.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-14T09:58:48.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.6 2024-04-14T09:58:49.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-14T09:58:49.875 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-14T09:58:49.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-14T09:58:49.878 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-14T09:58:49.879 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-14T09:58:49.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-14T09:58:49.881 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-14T09:58:49.883 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-14T09:58:50.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.040+0000 7f6bb5fcb640 1 Processor -- start 2024-04-14T09:58:50.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7f6bb5fcb640 1 -- start start 2024-04-14T09:58:50.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7f6bb5fcb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7680 0x7f6ba8052c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7f6bb5fcb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ba804a3d0 0x7f6ba8038740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7f6bb5fcb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ba8051bb0 con 0x7f6ba80e7a60 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7f6bb5fcb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6ba80527c0 con 0x7f6ba804a3d0 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7f6bb5fcb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba8051e90 con 0x7f6ba80e7680 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6bb57ca640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6ba80e7a60 0x7f6ba8007bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40960/0 (socket says 172.21.15.40:40960) 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ba804a3d0 0x7f6ba8038740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6ba804a3d0 0x7f6ba8038740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51310/0 (socket says 172.21.15.40:51310) 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 -- 172.21.15.40:0/1761329807 learned_addr learned my addr 172.21.15.40:0/1761329807 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6bb4fc9640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7680 0x7f6ba8052c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 -- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7680 msgr2=0x7f6ba8052c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7680 0x7f6ba8052c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 -- 172.21.15.40:0/1761329807 >> v1:172.21.15.40:6789/0 conn(0x7f6ba80e7a60 legacy=0x7f6ba8007bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.044+0000 7f6baffff640 1 -- 172.21.15.40:0/1761329807 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba8052170 con 0x7f6ba804a3d0 2024-04-14T09:58:50.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.040+0000 7fa01bbfa640 1 Processor -- start 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.040+0000 7fa01bbfa640 1 -- start start 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7fa01bbfa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c050210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7fa01bbfa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa00c048f50 0x7fa00c006b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7fa01bbfa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa00c050b80 con 0x7fa00c007060 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7fa01bbfa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa00c0074d0 con 0x7fa00c048f50 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.041+0000 7fa01bbfa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c050e60 con 0x7fa00c0e7730 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.042+0000 7fa019195640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa00c048f50 0x7fa00c006b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.042+0000 7fa019195640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa00c048f50 0x7fa00c006b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51300/0 (socket says 172.21.15.40:51300) 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.042+0000 7fa019195640 1 -- 172.21.15.40:0/3771130967 learned_addr learned my addr 172.21.15.40:0/3771130967 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7fa019195640 1 -- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 msgr2=0x7fa00c050210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7fa019195640 1 --2- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c050210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7fa019195640 1 -- 172.21.15.40:0/3771130967 >> v1:172.21.15.40:6789/0 conn(0x7fa00c007060 legacy=0x7fa00c0eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.043+0000 7fa019195640 1 -- 172.21.15.40:0/3771130967 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c051140 con 0x7fa00c048f50 2024-04-14T09:58:50.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.045+0000 7fa019195640 1 --2- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c048f50 0x7fa00c006b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa014069c20 tx=0x7fa0140a6f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=422050e9a6c2795 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.045+0000 7fa018994640 1 -- 172.21.15.40:0/3771130967 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140b4070 con 0x7fa00c048f50 2024-04-14T09:58:50.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.045+0000 7fa018994640 1 -- 172.21.15.40:0/3771130967 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0140a7db0 con 0x7fa00c048f50 2024-04-14T09:58:50.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.045+0000 7fa018994640 1 -- 172.21.15.40:0/3771130967 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0140af640 con 0x7fa00c048f50 2024-04-14T09:58:50.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.046+0000 7f6baffff640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba8038740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009870 tx=0x7f6ba402b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8280756d7542fe server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.046+0000 7f6baf7fe640 1 -- 172.21.15.40:0/1761329807 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4034070 con 0x7f6ba804a3d0 2024-04-14T09:58:50.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.046+0000 7f6baf7fe640 1 -- 172.21.15.40:0/1761329807 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ba4030860 con 0x7f6ba804a3d0 2024-04-14T09:58:50.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 msgr2=0x7f6ba8038740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7f6bb5fcb640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba8038740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4009870 tx=0x7f6ba402b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.046+0000 7fa01bbfa640 1 -- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c048f50 msgr2=0x7fa00c006b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.046+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c048f50 0x7fa00c006b20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa014069c20 tx=0x7fa0140a6f00 comp rx=0 tx=0).stop 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 -- 172.21.15.40:0/3771130967 shutdown_connections 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c048f50 0x7fa00c006b20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/3771130967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c050210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 -- 172.21.15.40:0/3771130967 >> 172.21.15.40:0/3771130967 conn(0x7fa00c055bc0 msgr2=0x7fa00c055fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 -- 172.21.15.40:0/3771130967 shutdown_connections 2024-04-14T09:58:50.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.047+0000 7fa01bbfa640 1 -- 172.21.15.40:0/3771130967 wait complete. 2024-04-14T09:58:50.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.048+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/1761329807 shutdown_connections 2024-04-14T09:58:50.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.048+0000 7f6bb5fcb640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba8038740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.048+0000 7f6bb5fcb640 1 --2- 172.21.15.40:0/1761329807 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7680 0x7f6ba8052c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.048+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/1761329807 >> 172.21.15.40:0/1761329807 conn(0x7f6ba8053740 msgr2=0x7f6ba8053b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.048+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/1761329807 shutdown_connections 2024-04-14T09:58:50.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.049+0000 7fa01bbfa640 1 Processor -- start 2024-04-14T09:58:50.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.049+0000 7fa01bbfa640 1 -- start start 2024-04-14T09:58:50.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.049+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/1761329807 wait complete. 2024-04-14T09:58:50.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.050+0000 7f6bb5fcb640 1 Processor -- start 2024-04-14T09:58:50.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.051+0000 7fa01bbfa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.051+0000 7fa01bbfa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.051+0000 7fa019996640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.051+0000 7fa019996640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51318/0 (socket says 172.21.15.40:51318) 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7fa019195640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7fa019195640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55088/0 (socket says 172.21.15.40:55088) 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7fa019996640 1 -- 172.21.15.40:0/2298806006 learned_addr learned my addr 172.21.15.40:0/2298806006 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c0d3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.051+0000 7f6bb5fcb640 1 -- start start 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba80cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 0x7f6ba80d4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8053190 con 0x7f6ba80e7680 2024-04-14T09:58:50.054 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba8055be0 con 0x7f6ba804a3d0 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb5fcb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba80517d0 con 0x7f6ba80e7a60 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6bb57ca640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 0x7f6ba80d4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6baffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6baffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55104/0 (socket says 172.21.15.40:55104) 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.052+0000 7f6baffff640 1 -- 172.21.15.40:0/2191965425 learned_addr learned my addr 172.21.15.40:0/2191965425 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb4fc9640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba80cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c050750 con 0x7fa00c048f50 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb57ca640 1 -- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 msgr2=0x7f6ba80cd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb57ca640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba80cd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb57ca640 1 -- 172.21.15.40:0/2191965425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 msgr2=0x7f6ba80cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb57ca640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6bb57ca640 1 -- 172.21.15.40:0/2191965425 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba80509b0 con 0x7f6ba80e7a60 2024-04-14T09:58:50.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7f6baffff640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:50.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa00c051700 con 0x7fa00c007060 2024-04-14T09:58:50.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.053+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa00c0508d0 con 0x7fa00c0e7730 2024-04-14T09:58:50.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019996640 1 -- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 msgr2=0x7fa00c0d3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa01a197640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c0d3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7f6bb57ca640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 0x7f6ba80d4950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0064ff0 tx=0x7f6bb00759a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019996640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c0d3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019996640 1 -- 172.21.15.40:0/2298806006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 msgr2=0x7fa00c04b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019996640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019996640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa00c0da670 con 0x7fa00c007060 2024-04-14T09:58:50.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0069a10 con 0x7f6ba80e7a60 2024-04-14T09:58:50.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.054+0000 7fa019195640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:50.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7fa019996640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa00400b410 tx=0x7fa00400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/2191965425 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba804a7b0 con 0x7f6ba80e7a60 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/2191965425 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba804ad70 con 0x7f6ba80e7a60 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bb008f020 con 0x7f6ba80e7a60 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0074d20 con 0x7f6ba80e7a60 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004015020 con 0x7fa00c007060 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa004011830 con 0x7fa00c007060 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa00c0d9dd0 con 0x7fa00c007060 2024-04-14T09:58:50.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.055+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa00c0da390 con 0x7fa00c007060 2024-04-14T09:58:50.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.057+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bb0074f80 con 0x7f6ba80e7a60 2024-04-14T09:58:50.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.057+0000 7f6bad7fa640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 0x7f6b9406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.058+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6bb0106570 con 0x7f6ba80e7a60 2024-04-14T09:58:50.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.058+0000 7f6bb4fc9640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 0x7f6b9406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.058+0000 7f6bb4fc9640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 0x7f6b9406eeb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c006fd0 tx=0x7f6b9c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.058+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa004011c20 con 0x7fa00c007060 2024-04-14T09:58:50.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.060+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa004018020 con 0x7fa00c007060 2024-04-14T09:58:50.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.060+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/2191965425 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba8053560 con 0x7f6ba80e7a60 2024-04-14T09:58:50.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.060+0000 7fa00a7fc640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 0x7f9ff806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.061+0000 7fa019195640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 0x7f9ff806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.061+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa00408bdd0 con 0x7fa00c007060 2024-04-14T09:58:50.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.061+0000 7fa019195640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 0x7f9ff806edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c550 tx=0x7fa0140ab000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.062+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc005290 con 0x7fa00c007060 2024-04-14T09:58:50.065 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.065+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6ba8053560 con 0x7f6ba80e7a60 2024-04-14T09:58:50.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.071+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa00401f020 con 0x7fa00c007060 2024-04-14T09:58:50.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.094+0000 7f877c80f640 1 Processor -- start 2024-04-14T09:58:50.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.094+0000 7f877c80f640 1 -- start start 2024-04-14T09:58:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f877c80f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f87780afd80 0x7f87780748d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f877c80f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f877c80f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877815b780 con 0x7f877806e820 2024-04-14T09:58:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f877c80f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f877815bd40 con 0x7f87780afd80 2024-04-14T09:58:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f877c80f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f877815ba60 con 0x7f877815ae10 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57230/0 (socket says 172.21.15.40:57230) 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f8776d9d640 1 -- 172.21.15.40:0/2593835089 learned_addr learned my addr 172.21.15.40:0/2593835089 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.096+0000 7f8775d9b640 1 --2- 172.21.15.40:0/2593835089 >> v2:172.21.15.136:3300/0 conn(0x7f87780afd80 0x7f87780748d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7f8776d9d640 1 -- 172.21.15.40:0/2593835089 >> v2:172.21.15.136:3300/0 conn(0x7f87780afd80 msgr2=0x7f87780748d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7f8776d9d640 1 --2- 172.21.15.40:0/2593835089 >> v2:172.21.15.136:3300/0 conn(0x7f87780afd80 0x7f87780748d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7f8776d9d640 1 -- 172.21.15.40:0/2593835089 >> v1:172.21.15.136:6789/0 conn(0x7f877806e820 legacy=0x7f877815ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7f8776d9d640 1 -- 172.21.15.40:0/2593835089 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877815e530 con 0x7f877815ae10 2024-04-14T09:58:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7ff057c36640 1 Processor -- start 2024-04-14T09:58:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.097+0000 7f1d6615e640 1 Processor -- start 2024-04-14T09:58:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.098+0000 7f1d595cb640 1 Processor -- start 2024-04-14T09:58:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.098+0000 7f1d595cb640 1 -- start start 2024-04-14T09:58:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.098+0000 7ff057c36640 1 -- start start 2024-04-14T09:58:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.098+0000 7f1d6615e640 1 -- start start 2024-04-14T09:58:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.098+0000 7f8776d9d640 1 --2- 172.21.15.40:0/2593835089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f877806c2f0 tx=0x7f877002bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78620d08f9052354 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f877559a640 1 -- 172.21.15.40:0/2593835089 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770003b90 con 0x7f877815ae10 2024-04-14T09:58:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f877559a640 1 -- 172.21.15.40:0/2593835089 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770003d30 con 0x7f877815ae10 2024-04-14T09:58:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f877559a640 1 -- 172.21.15.40:0/2593835089 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877002d8e0 con 0x7f877815ae10 2024-04-14T09:58:50.100 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d595cb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d595cb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d4c006fe0 0x7f1d4c03a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d595cb640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c032d20 con 0x7f1d4c008d10 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d595cb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c033930 con 0x7f1d4c006fe0 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d595cb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c033000 con 0x7f1d4c008930 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f877c80f640 1 -- 172.21.15.40:0/2593835089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 msgr2=0x7f87780b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57238/0 (socket says 172.21.15.40:57238) 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7f1d53fff640 1 -- 172.21.15.40:0/3840848286 learned_addr learned my addr 172.21.15.40:0/3840848286 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.099+0000 7ff057c36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff048057d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff057c36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff04803e830 0x7ff048053be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff057c36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff048054120 0x7ff0480e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff057c36640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff0480582c0 con 0x7ff048054120 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff057c36640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff048058560 con 0x7ff04803e830 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff057c36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff048058840 con 0x7ff0480e30b0 2024-04-14T09:58:50.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff048054120 0x7ff0480e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff048054120 0x7ff0480e6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55114/0 (socket says 172.21.15.40:55114) 2024-04-14T09:58:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 -- 172.21.15.40:0/2585180547 learned_addr learned my addr 172.21.15.40:0/2585180547 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f877c80f640 1 --2- 172.21.15.40:0/2593835089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f877806c2f0 tx=0x7f877002bb20 comp rx=0 tx=0).stop 2024-04-14T09:58:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0559d2640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff048057d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 -- 172.21.15.40:0/2585180547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 msgr2=0x7ff048057d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff048057d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 -- 172.21.15.40:0/2585180547 >> v2:172.21.15.136:3300/0 conn(0x7ff04803e830 msgr2=0x7ff048053be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 --2- 172.21.15.40:0/2585180547 >> v2:172.21.15.136:3300/0 conn(0x7ff04803e830 0x7ff048053be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7ff0561d3640 1 -- 172.21.15.40:0/2585180547 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff048058b20 con 0x7ff048054120 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d5f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1d6013d6b0 0x7f1d600cfea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56386/0 (socket says 172.21.15.40:56386) 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d5f7fe640 1 -- 172.21.15.40:0/2064385644 learned_addr learned my addr 172.21.15.40:0/2064385644 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:50.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d6615e640 1 --2- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d53fff640 1 -- 172.21.15.40:0/3840848286 >> v2:172.21.15.136:3300/0 conn(0x7f1d4c006fe0 msgr2=0x7f1d4c03a910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:58:50.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d53fff640 1 --2- 172.21.15.40:0/3840848286 >> v2:172.21.15.136:3300/0 conn(0x7f1d4c006fe0 0x7f1d4c03a910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d53fff640 1 -- 172.21.15.40:0/3840848286 >> v1:172.21.15.136:6789/0 conn(0x7f1d4c008d10 legacy=0x7f1d4c033dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-14T09:58:50.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.100+0000 7f1d53fff640 1 -- 172.21.15.40:0/3840848286 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0332e0 con 0x7f1d4c008930 2024-04-14T09:58:50.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 -- 172.21.15.40:0/2593835089 shutdown_connections 2024-04-14T09:58:50.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 --2- 172.21.15.40:0/2593835089 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f87780b41e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 --2- 172.21.15.40:0/2593835089 >> v2:172.21.15.136:3300/0 conn(0x7f87780afd80 0x7f87780748d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 -- 172.21.15.40:0/2593835089 >> 172.21.15.40:0/2593835089 conn(0x7f877806b520 msgr2=0x7f877806b900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6015ac70 con 0x7f1d6013fe00 2024-04-14T09:58:50.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 -- 172.21.15.40:0/2593835089 shutdown_connections 2024-04-14T09:58:50.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f877c80f640 1 -- 172.21.15.40:0/2593835089 wait complete. 2024-04-14T09:58:50.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6013e4c0 con 0x7f1d6013d6b0 2024-04-14T09:58:50.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d6013da90 con 0x7f1d60071a40 2024-04-14T09:58:50.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 274874781 0 0) 0x7f1d6013e4c0 con 0x7f1d6013d6b0 2024-04-14T09:58:50.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.101+0000 7ff0561d3640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480e6c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff050069c20 tx=0x7ff0500a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a023000633da5b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d48004630 con 0x7f1d6013d6b0 2024-04-14T09:58:50.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7ff0549d0640 1 -- 172.21.15.40:0/2585180547 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500b4070 con 0x7ff048054120 2024-04-14T09:58:50.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7ff0549d0640 1 -- 172.21.15.40:0/2585180547 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0500a7e10 con 0x7ff048054120 2024-04-14T09:58:50.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614013589 0 0) 0x7f1d6015ac70 con 0x7f1d6013fe00 2024-04-14T09:58:50.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6013e4c0 con 0x7f1d6013fe00 2024-04-14T09:58:50.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7ff0549d0640 1 -- 172.21.15.40:0/2585180547 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0500af640 con 0x7ff048054120 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d53fff640 1 --2- 172.21.15.40:0/3840848286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800f9b0 tx=0x7f1d4802fdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8997ddae7c83cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d52ffd640 1 -- 172.21.15.40:0/3840848286 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4803d070 con 0x7f1d4c008930 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d52ffd640 1 -- 172.21.15.40:0/3840848286 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d48030b70 con 0x7f1d4c008930 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d52ffd640 1 -- 172.21.15.40:0/3840848286 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48038440 con 0x7f1d4c008930 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5ffff640 1 -- 172.21.15.40:0/2064385644 >> v1:172.21.15.136:6789/0 conn(0x7f1d6013d6b0 legacy=0x7f1d600cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5ffff640 1 -- 172.21.15.40:0/2064385644 >> v1:172.21.15.40:6789/0 conn(0x7f1d6013fe00 legacy=0x7f1d6013ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.102+0000 7f1d5ffff640 1 -- 172.21.15.40:0/2064385644 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d601403e0 con 0x7f1d60071a40 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 -- 172.21.15.40:0/2585180547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 msgr2=0x7ff0480e6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480e6c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff050069c20 tx=0x7ff0500a6f60 comp rx=0 tx=0).stop 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 -- 172.21.15.40:0/2585180547 shutdown_connections 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480e6c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 --2- 172.21.15.40:0/2585180547 >> v2:172.21.15.136:3300/0 conn(0x7ff04803e830 0x7ff048053be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 --2- 172.21.15.40:0/2585180547 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff048057d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 -- 172.21.15.40:0/2585180547 >> 172.21.15.40:0/2585180547 conn(0x7ff0480559d0 msgr2=0x7ff048055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 -- 172.21.15.40:0/2585180547 shutdown_connections 2024-04-14T09:58:50.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60071ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009dc0 tx=0x7f1d5802bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a30cc8a6ae0b57 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7ff057c36640 1 -- 172.21.15.40:0/2585180547 wait complete. 2024-04-14T09:58:50.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58039070 con 0x7f1d60071a40 2024-04-14T09:58:50.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d5802cce0 con 0x7f1d60071a40 2024-04-14T09:58:50.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f1d5e7fc640 1 -- 172.21.15.40:0/2064385644 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58034640 con 0x7f1d60071a40 2024-04-14T09:58:50.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f1d595cb640 1 -- 172.21.15.40:0/3840848286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 msgr2=0x7f1d4c006aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f1d595cb640 1 --2- 172.21.15.40:0/3840848286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800f9b0 tx=0x7f1d4802fdc0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f056e02d640 1 Processor -- start 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f056e02d640 1 -- start start 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f877c80f640 1 Processor -- start 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.103+0000 7f877c80f640 1 -- start start 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f877c80f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f877806e820 0x7f8778151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f877c80f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 0x7f87780d0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 msgr2=0x7f1d60071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.104+0000 7f1d6615e640 1 --2- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60071ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1d58009dc0 tx=0x7f1d5802bf30 comp rx=0 tx=0).stop 2024-04-14T09:58:50.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 -- 172.21.15.40:0/3840848286 shutdown_connections 2024-04-14T09:58:50.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 --2- 172.21.15.40:0/3840848286 >> v2:172.21.15.136:3300/0 conn(0x7f1d4c006fe0 0x7f1d4c03a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 --2- 172.21.15.40:0/3840848286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c006aa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 -- 172.21.15.40:0/3840848286 >> 172.21.15.40:0/3840848286 conn(0x7f1d4c01ef30 msgr2=0x7f1d4c055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 shutdown_connections 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d6615e640 1 --2- 172.21.15.40:0/2064385644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60071ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 >> 172.21.15.40:0/2064385644 conn(0x7f1d60067230 msgr2=0x7f1d60067610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f056e02d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0560007530 0x7f0560053820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f056e02d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 0x7f0560053d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f056e02d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05600eb300 con 0x7f0560055470 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f056e02d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f05600eb5e0 con 0x7f056000d3e0 2024-04-14T09:58:50.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f056e02d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f05600eb8c0 con 0x7f0560007530 2024-04-14T09:58:50.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7ff057c36640 1 Processor -- start 2024-04-14T09:58:50.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 shutdown_connections 2024-04-14T09:58:50.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 -- 172.21.15.40:0/3840848286 shutdown_connections 2024-04-14T09:58:50.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7ff057c36640 1 -- start start 2024-04-14T09:58:50.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f877c80f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f8778155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f0567fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 0x7f0560053d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f0567fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 0x7f0560053d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55134/0 (socket says 172.21.15.40:55134) 2024-04-14T09:58:50.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f0567fff640 1 -- 172.21.15.40:0/2538032456 learned_addr learned my addr 172.21.15.40:0/2538032456 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d6615e640 1 -- 172.21.15.40:0/2064385644 wait complete. 2024-04-14T09:58:50.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f877c80f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8778074e10 con 0x7f87780afd80 2024-04-14T09:58:50.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f0566ffd640 1 --2- 172.21.15.40:0/2538032456 >> v2:172.21.15.136:3300/0 conn(0x7f0560007530 0x7f0560053820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f8778155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f8778155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57278/0 (socket says 172.21.15.40:57278) 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f8776d9d640 1 -- 172.21.15.40:0/3936271261 learned_addr learned my addr 172.21.15.40:0/3936271261 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f877659c640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f877806e820 0x7f8778151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 0x7f87780d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87780b0210 con 0x7f877806e820 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8778074f90 con 0x7f877815ae10 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f0566ffd640 1 -- 172.21.15.40:0/2538032456 >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 msgr2=0x7f0560053d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f0566ffd640 1 --2- 172.21.15.40:0/2538032456 >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 0x7f0560053d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f0566ffd640 1 -- 172.21.15.40:0/2538032456 >> v1:172.21.15.136:6789/0 conn(0x7f0560055470 legacy=0x7f05600517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f0566ffd640 1 -- 172.21.15.40:0/2538032456 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05600ebba0 con 0x7f0560007530 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 -- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 msgr2=0x7f8778155720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f8778155720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 -- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f877806e820 msgr2=0x7f8778151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f877806e820 0x7f8778151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7f8775d9b640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87780cf260 con 0x7f87780afd80 2024-04-14T09:58:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.105+0000 7f1d595cb640 1 -- 172.21.15.40:0/3840848286 wait complete. 2024-04-14T09:58:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f1d595cb640 1 Processor -- start 2024-04-14T09:58:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f8775d9b640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 0x7f87780d0300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f876801f650 tx=0x7f876801fb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.106+0000 7ff057c36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 0x7ff0480d9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff057c36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff057c36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff0480e16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff057c36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff0480e3490 con 0x7ff048054120 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff057c36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff04803bfb0 con 0x7ff04803e830 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff057c36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff0480e7160 con 0x7ff0480e30b0 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f0566ffd640 1 --2- 172.21.15.40:0/2538032456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560007530 0x7f0560053820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056000d330 tx=0x7f055c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b81347a6133f71fd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f1d6615e640 1 Processor -- start 2024-04-14T09:58:50.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff0551d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff0551d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55142/0 (socket says 172.21.15.40:55142) 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff0551d1640 1 -- 172.21.15.40:0/4040385851 learned_addr learned my addr 172.21.15.40:0/4040385851 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff0559d2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 0x7ff0480d9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f1d6615e640 1 -- start start 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7ff0561d3640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff0480e16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0559d2640 1 -- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 msgr2=0x7ff0480e16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0559d2640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff0480e16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0559d2640 1 -- 172.21.15.40:0/4040385851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 msgr2=0x7ff0480de510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8768028070 con 0x7f87780afd80 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87780cf540 con 0x7f87780afd80 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87780cfb00 con 0x7f87780afd80 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f876801d940 con 0x7f87780afd80 2024-04-14T09:58:50.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f876801dd30 con 0x7f87780afd80 2024-04-14T09:58:50.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0559d2640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0559d2640 1 -- 172.21.15.40:0/4040385851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0480d6af0 con 0x7ff04803e830 2024-04-14T09:58:50.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7ff0551d1640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.107+0000 7f1d595cb640 1 -- start start 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c0da760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 0x7f1d4c0d8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c03b710 con 0x7f1d4c008d10 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c03b590 con 0x7f1d4c006fe0 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f1d595cb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c032820 con 0x7f1d4c008930 2024-04-14T09:58:50.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d6615e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51390/0 (socket says 172.21.15.40:51390) 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 -- 172.21.15.40:0/836117025 learned_addr learned my addr 172.21.15.40:0/836117025 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f05667fc640 1 -- 172.21.15.40:0/2538032456 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c035020 con 0x7f0560007530 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f05667fc640 1 -- 172.21.15.40:0/2538032456 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f055c031830 con 0x7f0560007530 2024-04-14T09:58:50.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f05667fc640 1 -- 172.21.15.40:0/2538032456 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f055c031c00 con 0x7f0560007530 2024-04-14T09:58:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f86f851e640 1 Processor -- start 2024-04-14T09:58:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.108+0000 7f86f851e640 1 -- start start 2024-04-14T09:58:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f851e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 0x7f86f00722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d537fe640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c0da760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 -- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 msgr2=0x7f1d4c0da760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 -- 172.21.15.40:0/2538032456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560007530 msgr2=0x7f0560053820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 --2- 172.21.15.40:0/2538032456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560007530 0x7f0560053820 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056000d330 tx=0x7f055c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 -- 172.21.15.40:0/2538032456 shutdown_connections 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 --2- 172.21.15.40:0/2538032456 >> v2:172.21.15.40:3300/0 conn(0x7f056000d3e0 0x7f0560053d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 --2- 172.21.15.40:0/2538032456 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560007530 0x7f0560053820 secure :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f056000d330 tx=0x7f055c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f056e02d640 1 -- 172.21.15.40:0/2538032456 >> 172.21.15.40:0/2538032456 conn(0x7f0560052640 msgr2=0x7f0560052a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7ff0559d2640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 0x7ff0480d9ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00d520 tx=0x7ff04c00d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d58dca640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 0x7f1d4c0d8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f62ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 0x7f86f00722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c0da760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 -- 172.21.15.40:0/836117025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 msgr2=0x7f1d4c0d8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f851e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0125f0 con 0x7ff04803e830 2024-04-14T09:58:50.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f5ab9640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f86f0072830 0x7f86f00d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56394/0 (socket says 172.21.15.40:56394) 2024-04-14T09:58:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 0x7f1d4c0d8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f1d53fff640 1 -- 172.21.15.40:0/836117025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c181140 con 0x7f1d4c006fe0 2024-04-14T09:58:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff04c019070 con 0x7ff04803e830 2024-04-14T09:58:50.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d58dca640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 0x7f1d4c0d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff04c012990 con 0x7ff04803e830 2024-04-14T09:58:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f851e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86f015b5d0 con 0x7f86f0072830 2024-04-14T09:58:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f851e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f86f0072c90 con 0x7f86f00d0800 2024-04-14T09:58:50.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.109+0000 7f86f851e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f86f015b8b0 con 0x7f86f00cd3b0 2024-04-14T09:58:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f86f6abb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d53fff640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800f9b0 tx=0x7f1d480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d537fe640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c0da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f86f6abb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51404/0 (socket says 172.21.15.40:51404) 2024-04-14T09:58:50.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f86f6abb640 1 -- 172.21.15.40:0/3418669298 learned_addr learned my addr 172.21.15.40:0/3418669298 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7ff057c36640 1 -- 172.21.15.40:0/4040385851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0480da0e0 con 0x7ff04803e830 2024-04-14T09:58:50.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7ff057c36640 1 -- 172.21.15.40:0/4040385851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0480d7040 con 0x7ff04803e830 2024-04-14T09:58:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d6615e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 0x7f1d6015c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d5f7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57312/0 (socket says 172.21.15.40:57312) 2024-04-14T09:58:50.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d5f7fe640 1 -- 172.21.15.40:0/768289386 learned_addr learned my addr 172.21.15.40:0/768289386 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f876802b070 con 0x7f87780afd80 2024-04-14T09:58:50.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f86f62ba640 1 -- 172.21.15.40:0/3418669298 >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 msgr2=0x7f86f00c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:50.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f86f62ba640 1 --2- 172.21.15.40:0/3418669298 >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f1d6615e640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 0x7f1d601f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f86f52b8640 1 -- 172.21.15.40:0/3418669298 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208809223 0 0) 0x7f86f015b5d0 con 0x7f86f0072830 2024-04-14T09:58:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f86f62ba640 1 -- 172.21.15.40:0/3418669298 >> v1:172.21.15.136:6789/0 conn(0x7f86f0072830 legacy=0x7f86f00d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f86f62ba640 1 -- 172.21.15.40:0/3418669298 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f015bb90 con 0x7f86f00cd3b0 2024-04-14T09:58:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 0x7f1d601f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f1d5effd640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 0x7f1d6015c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f8766ffd640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 0x7f875806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f1d6615e640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1d60140c80 con 0x7f1d6013fe00 2024-04-14T09:58:50.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f1d6615e640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d601409a0 con 0x7f1d6013d6b0 2024-04-14T09:58:50.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f1d6615e640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d600748d0 con 0x7f1d60071a40 2024-04-14T09:58:50.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f86f6abb640 1 --2- 172.21.15.40:0/3418669298 >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f877659c640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 0x7f875806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.111+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f876809cfc0 con 0x7f87780afd80 2024-04-14T09:58:50.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4803d030 con 0x7f1d4c006fe0 2024-04-14T09:58:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 -- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 msgr2=0x7f1d60137ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 -- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 msgr2=0x7f1d6015c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 0x7f1d6015c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d601e2e20 con 0x7f1d6013fe00 2024-04-14T09:58:50.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f056e02d640 1 -- 172.21.15.40:0/2538032456 shutdown_connections 2024-04-14T09:58:50.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.110+0000 7f056e02d640 1 -- 172.21.15.40:0/2538032456 wait complete. 2024-04-14T09:58:50.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f877659c640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 0x7f875806ee80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f876c006fd0 tx=0x7f876c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f056e02d640 1 Processor -- start 2024-04-14T09:58:50.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c181420 con 0x7f1d4c006fe0 2024-04-14T09:58:50.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c04bc80 con 0x7f1d4c006fe0 2024-04-14T09:58:50.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d4803f070 con 0x7f1d4c006fe0 2024-04-14T09:58:50.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f056e02d640 1 -- start start 2024-04-14T09:58:50.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d48043610 con 0x7f1d4c006fe0 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5ffff640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 0x7f1d601f1280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d58033000 tx=0x7f1d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5f7fe640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f1d5effd640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 0x7f1d6015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff048007fb0 con 0x7ff04803e830 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff04c012b30 con 0x7ff04803e830 2024-04-14T09:58:50.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f875c005290 con 0x7f87780afd80 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.112+0000 7f86f62ba640 1 --2- 172.21.15.40:0/3418669298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 0x7f86f00722f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f86e40097a0 tx=0x7f86e402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0252c88908c0e8a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f86f52b8640 1 -- 172.21.15.40:0/3418669298 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4035020 con 0x7f86f00cd3b0 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f86f52b8640 1 -- 172.21.15.40:0/3418669298 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86e4031810 con 0x7f86f00cd3b0 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f056e02d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f056e02d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f056e02d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 0x7f056004f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f05677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f05677fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55158/0 (socket says 172.21.15.40:55158) 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0566ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0566ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51428/0 (socket says 172.21.15.40:51428) 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f056e02d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05600559d0 con 0x7f056000d3e0 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f056e02d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0560055850 con 0x7f0560055470 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f056e02d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f05600493b0 con 0x7f056004d1d0 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f05677fe640 1 -- 172.21.15.40:0/1823083717 learned_addr learned my addr 172.21.15.40:0/1823083717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 0x7f056004f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58039040 con 0x7f1d6013fe00 2024-04-14T09:58:50.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d58043070 con 0x7f1d6013fe00 2024-04-14T09:58:50.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.113+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d34005290 con 0x7f1d4c006fe0 2024-04-14T09:58:50.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7ff0467fc640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 0x7ff03406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff04c08c050 con 0x7ff04803e830 2024-04-14T09:58:50.152 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f86f52b8640 1 -- 172.21.15.40:0/3418669298 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86e4035020 con 0x7f86f00cd3b0 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f86f851e640 1 -- 172.21.15.40:0/3418669298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 msgr2=0x7f86f00722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f86f851e640 1 --2- 172.21.15.40:0/3418669298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 0x7f86f00722f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f86e40097a0 tx=0x7f86e402b8b0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7ff0551d1640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 0x7ff03406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 -- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 msgr2=0x7f056004cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 -- 172.21.15.40:0/1823083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 msgr2=0x7f05600d7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f0567fff640 1 -- 172.21.15.40:0/1823083717 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0560173700 con 0x7f056004d1d0 2024-04-14T09:58:50.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5803f670 con 0x7f1d6013fe00 2024-04-14T09:58:50.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.114+0000 7f1d6615e640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d601e3100 con 0x7f1d6013fe00 2024-04-14T09:58:50.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f1d6615e640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d601437f0 con 0x7f1d6013fe00 2024-04-14T09:58:50.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f0567fff640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 0x7f056004f380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056806a9e0 tx=0x7f0568068ff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 -- 172.21.15.40:0/3418669298 shutdown_connections 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 --2- 172.21.15.40:0/3418669298 >> v2:172.21.15.136:3300/0 conn(0x7f86f00d0800 0x7f86f00c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 --2- 172.21.15.40:0/3418669298 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f00cd3b0 0x7f86f00722f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 -- 172.21.15.40:0/3418669298 >> 172.21.15.40:0/3418669298 conn(0x7f86f00d0e50 msgr2=0x7f86f00d1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 -- 172.21.15.40:0/3418669298 shutdown_connections 2024-04-14T09:58:50.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d4804a060 con 0x7f1d4c006fe0 2024-04-14T09:58:50.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f86f851e640 1 -- 172.21.15.40:0/3418669298 wait complete. 2024-04-14T09:58:50.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7ff0551d1640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 0x7ff03406ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0480dcc90 tx=0x7ff040009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056806c6a0 con 0x7f056004d1d0 2024-04-14T09:58:50.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f056806c840 con 0x7f056004d1d0 2024-04-14T09:58:50.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056806cc30 con 0x7f056004d1d0 2024-04-14T09:58:50.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05601739e0 con 0x7f056004d1d0 2024-04-14T09:58:50.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f1d50ff9640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 0x7f1d3806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f05600d8490 con 0x7f056004d1d0 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f05677fe640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.115+0000 7f0566ffd640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.116+0000 7f1d537fe640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 0x7f1d3806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.116+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d480ad950 con 0x7f1d4c006fe0 2024-04-14T09:58:50.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.116+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d600756f0 con 0x7f1d6013fe00 2024-04-14T09:58:50.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.116+0000 7f1d537fe640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 0x7f1d3806ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c052ab0 tx=0x7f1d40008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.117+0000 7f86f851e640 1 Processor -- start 2024-04-14T09:58:50.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.117+0000 7f86f851e640 1 -- start start 2024-04-14T09:58:50.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.117+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05680748d0 con 0x7f056004d1d0 2024-04-14T09:58:50.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.117+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0548005290 con 0x7f056004d1d0 2024-04-14T09:58:50.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f0072830 0x7f86f0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f0553fff640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 0x7f054c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86f00d0800 0x7f86f00b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f5ab9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f5ab9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51434/0 (socket says 172.21.15.40:51434) 2024-04-14T09:58:50.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f5ab9640 1 -- 172.21.15.40:0/2275212178 learned_addr learned my addr 172.21.15.40:0/2275212178 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00c64d0 con 0x7f86f00d0800 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86f00c6350 con 0x7f86f00cd3b0 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f86f00c6650 con 0x7f86f0072830 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f6abb640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86f00d0800 0x7f86f00b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0568106bb0 con 0x7f056004d1d0 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f86f62ba640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f0072830 0x7f86f0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.118+0000 7f05677fe640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 0x7f054c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 -- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f0072830 msgr2=0x7f86f0155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f0072830 0x7f86f0155c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 -- 172.21.15.40:0/2275212178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86f00d0800 msgr2=0x7f86f00b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86f00d0800 0x7f86f00b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f00b49e0 con 0x7f86f00cd3b0 2024-04-14T09:58:50.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f86f5ab9640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c4d0 tx=0x7f86ec00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.119+0000 7f05677fe640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 0x7f054c06ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0554001730 tx=0x7f0554009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.120+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f876806aad0 con 0x7f87780afd80 2024-04-14T09:58:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.122+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff048007fb0 con 0x7ff04803e830 2024-04-14T09:58:50.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.123+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f05680d4cc0 con 0x7f056004d1d0 2024-04-14T09:58:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.123+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d5802cba0 con 0x7f1d6013fe00 2024-04-14T09:58:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.123+0000 7f1d47fff640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 0x7f1d4c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.124+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d580b22a0 con 0x7f1d6013fe00 2024-04-14T09:58:50.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.125+0000 7f1d5f7fe640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 0x7f1d4c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.125+0000 7f1d5f7fe640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 0x7f1d4c06ee80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d54000f60 tx=0x7f1d54009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.127+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1d58080400 con 0x7f1d6013fe00 2024-04-14T09:58:50.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1d48041320 con 0x7f1d4c006fe0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec018070 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ec007500 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ec004a20 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f0154e90 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.131+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f0155450 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.134+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f86ec01b070 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.134+0000 7f86e2ffd640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 0x7f86d406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.134+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f86ec08b1f0 con 0x7f86f00cd3b0 2024-04-14T09:58:50.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.134+0000 7f86f62ba640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 0x7f86d406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.134+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f00756f0 con 0x7f86f00cd3b0 2024-04-14T09:58:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.135+0000 7f86f62ba640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 0x7f86d406ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e403e040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.139+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f86ec058d00 con 0x7f86f00cd3b0 2024-04-14T09:58:50.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.468+0000 7f6bb5fcb640 1 -- 172.21.15.40:0/2191965425 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6ba80057d0 con 0x7f6ba80e7a60 2024-04-14T09:58:50.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.468+0000 7f6bad7fa640 1 -- 172.21.15.40:0/2191965425 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6bb0099030 con 0x7f6ba80e7a60 2024-04-14T09:58:50.474 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:50.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 msgr2=0x7f6b9406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 0x7f6b9406eeb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c006fd0 tx=0x7f6b9c008040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 msgr2=0x7f6ba80d4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 0x7f6ba80d4950 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0064ff0 tx=0x7f6bb00759a0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 shutdown_connections 2024-04-14T09:58:50.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.472+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6b9406c9f0 0x7f6b9406eeb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6ba80e7a60 0x7f6ba80d4950 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6ba80e7680 0x7f6ba80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 --2- 172.21.15.40:0/2191965425 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6ba804a3d0 0x7f6ba80cd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 >> 172.21.15.40:0/2191965425 conn(0x7f6ba8053740 msgr2=0x7f6ba8009620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 shutdown_connections 2024-04-14T09:58:50.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.473+0000 7f6b9affd640 1 -- 172.21.15.40:0/2191965425 wait complete. 2024-04-14T09:58:50.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2024-04-14T09:58:50.490 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.494 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.495+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9ffc005580 con 0x7fa00c007060 2024-04-14T09:58:50.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.495+0000 7fa00a7fc640 1 -- 172.21.15.40:0/2298806006 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0040172c0 con 0x7fa00c007060 2024-04-14T09:58:50.498 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 msgr2=0x7f9ff806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 0x7f9ff806edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00c550 tx=0x7fa0140ab000 comp rx=0 tx=0).stop 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 msgr2=0x7fa00c0d97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa00400b410 tx=0x7fa00400b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 shutdown_connections 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ff806c8f0 0x7f9ff806edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa00c0e7730 0x7fa00c0d3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa00c048f50 0x7fa00c04b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 --2- 172.21.15.40:0/2298806006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa00c007060 0x7fa00c0d97f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 >> 172.21.15.40:0/2298806006 conn(0x7fa00c055bc0 msgr2=0x7fa00c0e4d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 shutdown_connections 2024-04-14T09:58:50.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.499+0000 7fa01bbfa640 1 -- 172.21.15.40:0/2298806006 wait complete. 2024-04-14T09:58:50.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-04-14T09:58:50.515 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.523+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f86f00c7990 con 0x7f86f00cd3b0 2024-04-14T09:58:50.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.524+0000 7f86e2ffd640 1 -- 172.21.15.40:0/2275212178 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f86ec05d000 con 0x7f86f00cd3b0 2024-04-14T09:58:50.524 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 msgr2=0x7f86d406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 0x7f86d406ee80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f86e4036000 tx=0x7f86e403e040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 msgr2=0x7f86f014d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00c4d0 tx=0x7f86ec00c990 comp rx=0 tx=0).stop 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 shutdown_connections 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f86d406c9c0 0x7f86d406ee80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86f00d0800 0x7f86f00b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86f00cd3b0 0x7f86f014d9c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 --2- 172.21.15.40:0/2275212178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86f0072830 0x7f86f0155c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 >> 172.21.15.40:0/2275212178 conn(0x7f86f00d0e50 msgr2=0x7f86f00b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 shutdown_connections 2024-04-14T09:58:50.527 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.526+0000 7f86f851e640 1 -- 172.21.15.40:0/2275212178 wait complete. 2024-04-14T09:58:50.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.531+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1d6013b880 con 0x7f1d6013fe00 2024-04-14T09:58:50.531 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.531+0000 7f1d47fff640 1 -- 172.21.15.40:0/768289386 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d5807fd00 con 0x7f1d6013fe00 2024-04-14T09:58:50.531 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.533+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 msgr2=0x7f1d4c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.533+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 0x7f1d4c06ee80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1d54000f60 tx=0x7f1d54009040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.533+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 msgr2=0x7f1d601f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.533+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 0x7f1d601f1280 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1d58033000 tx=0x7f1d58004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 shutdown_connections 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d4c06c9c0 0x7f1d4c06ee80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d6013fe00 0x7f1d601f1280 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d6013d6b0 0x7f1d6015c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 --2- 172.21.15.40:0/768289386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d60071a40 0x7f1d60137ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 >> 172.21.15.40:0/768289386 conn(0x7f1d60067230 msgr2=0x7f1d6013acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 shutdown_connections 2024-04-14T09:58:50.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.534+0000 7f1d45ffb640 1 -- 172.21.15.40:0/768289386 wait complete. 2024-04-14T09:58:50.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-14T09:58:50.537 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2024-04-14T09:58:50.545 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.546+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0548005580 con 0x7f056004d1d0 2024-04-14T09:58:50.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.547+0000 7f0553fff640 1 -- 172.21.15.40:0/1823083717 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05680d45c0 con 0x7f056004d1d0 2024-04-14T09:58:50.547 INFO:teuthology.orchestra.run.smithi040.stdout:55834574859 2024-04-14T09:58:50.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 msgr2=0x7f054c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 0x7f054c06ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0554001730 tx=0x7f0554009040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 msgr2=0x7f056004f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 0x7f056004f380 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056806a9e0 tx=0x7f0568068ff0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 shutdown_connections 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f054c06c9c0 0x7f054c06ee80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f056004d1d0 0x7f056004f380 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0560055470 0x7f056004cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 --2- 172.21.15.40:0/1823083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f056000d3e0 0x7f05600d7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 >> 172.21.15.40:0/1823083717 conn(0x7f0560052640 msgr2=0x7f056004b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 shutdown_connections 2024-04-14T09:58:50.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.550+0000 7f056e02d640 1 -- 172.21.15.40:0/1823083717 wait complete. 2024-04-14T09:58:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.552+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff0480057d0 con 0x7ff04803e830 2024-04-14T09:58:50.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.552+0000 7ff0467fc640 1 -- 172.21.15.40:0/4040385851 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff04c059ad0 con 0x7ff04803e830 2024-04-14T09:58:50.552 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:50.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 msgr2=0x7ff03406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 0x7ff03406ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff0480dcc90 tx=0x7ff040009190 comp rx=0 tx=0).stop 2024-04-14T09:58:50.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 msgr2=0x7ff0480d9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1d34005580 con 0x7f1d4c006fe0 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 0x7ff0480d9ba0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00d520 tx=0x7ff04c00d9e0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 shutdown_connections 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff03406c9c0 0x7ff03406ee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0480e30b0 0x7ff0480e16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff048054120 0x7ff0480de510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 --2- 172.21.15.40:0/4040385851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff04803e830 0x7ff0480d9ba0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.556 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.555+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 >> 172.21.15.40:0/4040385851 conn(0x7ff0480559d0 msgr2=0x7ff0480076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.556+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 shutdown_connections 2024-04-14T09:58:50.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.556+0000 7ff033fff640 1 -- 172.21.15.40:0/4040385851 wait complete. 2024-04-14T09:58:50.557 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.556+0000 7f1d50ff9640 1 -- 172.21.15.40:0/836117025 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d4807bab0 con 0x7f1d4c006fe0 2024-04-14T09:58:50.557 INFO:teuthology.orchestra.run.smithi040.stdout:55834574858 2024-04-14T09:58:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 msgr2=0x7f1d3806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 0x7f1d3806ee80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c052ab0 tx=0x7f1d40008040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 msgr2=0x7f1d4c180910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1d4800f9b0 tx=0x7f1d480046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 shutdown_connections 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1d3806c9c0 0x7f1d3806ee80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1d4c008d10 0x7f1d4c0d8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d4c008930 0x7f1d4c0da760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 --2- 172.21.15.40:0/836117025 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d4c006fe0 0x7f1d4c180910 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 >> 172.21.15.40:0/836117025 conn(0x7f1d4c01ef30 msgr2=0x7f1d4c03a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 shutdown_connections 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.558+0000 7f1d595cb640 1 -- 172.21.15.40:0/836117025 wait complete. 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.559+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f875c005580 con 0x7f87780afd80 2024-04-14T09:58:50.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.559+0000 7f8766ffd640 1 -- 172.21.15.40:0/3936271261 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f876806edd0 con 0x7f87780afd80 2024-04-14T09:58:50.569 INFO:teuthology.orchestra.run.smithi040.stdout:55834574857 2024-04-14T09:58:50.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2024-04-14T09:58:50.570 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 msgr2=0x7f875806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 0x7f875806ee80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f876c006fd0 tx=0x7f876c008040 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 msgr2=0x7f87780d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 0x7f87780d0300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f876801f650 tx=0x7f876801fb10 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 shutdown_connections 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f875806c9c0 0x7f875806ee80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f877815ae10 0x7f8778155720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87780afd80 0x7f87780d0300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 --2- 172.21.15.40:0/3936271261 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f877806e820 0x7f8778151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 >> 172.21.15.40:0/3936271261 conn(0x7f877806b520 msgr2=0x7f877806ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 shutdown_connections 2024-04-14T09:58:50.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.563+0000 7f877c80f640 1 -- 172.21.15.40:0/3936271261 wait complete. 2024-04-14T09:58:50.572 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2024-04-14T09:58:50.573 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-14T09:58:50.573 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2024-04-14T09:58:50.576 DEBUG:teuthology.parallel:result is None 2024-04-14T09:58:50.576 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T09:58:50.576 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:58:50.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.724+0000 7f43d402d640 1 Processor -- start 2024-04-14T09:58:50.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.724+0000 7f43d402d640 1 -- start start 2024-04-14T09:58:50.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.724+0000 7f43d402d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d402d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc0ccce0 con 0x7f43cc15c690 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d402d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43cc0ccf80 con 0x7f43cc0b4680 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d402d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc0d01b0 con 0x7f43cc15c2b0 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d15c8640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f43cc15c690 0x7f43cc0cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40966/0 (socket says 172.21.15.40:40966) 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d15c8640 1 -- 172.21.15.40:0/1510905056 learned_addr learned my addr 172.21.15.40:0/1510905056 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d1dc9640 1 --2- 172.21.15.40:0/1510905056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650231159 0 0) 0x7f43cc0ccce0 con 0x7f43cc15c690 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43b4003520 con 0x7f43cc15c690 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217785312 0 0) 0x7f43cc0ccf80 con 0x7f43cc0b4680 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43cc0ccce0 con 0x7f43cc0b4680 2024-04-14T09:58:50.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d1dc9640 1 -- 172.21.15.40:0/1510905056 >> v1:172.21.15.136:6789/0 conn(0x7f43cc0b4680 legacy=0x7f43cc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d1dc9640 1 -- 172.21.15.40:0/1510905056 >> v1:172.21.15.40:6789/0 conn(0x7f43cc15c690 legacy=0x7f43cc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.725+0000 7f43d1dc9640 1 -- 172.21.15.40:0/1510905056 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0cd260 con 0x7f43cc15c2b0 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.726+0000 7f43d1dc9640 1 --2- 172.21.15.40:0/1510905056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0cfc70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097d0 tx=0x7f43c402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=737fb67ebd4f7c6e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.726+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4035020 con 0x7f43cc15c2b0 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.726+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43c4031800 con 0x7f43cc15c2b0 2024-04-14T09:58:50.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.726+0000 7f43d0dc7640 1 -- 172.21.15.40:0/1510905056 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43c4031bd0 con 0x7f43cc15c2b0 2024-04-14T09:58:50.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 -- 172.21.15.40:0/1510905056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 msgr2=0x7f43cc0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 --2- 172.21.15.40:0/1510905056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0cfc70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43c40097d0 tx=0x7f43c402b8a0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 -- 172.21.15.40:0/1510905056 shutdown_connections 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 --2- 172.21.15.40:0/1510905056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0cfc70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 -- 172.21.15.40:0/1510905056 >> 172.21.15.40:0/1510905056 conn(0x7f43cc0b3b90 msgr2=0x7f43cc0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 -- 172.21.15.40:0/1510905056 shutdown_connections 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.727+0000 7f43d402d640 1 -- 172.21.15.40:0/1510905056 wait complete. 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 Processor -- start 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 -- start start 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43cc0b4680 0x7f43cc0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc09b150 con 0x7f43cc0c71f0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f43cc0d03e0 con 0x7f43cc0b4680 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.728+0000 7f43d402d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f43cc09b2d0 con 0x7f43cc15c2b0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55176/0 (socket says 172.21.15.40:55176) 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 -- 172.21.15.40:0/2338462590 learned_addr learned my addr 172.21.15.40:0/2338462590 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d15c8640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d1dc9640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43cc0b4680 0x7f43cc0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 -- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 msgr2=0x7f43cc0b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 -- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43cc0b4680 msgr2=0x7f43cc0c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43cc0b4680 0x7f43cc0c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 -- 172.21.15.40:0/2338462590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43cc0c6150 con 0x7f43cc0c71f0 2024-04-14T09:58:50.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d25ca640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c790 tx=0x7f43bc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc003b70 con 0x7f43cc0c71f0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc003d10 con 0x7f43cc0c71f0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43cc0c6430 con 0x7f43cc0c71f0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc00aa50 con 0x7f43cc0c71f0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.729+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43cc0c69f0 con 0x7f43cc0c71f0 2024-04-14T09:58:50.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.730+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43cc074550 con 0x7f43cc0c71f0 2024-04-14T09:58:50.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.731+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43bc00abf0 con 0x7f43cc0c71f0 2024-04-14T09:58:50.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.731+0000 7f43ca7fc640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:50.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.731+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f43bc08bc70 con 0x7f43cc0c71f0 2024-04-14T09:58:50.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.731+0000 7f43d1dc9640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:50.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.732+0000 7f43d1dc9640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 0x7f43b806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43c4036000 tx=0x7f43c4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:50.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.736+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f43cc074550 con 0x7f43cc0c71f0 2024-04-14T09:58:50.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.917+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43cc0756f0 con 0x7f43b806c8f0 2024-04-14T09:58:50.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.925+0000 7f43ca7fc640 1 -- 172.21.15.40:0/2338462590 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f43c409b310 con 0x7f43b806c8f0 2024-04-14T09:58:50.925 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:50.930 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 msgr2=0x7f43b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 0x7f43b806edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f43c4036000 tx=0x7f43c4008030 comp rx=0 tx=0).stop 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 msgr2=0x7f43cc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f43bc00c790 tx=0x7f43bc00cc50 comp rx=0 tx=0).stop 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 shutdown_connections 2024-04-14T09:58:50.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f43b806c8f0 0x7f43b806edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f43cc0c71f0 0x7f43cc070740 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f43cc15c2b0 0x7f43cc0b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 --2- 172.21.15.40:0/2338462590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f43cc0b4680 0x7f43cc0c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 >> 172.21.15.40:0/2338462590 conn(0x7f43cc0b3b90 msgr2=0x7f43cc0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 shutdown_connections 2024-04-14T09:58:50.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:50.928+0000 7f43d402d640 1 -- 172.21.15.40:0/2338462590 wait complete. 2024-04-14T09:58:50.939 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-14T09:58:50.814916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008098"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718547+0000","last_change":"2024-04-14T09:58:22.400374+0000","last_active":"2024-04-14T09:58:28.718547+0000","last_peered":"2024-04-14T09:58:28.718547+0000","last_clean":"2024-04-14T09:58:28.718547+0000","last_became_active":"2024-04-14T09:58:22.400083+0000","last_became_peered":"2024-04-14T09:58:22.400083+0000","last_unstale":"2024-04-14T09:58:28.718547+0000","last_undegraded":"2024-04-14T09:58:28.718547+0000","last_fullsized":"2024-04-14T09:58:28.718547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411956+0000","last_change":"2024-04-14T09:58:23.405589+0000","last_active":"2024-04-14T09:58:28.411956+0000","last_peered":"2024-04-14T09:58:28.411956+0000","last_clean":"2024-04-14T09:58:28.411956+0000","last_became_active":"2024-04-14T09:58:23.405288+0000","last_became_peered":"2024-04-14T09:58:23.405288+0000","last_unstale":"2024-04-14T09:58:28.411956+0000","last_undegraded":"2024-04-14T09:58:28.411956+0000","last_fullsized":"2024-04-14T09:58:28.411956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411293+0000","last_change":"2024-04-14T09:58:27.669278+0000","last_active":"2024-04-14T09:58:28.411293+0000","last_peered":"2024-04-14T09:58:28.411293+0000","last_clean":"2024-04-14T09:58:28.411293+0000","last_became_active":"2024-04-14T09:58:27.668928+0000","last_became_peered":"2024-04-14T09:58:27.668928+0000","last_unstale":"2024-04-14T09:58:28.411293+0000","last_undegraded":"2024-04-14T09:58:28.411293+0000","last_fullsized":"2024-04-14T09:58:28.411293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:59.301538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412073+0000","last_change":"2024-04-14T09:58:22.396110+0000","last_active":"2024-04-14T09:58:28.412073+0000","last_peered":"2024-04-14T09:58:28.412073+0000","last_clean":"2024-04-14T09:58:28.412073+0000","last_became_active":"2024-04-14T09:58:22.395818+0000","last_became_peered":"2024-04-14T09:58:22.395818+0000","last_unstale":"2024-04-14T09:58:28.412073+0000","last_undegraded":"2024-04-14T09:58:28.412073+0000","last_fullsized":"2024-04-14T09:58:28.412073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:02:50.002691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718273+0000","last_change":"2024-04-14T09:58:23.405100+0000","last_active":"2024-04-14T09:58:28.718273+0000","last_peered":"2024-04-14T09:58:28.718273+0000","last_clean":"2024-04-14T09:58:28.718273+0000","last_became_active":"2024-04-14T09:58:23.404837+0000","last_became_peered":"2024-04-14T09:58:23.404837+0000","last_unstale":"2024-04-14T09:58:28.718273+0000","last_undegraded":"2024-04-14T09:58:28.718273+0000","last_fullsized":"2024-04-14T09:58:28.718273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:53.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411717+0000","last_change":"2024-04-14T09:58:27.431626+0000","last_active":"2024-04-14T09:58:28.411717+0000","last_peered":"2024-04-14T09:58:28.411717+0000","last_clean":"2024-04-14T09:58:28.411717+0000","last_became_active":"2024-04-14T09:58:27.431160+0000","last_became_peered":"2024-04-14T09:58:27.431160+0000","last_unstale":"2024-04-14T09:58:28.411717+0000","last_undegraded":"2024-04-14T09:58:28.411717+0000","last_fullsized":"2024-04-14T09:58:28.411717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:01.933626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719419+0000","last_change":"2024-04-14T09:58:22.396291+0000","last_active":"2024-04-14T09:58:28.719419+0000","last_peered":"2024-04-14T09:58:28.719419+0000","last_clean":"2024-04-14T09:58:28.719419+0000","last_became_active":"2024-04-14T09:58:22.396071+0000","last_became_peered":"2024-04-14T09:58:22.396071+0000","last_unstale":"2024-04-14T09:58:28.719419+0000","last_undegraded":"2024-04-14T09:58:28.719419+0000","last_fullsized":"2024-04-14T09:58:28.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717868+0000","last_change":"2024-04-14T09:58:23.397574+0000","last_active":"2024-04-14T09:58:28.717868+0000","last_peered":"2024-04-14T09:58:28.717868+0000","last_clean":"2024-04-14T09:58:28.717868+0000","last_became_active":"2024-04-14T09:58:23.397261+0000","last_became_peered":"2024-04-14T09:58:23.397261+0000","last_unstale":"2024-04-14T09:58:28.717868+0000","last_undegraded":"2024-04-14T09:58:28.717868+0000","last_fullsized":"2024-04-14T09:58:28.717868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412409+0000","last_change":"2024-04-14T09:58:27.427865+0000","last_active":"2024-04-14T09:58:28.412409+0000","last_peered":"2024-04-14T09:58:28.412409+0000","last_clean":"2024-04-14T09:58:28.412409+0000","last_became_active":"2024-04-14T09:58:27.427483+0000","last_became_peered":"2024-04-14T09:58:27.427483+0000","last_unstale":"2024-04-14T09:58:28.412409+0000","last_undegraded":"2024-04-14T09:58:28.412409+0000","last_fullsized":"2024-04-14T09:58:28.412409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718852+0000","last_change":"2024-04-14T09:58:22.394942+0000","last_active":"2024-04-14T09:58:28.718852+0000","last_peered":"2024-04-14T09:58:28.718852+0000","last_clean":"2024-04-14T09:58:28.718852+0000","last_became_active":"2024-04-14T09:58:22.394679+0000","last_became_peered":"2024-04-14T09:58:22.394679+0000","last_unstale":"2024-04-14T09:58:28.718852+0000","last_undegraded":"2024-04-14T09:58:28.718852+0000","last_fullsized":"2024-04-14T09:58:28.718852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:33.668503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718216+0000","last_change":"2024-04-14T09:58:23.402824+0000","last_active":"2024-04-14T09:58:28.718216+0000","last_peered":"2024-04-14T09:58:28.718216+0000","last_clean":"2024-04-14T09:58:28.718216+0000","last_became_active":"2024-04-14T09:58:23.402246+0000","last_became_peered":"2024-04-14T09:58:23.402246+0000","last_unstale":"2024-04-14T09:58:28.718216+0000","last_undegraded":"2024-04-14T09:58:28.718216+0000","last_fullsized":"2024-04-14T09:58:28.718216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411885+0000","last_change":"2024-04-14T09:58:27.423837+0000","last_active":"2024-04-14T09:58:28.411885+0000","last_peered":"2024-04-14T09:58:28.411885+0000","last_clean":"2024-04-14T09:58:28.411885+0000","last_became_active":"2024-04-14T09:58:27.423439+0000","last_became_peered":"2024-04-14T09:58:27.423439+0000","last_unstale":"2024-04-14T09:58:28.411885+0000","last_undegraded":"2024-04-14T09:58:28.411885+0000","last_fullsized":"2024-04-14T09:58:28.411885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:48.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718018+0000","last_change":"2024-04-14T09:58:23.404740+0000","last_active":"2024-04-14T09:58:28.718018+0000","last_peered":"2024-04-14T09:58:28.718018+0000","last_clean":"2024-04-14T09:58:28.718018+0000","last_became_active":"2024-04-14T09:58:23.404362+0000","last_became_peered":"2024-04-14T09:58:23.404362+0000","last_unstale":"2024-04-14T09:58:28.718018+0000","last_undegraded":"2024-04-14T09:58:28.718018+0000","last_fullsized":"2024-04-14T09:58:28.718018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719028+0000","last_change":"2024-04-14T09:58:22.391425+0000","last_active":"2024-04-14T09:58:28.719028+0000","last_peered":"2024-04-14T09:58:28.719028+0000","last_clean":"2024-04-14T09:58:28.719028+0000","last_became_active":"2024-04-14T09:58:22.391062+0000","last_became_peered":"2024-04-14T09:58:22.391062+0000","last_unstale":"2024-04-14T09:58:28.719028+0000","last_undegraded":"2024-04-14T09:58:28.719028+0000","last_fullsized":"2024-04-14T09:58:28.719028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:45.817473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412039+0000","last_change":"2024-04-14T09:58:27.431221+0000","last_active":"2024-04-14T09:58:28.412039+0000","last_peered":"2024-04-14T09:58:28.412039+0000","last_clean":"2024-04-14T09:58:28.412039+0000","last_became_active":"2024-04-14T09:58:27.430764+0000","last_became_peered":"2024-04-14T09:58:27.430764+0000","last_unstale":"2024-04-14T09:58:28.412039+0000","last_undegraded":"2024-04-14T09:58:28.412039+0000","last_fullsized":"2024-04-14T09:58:28.412039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411673+0000","last_change":"2024-04-14T09:58:23.403246+0000","last_active":"2024-04-14T09:58:28.411673+0000","last_peered":"2024-04-14T09:58:28.411673+0000","last_clean":"2024-04-14T09:58:28.411673+0000","last_became_active":"2024-04-14T09:58:23.402610+0000","last_became_peered":"2024-04-14T09:58:23.402610+0000","last_unstale":"2024-04-14T09:58:28.411673+0000","last_undegraded":"2024-04-14T09:58:28.411673+0000","last_fullsized":"2024-04-14T09:58:28.411673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718903+0000","last_change":"2024-04-14T09:58:22.395168+0000","last_active":"2024-04-14T09:58:28.718903+0000","last_peered":"2024-04-14T09:58:28.718903+0000","last_clean":"2024-04-14T09:58:28.718903+0000","last_became_active":"2024-04-14T09:58:22.394913+0000","last_became_peered":"2024-04-14T09:58:22.394913+0000","last_unstale":"2024-04-14T09:58:28.718903+0000","last_undegraded":"2024-04-14T09:58:28.718903+0000","last_fullsized":"2024-04-14T09:58:28.718903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412208+0000","last_change":"2024-04-14T09:58:27.431150+0000","last_active":"2024-04-14T09:58:28.412208+0000","last_peered":"2024-04-14T09:58:28.412208+0000","last_clean":"2024-04-14T09:58:28.412208+0000","last_became_active":"2024-04-14T09:58:27.430727+0000","last_became_peered":"2024-04-14T09:58:27.430727+0000","last_unstale":"2024-04-14T09:58:28.412208+0000","last_undegraded":"2024-04-14T09:58:28.412208+0000","last_fullsized":"2024-04-14T09:58:28.412208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411542+0000","last_change":"2024-04-14T09:58:23.396679+0000","last_active":"2024-04-14T09:58:28.411542+0000","last_peered":"2024-04-14T09:58:28.411542+0000","last_clean":"2024-04-14T09:58:28.411542+0000","last_became_active":"2024-04-14T09:58:23.396401+0000","last_became_peered":"2024-04-14T09:58:23.396401+0000","last_unstale":"2024-04-14T09:58:28.411542+0000","last_undegraded":"2024-04-14T09:58:28.411542+0000","last_fullsized":"2024-04-14T09:58:28.411542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718109+0000","last_change":"2024-04-14T09:58:22.390340+0000","last_active":"2024-04-14T09:58:28.718109+0000","last_peered":"2024-04-14T09:58:28.718109+0000","last_clean":"2024-04-14T09:58:28.718109+0000","last_became_active":"2024-04-14T09:58:22.390062+0000","last_became_peered":"2024-04-14T09:58:22.390062+0000","last_unstale":"2024-04-14T09:58:28.718109+0000","last_undegraded":"2024-04-14T09:58:28.718109+0000","last_fullsized":"2024-04-14T09:58:28.718109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718409+0000","last_change":"2024-04-14T09:58:27.667944+0000","last_active":"2024-04-14T09:58:28.718409+0000","last_peered":"2024-04-14T09:58:28.718409+0000","last_clean":"2024-04-14T09:58:28.718409+0000","last_became_active":"2024-04-14T09:58:27.667524+0000","last_became_peered":"2024-04-14T09:58:27.667524+0000","last_unstale":"2024-04-14T09:58:28.718409+0000","last_undegraded":"2024-04-14T09:58:28.718409+0000","last_fullsized":"2024-04-14T09:58:28.718409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412175+0000","last_change":"2024-04-14T09:58:23.396159+0000","last_active":"2024-04-14T09:58:28.412175+0000","last_peered":"2024-04-14T09:58:28.412175+0000","last_clean":"2024-04-14T09:58:28.412175+0000","last_became_active":"2024-04-14T09:58:23.395832+0000","last_became_peered":"2024-04-14T09:58:23.395832+0000","last_unstale":"2024-04-14T09:58:28.412175+0000","last_undegraded":"2024-04-14T09:58:28.412175+0000","last_fullsized":"2024-04-14T09:58:28.412175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:07.911238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718345+0000","last_change":"2024-04-14T09:58:22.398706+0000","last_active":"2024-04-14T09:58:28.718345+0000","last_peered":"2024-04-14T09:58:28.718345+0000","last_clean":"2024-04-14T09:58:28.718345+0000","last_became_active":"2024-04-14T09:58:22.398161+0000","last_became_peered":"2024-04-14T09:58:22.398161+0000","last_unstale":"2024-04-14T09:58:28.718345+0000","last_undegraded":"2024-04-14T09:58:28.718345+0000","last_fullsized":"2024-04-14T09:58:28.718345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411920+0000","last_change":"2024-04-14T09:58:27.427979+0000","last_active":"2024-04-14T09:58:28.411920+0000","last_peered":"2024-04-14T09:58:28.411920+0000","last_clean":"2024-04-14T09:58:28.411920+0000","last_became_active":"2024-04-14T09:58:27.427612+0000","last_became_peered":"2024-04-14T09:58:27.427612+0000","last_unstale":"2024-04-14T09:58:28.411920+0000","last_undegraded":"2024-04-14T09:58:28.411920+0000","last_fullsized":"2024-04-14T09:58:28.411920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:10.049805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719106+0000","last_change":"2024-04-14T09:58:23.403433+0000","last_active":"2024-04-14T09:58:28.719106+0000","last_peered":"2024-04-14T09:58:28.719106+0000","last_clean":"2024-04-14T09:58:28.719106+0000","last_became_active":"2024-04-14T09:58:23.402914+0000","last_became_peered":"2024-04-14T09:58:23.402914+0000","last_unstale":"2024-04-14T09:58:28.719106+0000","last_undegraded":"2024-04-14T09:58:28.719106+0000","last_fullsized":"2024-04-14T09:58:28.719106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719347+0000","last_change":"2024-04-14T09:58:22.390638+0000","last_active":"2024-04-14T09:58:28.719347+0000","last_peered":"2024-04-14T09:58:28.719347+0000","last_clean":"2024-04-14T09:58:28.719347+0000","last_became_active":"2024-04-14T09:58:22.390011+0000","last_became_peered":"2024-04-14T09:58:22.390011+0000","last_unstale":"2024-04-14T09:58:28.719347+0000","last_undegraded":"2024-04-14T09:58:28.719347+0000","last_fullsized":"2024-04-14T09:58:28.719347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411864+0000","last_change":"2024-04-14T09:58:27.669279+0000","last_active":"2024-04-14T09:58:28.411864+0000","last_peered":"2024-04-14T09:58:28.411864+0000","last_clean":"2024-04-14T09:58:28.411864+0000","last_became_active":"2024-04-14T09:58:27.668902+0000","last_became_peered":"2024-04-14T09:58:27.668902+0000","last_unstale":"2024-04-14T09:58:28.411864+0000","last_undegraded":"2024-04-14T09:58:28.411864+0000","last_fullsized":"2024-04-14T09:58:28.411864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:35.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412231+0000","last_change":"2024-04-14T09:58:23.406160+0000","last_active":"2024-04-14T09:58:28.412231+0000","last_peered":"2024-04-14T09:58:28.412231+0000","last_clean":"2024-04-14T09:58:28.412231+0000","last_became_active":"2024-04-14T09:58:23.405890+0000","last_became_peered":"2024-04-14T09:58:23.405890+0000","last_unstale":"2024-04-14T09:58:28.412231+0000","last_undegraded":"2024-04-14T09:58:28.412231+0000","last_fullsized":"2024-04-14T09:58:28.412231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719543+0000","last_change":"2024-04-14T09:58:22.395184+0000","last_active":"2024-04-14T09:58:28.719543+0000","last_peered":"2024-04-14T09:58:28.719543+0000","last_clean":"2024-04-14T09:58:28.719543+0000","last_became_active":"2024-04-14T09:58:22.394873+0000","last_became_peered":"2024-04-14T09:58:22.394873+0000","last_unstale":"2024-04-14T09:58:28.719543+0000","last_undegraded":"2024-04-14T09:58:28.719543+0000","last_fullsized":"2024-04-14T09:58:28.719543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411231+0000","last_change":"2024-04-14T09:58:27.669744+0000","last_active":"2024-04-14T09:58:28.411231+0000","last_peered":"2024-04-14T09:58:28.411231+0000","last_clean":"2024-04-14T09:58:28.411231+0000","last_became_active":"2024-04-14T09:58:27.668513+0000","last_became_peered":"2024-04-14T09:58:27.668513+0000","last_unstale":"2024-04-14T09:58:28.411231+0000","last_undegraded":"2024-04-14T09:58:28.411231+0000","last_fullsized":"2024-04-14T09:58:28.411231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:15.700051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719218+0000","last_change":"2024-04-14T09:58:23.394968+0000","last_active":"2024-04-14T09:58:28.719218+0000","last_peered":"2024-04-14T09:58:28.719218+0000","last_clean":"2024-04-14T09:58:28.719218+0000","last_became_active":"2024-04-14T09:58:23.394596+0000","last_became_peered":"2024-04-14T09:58:23.394596+0000","last_unstale":"2024-04-14T09:58:28.719218+0000","last_undegraded":"2024-04-14T09:58:28.719218+0000","last_fullsized":"2024-04-14T09:58:28.719218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719510+0000","last_change":"2024-04-14T09:58:22.398406+0000","last_active":"2024-04-14T09:58:28.719510+0000","last_peered":"2024-04-14T09:58:28.719510+0000","last_clean":"2024-04-14T09:58:28.719510+0000","last_became_active":"2024-04-14T09:58:22.398116+0000","last_became_peered":"2024-04-14T09:58:22.398116+0000","last_unstale":"2024-04-14T09:58:28.719510+0000","last_undegraded":"2024-04-14T09:58:28.719510+0000","last_fullsized":"2024-04-14T09:58:28.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:16.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718418+0000","last_change":"2024-04-14T09:58:27.668504+0000","last_active":"2024-04-14T09:58:28.718418+0000","last_peered":"2024-04-14T09:58:28.718418+0000","last_clean":"2024-04-14T09:58:28.718418+0000","last_became_active":"2024-04-14T09:58:27.667630+0000","last_became_peered":"2024-04-14T09:58:27.667630+0000","last_unstale":"2024-04-14T09:58:28.718418+0000","last_undegraded":"2024-04-14T09:58:28.718418+0000","last_fullsized":"2024-04-14T09:58:28.718418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718268+0000","last_change":"2024-04-14T09:58:23.404467+0000","last_active":"2024-04-14T09:58:28.718268+0000","last_peered":"2024-04-14T09:58:28.718268+0000","last_clean":"2024-04-14T09:58:28.718268+0000","last_became_active":"2024-04-14T09:58:23.403864+0000","last_became_peered":"2024-04-14T09:58:23.403864+0000","last_unstale":"2024-04-14T09:58:28.718268+0000","last_undegraded":"2024-04-14T09:58:28.718268+0000","last_fullsized":"2024-04-14T09:58:28.718268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719289+0000","last_change":"2024-04-14T09:58:22.398987+0000","last_active":"2024-04-14T09:58:28.719289+0000","last_peered":"2024-04-14T09:58:28.719289+0000","last_clean":"2024-04-14T09:58:28.719289+0000","last_became_active":"2024-04-14T09:58:22.398682+0000","last_became_peered":"2024-04-14T09:58:22.398682+0000","last_unstale":"2024-04-14T09:58:28.719289+0000","last_undegraded":"2024-04-14T09:58:28.719289+0000","last_fullsized":"2024-04-14T09:58:28.719289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718473+0000","last_change":"2024-04-14T09:58:27.431798+0000","last_active":"2024-04-14T09:58:28.718473+0000","last_peered":"2024-04-14T09:58:28.718473+0000","last_clean":"2024-04-14T09:58:28.718473+0000","last_became_active":"2024-04-14T09:58:27.431417+0000","last_became_peered":"2024-04-14T09:58:27.431417+0000","last_unstale":"2024-04-14T09:58:28.718473+0000","last_undegraded":"2024-04-14T09:58:28.718473+0000","last_fullsized":"2024-04-14T09:58:28.718473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412488+0000","last_change":"2024-04-14T09:58:23.400432+0000","last_active":"2024-04-14T09:58:28.412488+0000","last_peered":"2024-04-14T09:58:28.412488+0000","last_clean":"2024-04-14T09:58:28.412488+0000","last_became_active":"2024-04-14T09:58:23.400175+0000","last_became_peered":"2024-04-14T09:58:23.400175+0000","last_unstale":"2024-04-14T09:58:28.412488+0000","last_undegraded":"2024-04-14T09:58:28.412488+0000","last_fullsized":"2024-04-14T09:58:28.412488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718166+0000","last_change":"2024-04-14T09:58:22.385714+0000","last_active":"2024-04-14T09:58:28.718166+0000","last_peered":"2024-04-14T09:58:28.718166+0000","last_clean":"2024-04-14T09:58:28.718166+0000","last_became_active":"2024-04-14T09:58:22.385337+0000","last_became_peered":"2024-04-14T09:58:22.385337+0000","last_unstale":"2024-04-14T09:58:28.718166+0000","last_undegraded":"2024-04-14T09:58:28.718166+0000","last_fullsized":"2024-04-14T09:58:28.718166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719243+0000","last_change":"2024-04-14T09:58:27.436131+0000","last_active":"2024-04-14T09:58:28.719243+0000","last_peered":"2024-04-14T09:58:28.719243+0000","last_clean":"2024-04-14T09:58:28.719243+0000","last_became_active":"2024-04-14T09:58:27.435730+0000","last_became_peered":"2024-04-14T09:58:27.435730+0000","last_unstale":"2024-04-14T09:58:28.719243+0000","last_undegraded":"2024-04-14T09:58:28.719243+0000","last_fullsized":"2024-04-14T09:58:28.719243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717989+0000","last_change":"2024-04-14T09:58:23.395456+0000","last_active":"2024-04-14T09:58:28.717989+0000","last_peered":"2024-04-14T09:58:28.717989+0000","last_clean":"2024-04-14T09:58:28.717989+0000","last_became_active":"2024-04-14T09:58:23.394235+0000","last_became_peered":"2024-04-14T09:58:23.394235+0000","last_unstale":"2024-04-14T09:58:28.717989+0000","last_undegraded":"2024-04-14T09:58:28.717989+0000","last_fullsized":"2024-04-14T09:58:28.717989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718058+0000","last_change":"2024-04-14T09:58:22.394128+0000","last_active":"2024-04-14T09:58:28.718058+0000","last_peered":"2024-04-14T09:58:28.718058+0000","last_clean":"2024-04-14T09:58:28.718058+0000","last_became_active":"2024-04-14T09:58:22.393765+0000","last_became_peered":"2024-04-14T09:58:22.393765+0000","last_unstale":"2024-04-14T09:58:28.718058+0000","last_undegraded":"2024-04-14T09:58:28.718058+0000","last_fullsized":"2024-04-14T09:58:28.718058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718551+0000","last_change":"2024-04-14T09:58:27.435923+0000","last_active":"2024-04-14T09:58:28.718551+0000","last_peered":"2024-04-14T09:58:28.718551+0000","last_clean":"2024-04-14T09:58:28.718551+0000","last_became_active":"2024-04-14T09:58:27.435542+0000","last_became_peered":"2024-04-14T09:58:27.435542+0000","last_unstale":"2024-04-14T09:58:28.718551+0000","last_undegraded":"2024-04-14T09:58:28.718551+0000","last_fullsized":"2024-04-14T09:58:28.718551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718022+0000","last_change":"2024-04-14T09:58:23.397634+0000","last_active":"2024-04-14T09:58:28.718022+0000","last_peered":"2024-04-14T09:58:28.718022+0000","last_clean":"2024-04-14T09:58:28.718022+0000","last_became_active":"2024-04-14T09:58:23.397351+0000","last_became_peered":"2024-04-14T09:58:23.397351+0000","last_unstale":"2024-04-14T09:58:28.718022+0000","last_undegraded":"2024-04-14T09:58:28.718022+0000","last_fullsized":"2024-04-14T09:58:28.718022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:17.852536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718440+0000","last_change":"2024-04-14T09:58:22.391011+0000","last_active":"2024-04-14T09:58:28.718440+0000","last_peered":"2024-04-14T09:58:28.718440+0000","last_clean":"2024-04-14T09:58:28.718440+0000","last_became_active":"2024-04-14T09:58:22.389916+0000","last_became_peered":"2024-04-14T09:58:22.389916+0000","last_unstale":"2024-04-14T09:58:28.718440+0000","last_undegraded":"2024-04-14T09:58:28.718440+0000","last_fullsized":"2024-04-14T09:58:28.718440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719004+0000","last_change":"2024-04-14T09:58:27.668355+0000","last_active":"2024-04-14T09:58:28.719004+0000","last_peered":"2024-04-14T09:58:28.719004+0000","last_clean":"2024-04-14T09:58:28.719004+0000","last_became_active":"2024-04-14T09:58:27.667937+0000","last_became_peered":"2024-04-14T09:58:27.667937+0000","last_unstale":"2024-04-14T09:58:28.719004+0000","last_undegraded":"2024-04-14T09:58:28.719004+0000","last_fullsized":"2024-04-14T09:58:28.719004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411503+0000","last_change":"2024-04-14T09:58:23.402580+0000","last_active":"2024-04-14T09:58:28.411503+0000","last_peered":"2024-04-14T09:58:28.411503+0000","last_clean":"2024-04-14T09:58:28.411503+0000","last_became_active":"2024-04-14T09:58:23.401893+0000","last_became_peered":"2024-04-14T09:58:23.401893+0000","last_unstale":"2024-04-14T09:58:28.411503+0000","last_undegraded":"2024-04-14T09:58:28.411503+0000","last_fullsized":"2024-04-14T09:58:28.411503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717978+0000","last_change":"2024-04-14T09:58:22.384644+0000","last_active":"2024-04-14T09:58:28.717978+0000","last_peered":"2024-04-14T09:58:28.717978+0000","last_clean":"2024-04-14T09:58:28.717978+0000","last_became_active":"2024-04-14T09:58:22.384367+0000","last_became_peered":"2024-04-14T09:58:22.384367+0000","last_unstale":"2024-04-14T09:58:28.717978+0000","last_undegraded":"2024-04-14T09:58:28.717978+0000","last_fullsized":"2024-04-14T09:58:28.717978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718493+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:58:28.718493+0000","last_peered":"2024-04-14T09:58:28.718493+0000","last_clean":"2024-04-14T09:58:28.718493+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:58:28.718493+0000","last_undegraded":"2024-04-14T09:58:28.718493+0000","last_fullsized":"2024-04-14T09:58:28.718493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717982+0000","last_change":"2024-04-14T09:58:27.668840+0000","last_active":"2024-04-14T09:58:28.717982+0000","last_peered":"2024-04-14T09:58:28.717982+0000","last_clean":"2024-04-14T09:58:28.717982+0000","last_became_active":"2024-04-14T09:58:27.668471+0000","last_became_peered":"2024-04-14T09:58:27.668471+0000","last_unstale":"2024-04-14T09:58:28.717982+0000","last_undegraded":"2024-04-14T09:58:28.717982+0000","last_fullsized":"2024-04-14T09:58:28.717982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719240+0000","last_change":"2024-04-14T09:58:23.409162+0000","last_active":"2024-04-14T09:58:28.719240+0000","last_peered":"2024-04-14T09:58:28.719240+0000","last_clean":"2024-04-14T09:58:28.719240+0000","last_became_active":"2024-04-14T09:58:23.408850+0000","last_became_peered":"2024-04-14T09:58:23.408850+0000","last_unstale":"2024-04-14T09:58:28.719240+0000","last_undegraded":"2024-04-14T09:58:28.719240+0000","last_fullsized":"2024-04-14T09:58:28.719240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:22.384829+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:22.383935+0000","last_became_peered":"2024-04-14T09:58:22.383935+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717969+0000","last_change":"2024-04-14T09:58:27.667909+0000","last_active":"2024-04-14T09:58:28.717969+0000","last_peered":"2024-04-14T09:58:28.717969+0000","last_clean":"2024-04-14T09:58:28.717969+0000","last_became_active":"2024-04-14T09:58:27.667550+0000","last_became_peered":"2024-04-14T09:58:27.667550+0000","last_unstale":"2024-04-14T09:58:28.717969+0000","last_undegraded":"2024-04-14T09:58:28.717969+0000","last_fullsized":"2024-04-14T09:58:28.717969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717961+0000","last_change":"2024-04-14T09:58:23.408028+0000","last_active":"2024-04-14T09:58:28.717961+0000","last_peered":"2024-04-14T09:58:28.717961+0000","last_clean":"2024-04-14T09:58:28.717961+0000","last_became_active":"2024-04-14T09:58:23.407386+0000","last_became_peered":"2024-04-14T09:58:23.407386+0000","last_unstale":"2024-04-14T09:58:28.717961+0000","last_undegraded":"2024-04-14T09:58:28.717961+0000","last_fullsized":"2024-04-14T09:58:28.717961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719337+0000","last_change":"2024-04-14T09:58:22.390083+0000","last_active":"2024-04-14T09:58:28.719337+0000","last_peered":"2024-04-14T09:58:28.719337+0000","last_clean":"2024-04-14T09:58:28.719337+0000","last_became_active":"2024-04-14T09:58:22.389814+0000","last_became_peered":"2024-04-14T09:58:22.389814+0000","last_unstale":"2024-04-14T09:58:28.719337+0000","last_undegraded":"2024-04-14T09:58:28.719337+0000","last_fullsized":"2024-04-14T09:58:28.719337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718671+0000","last_change":"2024-04-14T09:58:27.428137+0000","last_active":"2024-04-14T09:58:28.718671+0000","last_peered":"2024-04-14T09:58:28.718671+0000","last_clean":"2024-04-14T09:58:28.718671+0000","last_became_active":"2024-04-14T09:58:27.427703+0000","last_became_peered":"2024-04-14T09:58:27.427703+0000","last_unstale":"2024-04-14T09:58:28.718671+0000","last_undegraded":"2024-04-14T09:58:28.718671+0000","last_fullsized":"2024-04-14T09:58:28.718671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719613+0000","last_change":"2024-04-14T09:58:23.404910+0000","last_active":"2024-04-14T09:58:28.719613+0000","last_peered":"2024-04-14T09:58:28.719613+0000","last_clean":"2024-04-14T09:58:28.719613+0000","last_became_active":"2024-04-14T09:58:23.404674+0000","last_became_peered":"2024-04-14T09:58:23.404674+0000","last_unstale":"2024-04-14T09:58:28.719613+0000","last_undegraded":"2024-04-14T09:58:28.719613+0000","last_fullsized":"2024-04-14T09:58:28.719613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:55.269064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718569+0000","last_change":"2024-04-14T09:58:22.394100+0000","last_active":"2024-04-14T09:58:28.718569+0000","last_peered":"2024-04-14T09:58:28.718569+0000","last_clean":"2024-04-14T09:58:28.718569+0000","last_became_active":"2024-04-14T09:58:22.393802+0000","last_became_peered":"2024-04-14T09:58:22.393802+0000","last_unstale":"2024-04-14T09:58:28.718569+0000","last_undegraded":"2024-04-14T09:58:28.718569+0000","last_fullsized":"2024-04-14T09:58:28.718569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717532+0000","last_change":"2024-04-14T09:58:27.667932+0000","last_active":"2024-04-14T09:58:28.717532+0000","last_peered":"2024-04-14T09:58:28.717532+0000","last_clean":"2024-04-14T09:58:28.717532+0000","last_became_active":"2024-04-14T09:58:27.667573+0000","last_became_peered":"2024-04-14T09:58:27.667573+0000","last_unstale":"2024-04-14T09:58:28.717532+0000","last_undegraded":"2024-04-14T09:58:28.717532+0000","last_fullsized":"2024-04-14T09:58:28.717532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719102+0000","last_change":"2024-04-14T09:58:23.404327+0000","last_active":"2024-04-14T09:58:28.719102+0000","last_peered":"2024-04-14T09:58:28.719102+0000","last_clean":"2024-04-14T09:58:28.719102+0000","last_became_active":"2024-04-14T09:58:23.403839+0000","last_became_peered":"2024-04-14T09:58:23.403839+0000","last_unstale":"2024-04-14T09:58:28.719102+0000","last_undegraded":"2024-04-14T09:58:28.719102+0000","last_fullsized":"2024-04-14T09:58:28.719102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412068+0000","last_change":"2024-04-14T09:58:22.399651+0000","last_active":"2024-04-14T09:58:28.412068+0000","last_peered":"2024-04-14T09:58:28.412068+0000","last_clean":"2024-04-14T09:58:28.412068+0000","last_became_active":"2024-04-14T09:58:22.399360+0000","last_became_peered":"2024-04-14T09:58:22.399360+0000","last_unstale":"2024-04-14T09:58:28.412068+0000","last_undegraded":"2024-04-14T09:58:28.412068+0000","last_fullsized":"2024-04-14T09:58:28.412068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411723+0000","last_change":"2024-04-14T09:58:27.428173+0000","last_active":"2024-04-14T09:58:28.411723+0000","last_peered":"2024-04-14T09:58:28.411723+0000","last_clean":"2024-04-14T09:58:28.411723+0000","last_became_active":"2024-04-14T09:58:27.427578+0000","last_became_peered":"2024-04-14T09:58:27.427578+0000","last_unstale":"2024-04-14T09:58:28.411723+0000","last_undegraded":"2024-04-14T09:58:28.411723+0000","last_fullsized":"2024-04-14T09:58:28.411723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:22.952495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718706+0000","last_change":"2024-04-14T09:58:23.401131+0000","last_active":"2024-04-14T09:58:28.718706+0000","last_peered":"2024-04-14T09:58:28.718706+0000","last_clean":"2024-04-14T09:58:28.718706+0000","last_became_active":"2024-04-14T09:58:23.400782+0000","last_became_peered":"2024-04-14T09:58:23.400782+0000","last_unstale":"2024-04-14T09:58:28.718706+0000","last_undegraded":"2024-04-14T09:58:28.718706+0000","last_fullsized":"2024-04-14T09:58:28.718706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718236+0000","last_change":"2024-04-14T09:58:22.384480+0000","last_active":"2024-04-14T09:58:28.718236+0000","last_peered":"2024-04-14T09:58:28.718236+0000","last_clean":"2024-04-14T09:58:28.718236+0000","last_became_active":"2024-04-14T09:58:22.384218+0000","last_became_peered":"2024-04-14T09:58:22.384218+0000","last_unstale":"2024-04-14T09:58:28.718236+0000","last_undegraded":"2024-04-14T09:58:28.718236+0000","last_fullsized":"2024-04-14T09:58:28.718236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:27.426500+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:27.426031+0000","last_became_peered":"2024-04-14T09:58:27.426031+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718325+0000","last_change":"2024-04-14T09:58:23.405791+0000","last_active":"2024-04-14T09:58:28.718325+0000","last_peered":"2024-04-14T09:58:28.718325+0000","last_clean":"2024-04-14T09:58:28.718325+0000","last_became_active":"2024-04-14T09:58:23.405500+0000","last_became_peered":"2024-04-14T09:58:23.405500+0000","last_unstale":"2024-04-14T09:58:28.718325+0000","last_undegraded":"2024-04-14T09:58:28.718325+0000","last_fullsized":"2024-04-14T09:58:28.718325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718933+0000","last_change":"2024-04-14T09:58:22.390322+0000","last_active":"2024-04-14T09:58:28.718933+0000","last_peered":"2024-04-14T09:58:28.718933+0000","last_clean":"2024-04-14T09:58:28.718933+0000","last_became_active":"2024-04-14T09:58:22.390024+0000","last_became_peered":"2024-04-14T09:58:22.390024+0000","last_unstale":"2024-04-14T09:58:28.718933+0000","last_undegraded":"2024-04-14T09:58:28.718933+0000","last_fullsized":"2024-04-14T09:58:28.718933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412180+0000","last_change":"2024-04-14T09:58:27.670485+0000","last_active":"2024-04-14T09:58:28.412180+0000","last_peered":"2024-04-14T09:58:28.412180+0000","last_clean":"2024-04-14T09:58:28.412180+0000","last_became_active":"2024-04-14T09:58:27.670080+0000","last_became_peered":"2024-04-14T09:58:27.670080+0000","last_unstale":"2024-04-14T09:58:28.412180+0000","last_undegraded":"2024-04-14T09:58:28.412180+0000","last_fullsized":"2024-04-14T09:58:28.412180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:09.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:23.404680+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:23.404418+0000","last_became_peered":"2024-04-14T09:58:23.404418+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718090+0000","last_change":"2024-04-14T09:58:22.393671+0000","last_active":"2024-04-14T09:58:28.718090+0000","last_peered":"2024-04-14T09:58:28.718090+0000","last_clean":"2024-04-14T09:58:28.718090+0000","last_became_active":"2024-04-14T09:58:22.393431+0000","last_became_peered":"2024-04-14T09:58:22.393431+0000","last_unstale":"2024-04-14T09:58:28.718090+0000","last_undegraded":"2024-04-14T09:58:28.718090+0000","last_fullsized":"2024-04-14T09:58:28.718090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412086+0000","last_change":"2024-04-14T09:58:27.668347+0000","last_active":"2024-04-14T09:58:28.412086+0000","last_peered":"2024-04-14T09:58:28.412086+0000","last_clean":"2024-04-14T09:58:28.412086+0000","last_became_active":"2024-04-14T09:58:27.667469+0000","last_became_peered":"2024-04-14T09:58:27.667469+0000","last_unstale":"2024-04-14T09:58:28.412086+0000","last_undegraded":"2024-04-14T09:58:28.412086+0000","last_fullsized":"2024-04-14T09:58:28.412086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718924+0000","last_change":"2024-04-14T09:58:23.408574+0000","last_active":"2024-04-14T09:58:28.718924+0000","last_peered":"2024-04-14T09:58:28.718924+0000","last_clean":"2024-04-14T09:58:28.718924+0000","last_became_active":"2024-04-14T09:58:23.408295+0000","last_became_peered":"2024-04-14T09:58:23.408295+0000","last_unstale":"2024-04-14T09:58:28.718924+0000","last_undegraded":"2024-04-14T09:58:28.718924+0000","last_fullsized":"2024-04-14T09:58:28.718924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718923+0000","last_change":"2024-04-14T09:58:22.398210+0000","last_active":"2024-04-14T09:58:28.718923+0000","last_peered":"2024-04-14T09:58:28.718923+0000","last_clean":"2024-04-14T09:58:28.718923+0000","last_became_active":"2024-04-14T09:58:22.397939+0000","last_became_peered":"2024-04-14T09:58:22.397939+0000","last_unstale":"2024-04-14T09:58:28.718923+0000","last_undegraded":"2024-04-14T09:58:28.718923+0000","last_fullsized":"2024-04-14T09:58:28.718923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:32:05.174642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718300+0000","last_change":"2024-04-14T09:58:27.668858+0000","last_active":"2024-04-14T09:58:28.718300+0000","last_peered":"2024-04-14T09:58:28.718300+0000","last_clean":"2024-04-14T09:58:28.718300+0000","last_became_active":"2024-04-14T09:58:27.668509+0000","last_became_peered":"2024-04-14T09:58:27.668509+0000","last_unstale":"2024-04-14T09:58:28.718300+0000","last_undegraded":"2024-04-14T09:58:28.718300+0000","last_fullsized":"2024-04-14T09:58:28.718300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719155+0000","last_change":"2024-04-14T09:58:23.403359+0000","last_active":"2024-04-14T09:58:28.719155+0000","last_peered":"2024-04-14T09:58:28.719155+0000","last_clean":"2024-04-14T09:58:28.719155+0000","last_became_active":"2024-04-14T09:58:23.403105+0000","last_became_peered":"2024-04-14T09:58:23.403105+0000","last_unstale":"2024-04-14T09:58:28.719155+0000","last_undegraded":"2024-04-14T09:58:28.719155+0000","last_fullsized":"2024-04-14T09:58:28.719155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:32.895716+0000","last_change":"2024-04-14T09:58:22.393783+0000","last_active":"2024-04-14T09:58:32.895716+0000","last_peered":"2024-04-14T09:58:32.895716+0000","last_clean":"2024-04-14T09:58:32.895716+0000","last_became_active":"2024-04-14T09:58:22.393497+0000","last_became_peered":"2024-04-14T09:58:22.393497+0000","last_unstale":"2024-04-14T09:58:32.895716+0000","last_undegraded":"2024-04-14T09:58:32.895716+0000","last_fullsized":"2024-04-14T09:58:32.895716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718743+0000","last_change":"2024-04-14T09:58:27.435279+0000","last_active":"2024-04-14T09:58:28.718743+0000","last_peered":"2024-04-14T09:58:28.718743+0000","last_clean":"2024-04-14T09:58:28.718743+0000","last_became_active":"2024-04-14T09:58:27.434860+0000","last_became_peered":"2024-04-14T09:58:27.434860+0000","last_unstale":"2024-04-14T09:58:28.718743+0000","last_undegraded":"2024-04-14T09:58:28.718743+0000","last_fullsized":"2024-04-14T09:58:28.718743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412292+0000","last_change":"2024-04-14T09:58:23.406709+0000","last_active":"2024-04-14T09:58:28.412292+0000","last_peered":"2024-04-14T09:58:28.412292+0000","last_clean":"2024-04-14T09:58:28.412292+0000","last_became_active":"2024-04-14T09:58:23.406119+0000","last_became_peered":"2024-04-14T09:58:23.406119+0000","last_unstale":"2024-04-14T09:58:28.412292+0000","last_undegraded":"2024-04-14T09:58:28.412292+0000","last_fullsized":"2024-04-14T09:58:28.412292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:34.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719263+0000","last_change":"2024-04-14T09:58:22.383968+0000","last_active":"2024-04-14T09:58:28.719263+0000","last_peered":"2024-04-14T09:58:28.719263+0000","last_clean":"2024-04-14T09:58:28.719263+0000","last_became_active":"2024-04-14T09:58:22.383573+0000","last_became_peered":"2024-04-14T09:58:22.383573+0000","last_unstale":"2024-04-14T09:58:28.719263+0000","last_undegraded":"2024-04-14T09:58:28.719263+0000","last_fullsized":"2024-04-14T09:58:28.719263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412330+0000","last_change":"2024-04-14T09:58:27.428066+0000","last_active":"2024-04-14T09:58:28.412330+0000","last_peered":"2024-04-14T09:58:28.412330+0000","last_clean":"2024-04-14T09:58:28.412330+0000","last_became_active":"2024-04-14T09:58:27.427579+0000","last_became_peered":"2024-04-14T09:58:27.427579+0000","last_unstale":"2024-04-14T09:58:28.412330+0000","last_undegraded":"2024-04-14T09:58:28.412330+0000","last_fullsized":"2024-04-14T09:58:28.412330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718449+0000","last_change":"2024-04-14T09:58:23.404342+0000","last_active":"2024-04-14T09:58:28.718449+0000","last_peered":"2024-04-14T09:58:28.718449+0000","last_clean":"2024-04-14T09:58:28.718449+0000","last_became_active":"2024-04-14T09:58:23.403726+0000","last_became_peered":"2024-04-14T09:58:23.403726+0000","last_unstale":"2024-04-14T09:58:28.718449+0000","last_undegraded":"2024-04-14T09:58:28.718449+0000","last_fullsized":"2024-04-14T09:58:28.718449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718147+0000","last_change":"2024-04-14T09:58:22.392609+0000","last_active":"2024-04-14T09:58:28.718147+0000","last_peered":"2024-04-14T09:58:28.718147+0000","last_clean":"2024-04-14T09:58:28.718147+0000","last_became_active":"2024-04-14T09:58:22.392332+0000","last_became_peered":"2024-04-14T09:58:22.392332+0000","last_unstale":"2024-04-14T09:58:28.718147+0000","last_undegraded":"2024-04-14T09:58:28.718147+0000","last_fullsized":"2024-04-14T09:58:28.718147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411427+0000","last_change":"2024-04-14T09:58:27.434042+0000","last_active":"2024-04-14T09:58:28.411427+0000","last_peered":"2024-04-14T09:58:28.411427+0000","last_clean":"2024-04-14T09:58:28.411427+0000","last_became_active":"2024-04-14T09:58:27.433635+0000","last_became_peered":"2024-04-14T09:58:27.433635+0000","last_unstale":"2024-04-14T09:58:28.411427+0000","last_undegraded":"2024-04-14T09:58:28.411427+0000","last_fullsized":"2024-04-14T09:58:28.411427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:25.171487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717663+0000","last_change":"2024-04-14T09:58:23.410881+0000","last_active":"2024-04-14T09:58:28.717663+0000","last_peered":"2024-04-14T09:58:28.717663+0000","last_clean":"2024-04-14T09:58:28.717663+0000","last_became_active":"2024-04-14T09:58:23.410383+0000","last_became_peered":"2024-04-14T09:58:23.410383+0000","last_unstale":"2024-04-14T09:58:28.717663+0000","last_undegraded":"2024-04-14T09:58:28.717663+0000","last_fullsized":"2024-04-14T09:58:28.717663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719207+0000","last_change":"2024-04-14T09:58:22.392621+0000","last_active":"2024-04-14T09:58:28.719207+0000","last_peered":"2024-04-14T09:58:28.719207+0000","last_clean":"2024-04-14T09:58:28.719207+0000","last_became_active":"2024-04-14T09:58:22.390883+0000","last_became_peered":"2024-04-14T09:58:22.390883+0000","last_unstale":"2024-04-14T09:58:28.719207+0000","last_undegraded":"2024-04-14T09:58:28.719207+0000","last_fullsized":"2024-04-14T09:58:28.719207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411485+0000","last_change":"2024-04-14T09:58:27.668298+0000","last_active":"2024-04-14T09:58:28.411485+0000","last_peered":"2024-04-14T09:58:28.411485+0000","last_clean":"2024-04-14T09:58:28.411485+0000","last_became_active":"2024-04-14T09:58:27.667944+0000","last_became_peered":"2024-04-14T09:58:27.667944+0000","last_unstale":"2024-04-14T09:58:28.411485+0000","last_undegraded":"2024-04-14T09:58:28.411485+0000","last_fullsized":"2024-04-14T09:58:28.411485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718701+0000","last_change":"2024-04-14T09:58:27.669462+0000","last_active":"2024-04-14T09:58:28.718701+0000","last_peered":"2024-04-14T09:58:28.718701+0000","last_clean":"2024-04-14T09:58:28.718701+0000","last_became_active":"2024-04-14T09:58:27.669027+0000","last_became_peered":"2024-04-14T09:58:27.669027+0000","last_unstale":"2024-04-14T09:58:28.718701+0000","last_undegraded":"2024-04-14T09:58:28.718701+0000","last_fullsized":"2024-04-14T09:58:28.718701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717917+0000","last_change":"2024-04-14T09:58:23.398529+0000","last_active":"2024-04-14T09:58:28.717917+0000","last_peered":"2024-04-14T09:58:28.717917+0000","last_clean":"2024-04-14T09:58:28.717917+0000","last_became_active":"2024-04-14T09:58:23.397726+0000","last_became_peered":"2024-04-14T09:58:23.397726+0000","last_unstale":"2024-04-14T09:58:28.717917+0000","last_undegraded":"2024-04-14T09:58:28.717917+0000","last_fullsized":"2024-04-14T09:58:28.717917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717881+0000","last_change":"2024-04-14T09:58:22.384888+0000","last_active":"2024-04-14T09:58:28.717881+0000","last_peered":"2024-04-14T09:58:28.717881+0000","last_clean":"2024-04-14T09:58:28.717881+0000","last_became_active":"2024-04-14T09:58:22.383944+0000","last_became_peered":"2024-04-14T09:58:22.383944+0000","last_unstale":"2024-04-14T09:58:28.717881+0000","last_undegraded":"2024-04-14T09:58:28.717881+0000","last_fullsized":"2024-04-14T09:58:28.717881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719260+0000","last_change":"2024-04-14T09:58:27.429696+0000","last_active":"2024-04-14T09:58:28.719260+0000","last_peered":"2024-04-14T09:58:28.719260+0000","last_clean":"2024-04-14T09:58:28.719260+0000","last_became_active":"2024-04-14T09:58:27.429288+0000","last_became_peered":"2024-04-14T09:58:27.429288+0000","last_unstale":"2024-04-14T09:58:28.719260+0000","last_undegraded":"2024-04-14T09:58:28.719260+0000","last_fullsized":"2024-04-14T09:58:28.719260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411313+0000","last_change":"2024-04-14T09:58:23.400094+0000","last_active":"2024-04-14T09:58:28.411313+0000","last_peered":"2024-04-14T09:58:28.411313+0000","last_clean":"2024-04-14T09:58:28.411313+0000","last_became_active":"2024-04-14T09:58:23.399785+0000","last_became_peered":"2024-04-14T09:58:23.399785+0000","last_unstale":"2024-04-14T09:58:28.411313+0000","last_undegraded":"2024-04-14T09:58:28.411313+0000","last_fullsized":"2024-04-14T09:58:28.411313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411504+0000","last_change":"2024-04-14T09:58:22.397732+0000","last_active":"2024-04-14T09:58:28.411504+0000","last_peered":"2024-04-14T09:58:28.411504+0000","last_clean":"2024-04-14T09:58:28.411504+0000","last_became_active":"2024-04-14T09:58:22.397449+0000","last_became_peered":"2024-04-14T09:58:22.397449+0000","last_unstale":"2024-04-14T09:58:28.411504+0000","last_undegraded":"2024-04-14T09:58:28.411504+0000","last_fullsized":"2024-04-14T09:58:28.411504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718183+0000","last_change":"2024-04-14T09:58:22.393706+0000","last_active":"2024-04-14T09:58:28.718183+0000","last_peered":"2024-04-14T09:58:28.718183+0000","last_clean":"2024-04-14T09:58:28.718183+0000","last_became_active":"2024-04-14T09:58:22.393405+0000","last_became_peered":"2024-04-14T09:58:22.393405+0000","last_unstale":"2024-04-14T09:58:28.718183+0000","last_undegraded":"2024-04-14T09:58:28.718183+0000","last_fullsized":"2024-04-14T09:58:28.718183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:23.402551+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:23.402184+0000","last_became_peered":"2024-04-14T09:58:23.402184+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717894+0000","last_change":"2024-04-14T09:58:27.432957+0000","last_active":"2024-04-14T09:58:28.717894+0000","last_peered":"2024-04-14T09:58:28.717894+0000","last_clean":"2024-04-14T09:58:28.717894+0000","last_became_active":"2024-04-14T09:58:27.432530+0000","last_became_peered":"2024-04-14T09:58:27.432530+0000","last_unstale":"2024-04-14T09:58:28.717894+0000","last_undegraded":"2024-04-14T09:58:28.717894+0000","last_fullsized":"2024-04-14T09:58:28.717894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:57.757589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411784+0000","last_change":"2024-04-14T09:58:22.391395+0000","last_active":"2024-04-14T09:58:28.411784+0000","last_peered":"2024-04-14T09:58:28.411784+0000","last_clean":"2024-04-14T09:58:28.411784+0000","last_became_active":"2024-04-14T09:58:22.391132+0000","last_became_peered":"2024-04-14T09:58:22.391132+0000","last_unstale":"2024-04-14T09:58:28.411784+0000","last_undegraded":"2024-04-14T09:58:28.411784+0000","last_fullsized":"2024-04-14T09:58:28.411784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:45.950958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411949+0000","last_change":"2024-04-14T09:58:23.396095+0000","last_active":"2024-04-14T09:58:28.411949+0000","last_peered":"2024-04-14T09:58:28.411949+0000","last_clean":"2024-04-14T09:58:28.411949+0000","last_became_active":"2024-04-14T09:58:23.395823+0000","last_became_peered":"2024-04-14T09:58:23.395823+0000","last_unstale":"2024-04-14T09:58:28.411949+0000","last_undegraded":"2024-04-14T09:58:28.411949+0000","last_fullsized":"2024-04-14T09:58:28.411949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:06.520353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412451+0000","last_change":"2024-04-14T09:58:27.432961+0000","last_active":"2024-04-14T09:58:28.412451+0000","last_peered":"2024-04-14T09:58:28.412451+0000","last_clean":"2024-04-14T09:58:28.412451+0000","last_became_active":"2024-04-14T09:58:27.432561+0000","last_became_peered":"2024-04-14T09:58:27.432561+0000","last_unstale":"2024-04-14T09:58:28.412451+0000","last_undegraded":"2024-04-14T09:58:28.412451+0000","last_fullsized":"2024-04-14T09:58:28.412451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:05.795116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718199+0000","last_change":"2024-04-14T09:58:23.407620+0000","last_active":"2024-04-14T09:58:28.718199+0000","last_peered":"2024-04-14T09:58:28.718199+0000","last_clean":"2024-04-14T09:58:28.718199+0000","last_became_active":"2024-04-14T09:58:23.407229+0000","last_became_peered":"2024-04-14T09:58:23.407229+0000","last_unstale":"2024-04-14T09:58:28.718199+0000","last_undegraded":"2024-04-14T09:58:28.718199+0000","last_fullsized":"2024-04-14T09:58:28.718199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717968+0000","last_change":"2024-04-14T09:58:23.401653+0000","last_active":"2024-04-14T09:58:28.717968+0000","last_peered":"2024-04-14T09:58:28.717968+0000","last_clean":"2024-04-14T09:58:28.717968+0000","last_became_active":"2024-04-14T09:58:23.401364+0000","last_became_peered":"2024-04-14T09:58:23.401364+0000","last_unstale":"2024-04-14T09:58:28.717968+0000","last_undegraded":"2024-04-14T09:58:28.717968+0000","last_fullsized":"2024-04-14T09:58:28.717968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718067+0000","last_change":"2024-04-14T09:58:23.408171+0000","last_active":"2024-04-14T09:58:28.718067+0000","last_peered":"2024-04-14T09:58:28.718067+0000","last_clean":"2024-04-14T09:58:28.718067+0000","last_became_active":"2024-04-14T09:58:23.407239+0000","last_became_peered":"2024-04-14T09:58:23.407239+0000","last_unstale":"2024-04-14T09:58:28.718067+0000","last_undegraded":"2024-04-14T09:58:28.718067+0000","last_fullsized":"2024-04-14T09:58:28.718067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718730+0000","last_change":"2024-04-14T09:58:23.404101+0000","last_active":"2024-04-14T09:58:28.718730+0000","last_peered":"2024-04-14T09:58:28.718730+0000","last_clean":"2024-04-14T09:58:28.718730+0000","last_became_active":"2024-04-14T09:58:23.403370+0000","last_became_peered":"2024-04-14T09:58:23.403370+0000","last_unstale":"2024-04-14T09:58:28.718730+0000","last_undegraded":"2024-04-14T09:58:28.718730+0000","last_fullsized":"2024-04-14T09:58:28.718730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:17:06.376909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412345+0000","last_change":"2024-04-14T09:58:23.404808+0000","last_active":"2024-04-14T09:58:28.412345+0000","last_peered":"2024-04-14T09:58:28.412345+0000","last_clean":"2024-04-14T09:58:28.412345+0000","last_became_active":"2024-04-14T09:58:23.404405+0000","last_became_peered":"2024-04-14T09:58:23.404405+0000","last_unstale":"2024-04-14T09:58:28.412345+0000","last_undegraded":"2024-04-14T09:58:28.412345+0000","last_fullsized":"2024-04-14T09:58:28.412345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719094+0000","last_change":"2024-04-14T09:58:23.404182+0000","last_active":"2024-04-14T09:58:28.719094+0000","last_peered":"2024-04-14T09:58:28.719094+0000","last_clean":"2024-04-14T09:58:28.719094+0000","last_became_active":"2024-04-14T09:58:23.403910+0000","last_became_peered":"2024-04-14T09:58:23.403910+0000","last_unstale":"2024-04-14T09:58:28.719094+0000","last_undegraded":"2024-04-14T09:58:28.719094+0000","last_fullsized":"2024-04-14T09:58:28.719094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719413+0000","last_change":"2024-04-14T09:58:23.408207+0000","last_active":"2024-04-14T09:58:28.719413+0000","last_peered":"2024-04-14T09:58:28.719413+0000","last_clean":"2024-04-14T09:58:28.719413+0000","last_became_active":"2024-04-14T09:58:23.406767+0000","last_became_peered":"2024-04-14T09:58:23.406767+0000","last_unstale":"2024-04-14T09:58:28.719413+0000","last_undegraded":"2024-04-14T09:58:28.719413+0000","last_fullsized":"2024-04-14T09:58:28.719413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412204+0000","last_change":"2024-04-14T09:58:23.406514+0000","last_active":"2024-04-14T09:58:28.412204+0000","last_peered":"2024-04-14T09:58:28.412204+0000","last_clean":"2024-04-14T09:58:28.412204+0000","last_became_active":"2024-04-14T09:58:23.405465+0000","last_became_peered":"2024-04-14T09:58:23.405465+0000","last_unstale":"2024-04-14T09:58:28.412204+0000","last_undegraded":"2024-04-14T09:58:28.412204+0000","last_fullsized":"2024-04-14T09:58:28.412204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717813+0000","last_change":"2024-04-14T09:58:23.406224+0000","last_active":"2024-04-14T09:58:28.717813+0000","last_peered":"2024-04-14T09:58:28.717813+0000","last_clean":"2024-04-14T09:58:28.717813+0000","last_became_active":"2024-04-14T09:58:23.405960+0000","last_became_peered":"2024-04-14T09:58:23.405960+0000","last_unstale":"2024-04-14T09:58:28.717813+0000","last_undegraded":"2024-04-14T09:58:28.717813+0000","last_fullsized":"2024-04-14T09:58:28.717813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411302+0000","last_change":"2024-04-14T09:58:23.397512+0000","last_active":"2024-04-14T09:58:28.411302+0000","last_peered":"2024-04-14T09:58:28.411302+0000","last_clean":"2024-04-14T09:58:28.411302+0000","last_became_active":"2024-04-14T09:58:23.397243+0000","last_became_peered":"2024-04-14T09:58:23.397243+0000","last_unstale":"2024-04-14T09:58:28.411302+0000","last_undegraded":"2024-04-14T09:58:28.411302+0000","last_fullsized":"2024-04-14T09:58:28.411302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718006+0000","last_change":"2024-04-14T09:58:23.397450+0000","last_active":"2024-04-14T09:58:28.718006+0000","last_peered":"2024-04-14T09:58:28.718006+0000","last_clean":"2024-04-14T09:58:28.718006+0000","last_became_active":"2024-04-14T09:58:23.397165+0000","last_became_peered":"2024-04-14T09:58:23.397165+0000","last_unstale":"2024-04-14T09:58:28.718006+0000","last_undegraded":"2024-04-14T09:58:28.718006+0000","last_fullsized":"2024-04-14T09:58:28.718006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718469+0000","last_change":"2024-04-14T09:58:23.407381+0000","last_active":"2024-04-14T09:58:28.718469+0000","last_peered":"2024-04-14T09:58:28.718469+0000","last_clean":"2024-04-14T09:58:28.718469+0000","last_became_active":"2024-04-14T09:58:23.407118+0000","last_became_peered":"2024-04-14T09:58:23.407118+0000","last_unstale":"2024-04-14T09:58:28.718469+0000","last_undegraded":"2024-04-14T09:58:28.718469+0000","last_fullsized":"2024-04-14T09:58:28.718469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718613+0000","last_change":"2024-04-14T09:58:23.404570+0000","last_active":"2024-04-14T09:58:28.718613+0000","last_peered":"2024-04-14T09:58:28.718613+0000","last_clean":"2024-04-14T09:58:28.718613+0000","last_became_active":"2024-04-14T09:58:23.404262+0000","last_became_peered":"2024-04-14T09:58:23.404262+0000","last_unstale":"2024-04-14T09:58:28.718613+0000","last_undegraded":"2024-04-14T09:58:28.718613+0000","last_fullsized":"2024-04-14T09:58:28.718613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719427+0000","last_change":"2024-04-14T09:58:23.404295+0000","last_active":"2024-04-14T09:58:28.719427+0000","last_peered":"2024-04-14T09:58:28.719427+0000","last_clean":"2024-04-14T09:58:28.719427+0000","last_became_active":"2024-04-14T09:58:23.404005+0000","last_became_peered":"2024-04-14T09:58:23.404005+0000","last_unstale":"2024-04-14T09:58:28.719427+0000","last_undegraded":"2024-04-14T09:58:28.719427+0000","last_fullsized":"2024-04-14T09:58:28.719427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718467+0000","last_change":"2024-04-14T09:58:23.407616+0000","last_active":"2024-04-14T09:58:28.718467+0000","last_peered":"2024-04-14T09:58:28.718467+0000","last_clean":"2024-04-14T09:58:28.718467+0000","last_became_active":"2024-04-14T09:58:23.407260+0000","last_became_peered":"2024-04-14T09:58:23.407260+0000","last_unstale":"2024-04-14T09:58:28.718467+0000","last_undegraded":"2024-04-14T09:58:28.718467+0000","last_fullsized":"2024-04-14T09:58:28.718467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718039+0000","last_change":"2024-04-14T09:58:23.410650+0000","last_active":"2024-04-14T09:58:28.718039+0000","last_peered":"2024-04-14T09:58:28.718039+0000","last_clean":"2024-04-14T09:58:28.718039+0000","last_became_active":"2024-04-14T09:58:23.410379+0000","last_became_peered":"2024-04-14T09:58:23.410379+0000","last_unstale":"2024-04-14T09:58:28.718039+0000","last_undegraded":"2024-04-14T09:58:28.718039+0000","last_fullsized":"2024-04-14T09:58:28.718039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717749+0000","last_change":"2024-04-14T09:58:23.398466+0000","last_active":"2024-04-14T09:58:28.717749+0000","last_peered":"2024-04-14T09:58:28.717749+0000","last_clean":"2024-04-14T09:58:28.717749+0000","last_became_active":"2024-04-14T09:58:23.398189+0000","last_became_peered":"2024-04-14T09:58:23.398189+0000","last_unstale":"2024-04-14T09:58:28.717749+0000","last_undegraded":"2024-04-14T09:58:28.717749+0000","last_fullsized":"2024-04-14T09:58:28.717749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718017+0000","last_change":"2024-04-14T09:58:23.393259+0000","last_active":"2024-04-14T09:58:28.718017+0000","last_peered":"2024-04-14T09:58:28.718017+0000","last_clean":"2024-04-14T09:58:28.718017+0000","last_became_active":"2024-04-14T09:58:23.392971+0000","last_became_peered":"2024-04-14T09:58:23.392971+0000","last_unstale":"2024-04-14T09:58:28.718017+0000","last_undegraded":"2024-04-14T09:58:28.718017+0000","last_fullsized":"2024-04-14T09:58:28.718017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718832+0000","last_change":"2024-04-14T09:58:23.398828+0000","last_active":"2024-04-14T09:58:28.718832+0000","last_peered":"2024-04-14T09:58:28.718832+0000","last_clean":"2024-04-14T09:58:28.718832+0000","last_became_active":"2024-04-14T09:58:23.398386+0000","last_became_peered":"2024-04-14T09:58:23.398386+0000","last_unstale":"2024-04-14T09:58:28.718832+0000","last_undegraded":"2024-04-14T09:58:28.718832+0000","last_fullsized":"2024-04-14T09:58:28.718832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411945+0000","last_change":"2024-04-14T09:58:23.407691+0000","last_active":"2024-04-14T09:58:28.411945+0000","last_peered":"2024-04-14T09:58:28.411945+0000","last_clean":"2024-04-14T09:58:28.411945+0000","last_became_active":"2024-04-14T09:58:23.407271+0000","last_became_peered":"2024-04-14T09:58:23.407271+0000","last_unstale":"2024-04-14T09:58:28.411945+0000","last_undegraded":"2024-04-14T09:58:28.411945+0000","last_fullsized":"2024-04-14T09:58:28.411945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412261+0000","last_change":"2024-04-14T09:58:23.405452+0000","last_active":"2024-04-14T09:58:28.412261+0000","last_peered":"2024-04-14T09:58:28.412261+0000","last_clean":"2024-04-14T09:58:28.412261+0000","last_became_active":"2024-04-14T09:58:23.404804+0000","last_became_peered":"2024-04-14T09:58:23.404804+0000","last_unstale":"2024-04-14T09:58:28.412261+0000","last_undegraded":"2024-04-14T09:58:28.412261+0000","last_fullsized":"2024-04-14T09:58:28.412261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718106+0000","last_change":"2024-04-14T09:58:23.413350+0000","last_active":"2024-04-14T09:58:28.718106+0000","last_peered":"2024-04-14T09:58:28.718106+0000","last_clean":"2024-04-14T09:58:28.718106+0000","last_became_active":"2024-04-14T09:58:23.413030+0000","last_became_peered":"2024-04-14T09:58:23.413030+0000","last_unstale":"2024-04-14T09:58:28.718106+0000","last_undegraded":"2024-04-14T09:58:28.718106+0000","last_fullsized":"2024-04-14T09:58:28.718106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719331+0000","last_change":"2024-04-14T09:58:23.411335+0000","last_active":"2024-04-14T09:58:28.719331+0000","last_peered":"2024-04-14T09:58:28.719331+0000","last_clean":"2024-04-14T09:58:28.719331+0000","last_became_active":"2024-04-14T09:58:23.409283+0000","last_became_peered":"2024-04-14T09:58:23.409283+0000","last_unstale":"2024-04-14T09:58:28.719331+0000","last_undegraded":"2024-04-14T09:58:28.719331+0000","last_fullsized":"2024-04-14T09:58:28.719331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719533+0000","last_change":"2024-04-14T09:58:23.408154+0000","last_active":"2024-04-14T09:58:28.719533+0000","last_peered":"2024-04-14T09:58:28.719533+0000","last_clean":"2024-04-14T09:58:28.719533+0000","last_became_active":"2024-04-14T09:58:23.407848+0000","last_became_peered":"2024-04-14T09:58:23.407848+0000","last_unstale":"2024-04-14T09:58:28.719533+0000","last_undegraded":"2024-04-14T09:58:28.719533+0000","last_fullsized":"2024-04-14T09:58:28.719533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411189+0000","last_change":"2024-04-14T09:58:23.399466+0000","last_active":"2024-04-14T09:58:28.411189+0000","last_peered":"2024-04-14T09:58:28.411189+0000","last_clean":"2024-04-14T09:58:28.411189+0000","last_became_active":"2024-04-14T09:58:23.399192+0000","last_became_peered":"2024-04-14T09:58:23.399192+0000","last_unstale":"2024-04-14T09:58:28.411189+0000","last_undegraded":"2024-04-14T09:58:28.411189+0000","last_fullsized":"2024-04-14T09:58:28.411189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718615+0000","last_change":"2024-04-14T09:58:23.402089+0000","last_active":"2024-04-14T09:58:28.718615+0000","last_peered":"2024-04-14T09:58:28.718615+0000","last_clean":"2024-04-14T09:58:28.718615+0000","last_became_active":"2024-04-14T09:58:23.401791+0000","last_became_peered":"2024-04-14T09:58:23.401791+0000","last_unstale":"2024-04-14T09:58:28.718615+0000","last_undegraded":"2024-04-14T09:58:28.718615+0000","last_fullsized":"2024-04-14T09:58:28.718615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717901+0000","last_change":"2024-04-14T09:58:23.400405+0000","last_active":"2024-04-14T09:58:28.717901+0000","last_peered":"2024-04-14T09:58:28.717901+0000","last_clean":"2024-04-14T09:58:28.717901+0000","last_became_active":"2024-04-14T09:58:23.400094+0000","last_became_peered":"2024-04-14T09:58:23.400094+0000","last_unstale":"2024-04-14T09:58:28.717901+0000","last_undegraded":"2024-04-14T09:58:28.717901+0000","last_fullsized":"2024-04-14T09:58:28.717901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718700+0000","last_change":"2024-04-14T09:58:23.401268+0000","last_active":"2024-04-14T09:58:28.718700+0000","last_peered":"2024-04-14T09:58:28.718700+0000","last_clean":"2024-04-14T09:58:28.718700+0000","last_became_active":"2024-04-14T09:58:23.400978+0000","last_became_peered":"2024-04-14T09:58:23.400978+0000","last_unstale":"2024-04-14T09:58:28.718700+0000","last_undegraded":"2024-04-14T09:58:28.718700+0000","last_fullsized":"2024-04-14T09:58:28.718700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717724+0000","last_change":"2024-04-14T09:58:23.410361+0000","last_active":"2024-04-14T09:58:28.717724+0000","last_peered":"2024-04-14T09:58:28.717724+0000","last_clean":"2024-04-14T09:58:28.717724+0000","last_became_active":"2024-04-14T09:58:23.407726+0000","last_became_peered":"2024-04-14T09:58:23.407726+0000","last_unstale":"2024-04-14T09:58:28.717724+0000","last_undegraded":"2024-04-14T09:58:28.717724+0000","last_fullsized":"2024-04-14T09:58:28.717724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719465+0000","last_change":"2024-04-14T09:58:23.402602+0000","last_active":"2024-04-14T09:58:28.719465+0000","last_peered":"2024-04-14T09:58:28.719465+0000","last_clean":"2024-04-14T09:58:28.719465+0000","last_became_active":"2024-04-14T09:58:23.402243+0000","last_became_peered":"2024-04-14T09:58:23.402243+0000","last_unstale":"2024-04-14T09:58:28.719465+0000","last_undegraded":"2024-04-14T09:58:28.719465+0000","last_fullsized":"2024-04-14T09:58:28.719465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:37.707556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719506+0000","last_change":"2024-04-14T09:58:23.399802+0000","last_active":"2024-04-14T09:58:28.719506+0000","last_peered":"2024-04-14T09:58:28.719506+0000","last_clean":"2024-04-14T09:58:28.719506+0000","last_became_active":"2024-04-14T09:58:23.399467+0000","last_became_peered":"2024-04-14T09:58:23.399467+0000","last_unstale":"2024-04-14T09:58:28.719506+0000","last_undegraded":"2024-04-14T09:58:28.719506+0000","last_fullsized":"2024-04-14T09:58:28.719506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719375+0000","last_change":"2024-04-14T09:58:23.406066+0000","last_active":"2024-04-14T09:58:28.719375+0000","last_peered":"2024-04-14T09:58:28.719375+0000","last_clean":"2024-04-14T09:58:28.719375+0000","last_became_active":"2024-04-14T09:58:23.405739+0000","last_became_peered":"2024-04-14T09:58:23.405739+0000","last_unstale":"2024-04-14T09:58:28.719375+0000","last_undegraded":"2024-04-14T09:58:28.719375+0000","last_fullsized":"2024-04-14T09:58:28.719375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:58:50.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:58:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 Processor -- start 2024-04-14T09:58:51.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 -- start start 2024-04-14T09:58:51.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6c3015e650 0x7f6c300b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c300b4760 0x7f6c300d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c300b4c70 con 0x7f6c300d2cb0 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6c300d3120 con 0x7f6c300b4760 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.082+0000 7f6c351fe640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6c300b5880 con 0x7f6c3015e650 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c300b4760 0x7f6c300d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6c300b4760 0x7f6c300d2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55180/0 (socket says 172.21.15.40:55180) 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 -- 172.21.15.40:0/3017541484 learned_addr learned my addr 172.21.15.40:0/3017541484 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2ed9d640 1 --2- 172.21.15.40:0/3017541484 >> v2:172.21.15.136:3300/0 conn(0x7f6c3015e650 0x7f6c300b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 -- 172.21.15.40:0/3017541484 >> v2:172.21.15.136:3300/0 conn(0x7f6c3015e650 msgr2=0x7f6c300b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 --2- 172.21.15.40:0/3017541484 >> v2:172.21.15.136:3300/0 conn(0x7f6c3015e650 0x7f6c300b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 -- 172.21.15.40:0/3017541484 >> v1:172.21.15.136:6789/0 conn(0x7f6c300d2cb0 legacy=0x7f6c301622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2dd9b640 1 -- 172.21.15.40:0/3017541484 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2952042142 0 0) 0x7f6c300b4c70 con 0x7f6c300d2cb0 2024-04-14T09:58:51.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.083+0000 7f6c2e59c640 1 -- 172.21.15.40:0/3017541484 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c300b4f50 con 0x7f6c300b4760 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c2e59c640 1 --2- 172.21.15.40:0/3017541484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300d2770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c300b6e10 tx=0x7f6c2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eca3f2d04cafd4d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c2dd9b640 1 -- 172.21.15.40:0/3017541484 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24034070 con 0x7f6c300b4760 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c2dd9b640 1 -- 172.21.15.40:0/3017541484 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c24030860 con 0x7f6c300b4760 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c2dd9b640 1 -- 172.21.15.40:0/3017541484 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24030c30 con 0x7f6c300b4760 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 -- 172.21.15.40:0/3017541484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 msgr2=0x7f6c300d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 --2- 172.21.15.40:0/3017541484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300d2770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c300b6e10 tx=0x7f6c2402b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 -- 172.21.15.40:0/3017541484 shutdown_connections 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 --2- 172.21.15.40:0/3017541484 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300d2770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 --2- 172.21.15.40:0/3017541484 >> v2:172.21.15.136:3300/0 conn(0x7f6c3015e650 0x7f6c300b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 -- 172.21.15.40:0/3017541484 >> 172.21.15.40:0/3017541484 conn(0x7f6c3009d580 msgr2=0x7f6c300d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 -- 172.21.15.40:0/3017541484 shutdown_connections 2024-04-14T09:58:51.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.084+0000 7f6c351fe640 1 -- 172.21.15.40:0/3017541484 wait complete. 2024-04-14T09:58:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 Processor -- start 2024-04-14T09:58:51.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 -- start start 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c300d2cb0 0x7f6c300cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 0x7f6c300c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6c300d2270 con 0x7f6c300b4760 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6c300b5510 con 0x7f6c3015e650 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c351fe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6c3015ea30 con 0x7f6c300d2cb0 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c2ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.086+0000 7f6c2ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55196/0 (socket says 172.21.15.40:55196) 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 -- 172.21.15.40:0/4268945673 learned_addr learned my addr 172.21.15.40:0/4268945673 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2e59c640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c300d2cb0 0x7f6c300cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2f59e640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 0x7f6c300c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 -- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c300d2cb0 msgr2=0x7f6c300cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c300d2cb0 0x7f6c300cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 -- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 msgr2=0x7f6c300c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 0x7f6c300c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 -- 172.21.15.40:0/4268945673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c300ce360 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2f59e640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 0x7f6c300c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c2ed9d640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e9b0 tx=0x7f6c2000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c20017070 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c2000c9a0 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c300c8470 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2000cd90 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.087+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c300c8a30 con 0x7f6c300b4760 2024-04-14T09:58:51.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.088+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c300756f0 con 0x7f6c300b4760 2024-04-14T09:58:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.088+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c2001a070 con 0x7f6c300b4760 2024-04-14T09:58:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.089+0000 7f6c177fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 0x7f6c1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.089+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6c2008be00 con 0x7f6c300b4760 2024-04-14T09:58:51.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.089+0000 7f6c2e59c640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 0x7f6c1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.089+0000 7f6c2e59c640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 0x7f6c1c06ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c24036000 tx=0x7f6c2403c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.093+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6c20059880 con 0x7f6c300b4760 2024-04-14T09:58:51.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.273+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c300ce960 con 0x7f6c1c06c920 2024-04-14T09:58:51.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.281+0000 7f6c177fe640 1 -- 172.21.15.40:0/4268945673 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f6c2409b310 con 0x7f6c1c06c920 2024-04-14T09:58:51.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:51.285 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 msgr2=0x7f6c1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 0x7f6c1c06ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c24036000 tx=0x7f6c2403c040 comp rx=0 tx=0).stop 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 msgr2=0x7f6c300c7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6c2000e9b0 tx=0x7f6c2000ee70 comp rx=0 tx=0).stop 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 shutdown_connections 2024-04-14T09:58:51.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6c1c06c920 0x7f6c1c06ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c3015e650 0x7f6c300c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c300d2cb0 0x7f6c300cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 --2- 172.21.15.40:0/4268945673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6c300b4760 0x7f6c300c7de0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 >> 172.21.15.40:0/4268945673 conn(0x7f6c3009d580 msgr2=0x7f6c3015d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 shutdown_connections 2024-04-14T09:58:51.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.284+0000 7f6c351fe640 1 -- 172.21.15.40:0/4268945673 wait complete. 2024-04-14T09:58:51.295 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-14T09:58:50.814916+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3383296,"data_stored":2029432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008098"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718547+0000","last_change":"2024-04-14T09:58:22.400374+0000","last_active":"2024-04-14T09:58:28.718547+0000","last_peered":"2024-04-14T09:58:28.718547+0000","last_clean":"2024-04-14T09:58:28.718547+0000","last_became_active":"2024-04-14T09:58:22.400083+0000","last_became_peered":"2024-04-14T09:58:22.400083+0000","last_unstale":"2024-04-14T09:58:28.718547+0000","last_undegraded":"2024-04-14T09:58:28.718547+0000","last_fullsized":"2024-04-14T09:58:28.718547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411956+0000","last_change":"2024-04-14T09:58:23.405589+0000","last_active":"2024-04-14T09:58:28.411956+0000","last_peered":"2024-04-14T09:58:28.411956+0000","last_clean":"2024-04-14T09:58:28.411956+0000","last_became_active":"2024-04-14T09:58:23.405288+0000","last_became_peered":"2024-04-14T09:58:23.405288+0000","last_unstale":"2024-04-14T09:58:28.411956+0000","last_undegraded":"2024-04-14T09:58:28.411956+0000","last_fullsized":"2024-04-14T09:58:28.411956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411293+0000","last_change":"2024-04-14T09:58:27.669278+0000","last_active":"2024-04-14T09:58:28.411293+0000","last_peered":"2024-04-14T09:58:28.411293+0000","last_clean":"2024-04-14T09:58:28.411293+0000","last_became_active":"2024-04-14T09:58:27.668928+0000","last_became_peered":"2024-04-14T09:58:27.668928+0000","last_unstale":"2024-04-14T09:58:28.411293+0000","last_undegraded":"2024-04-14T09:58:28.411293+0000","last_fullsized":"2024-04-14T09:58:28.411293+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:59.301538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412073+0000","last_change":"2024-04-14T09:58:22.396110+0000","last_active":"2024-04-14T09:58:28.412073+0000","last_peered":"2024-04-14T09:58:28.412073+0000","last_clean":"2024-04-14T09:58:28.412073+0000","last_became_active":"2024-04-14T09:58:22.395818+0000","last_became_peered":"2024-04-14T09:58:22.395818+0000","last_unstale":"2024-04-14T09:58:28.412073+0000","last_undegraded":"2024-04-14T09:58:28.412073+0000","last_fullsized":"2024-04-14T09:58:28.412073+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:02:50.002691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718273+0000","last_change":"2024-04-14T09:58:23.405100+0000","last_active":"2024-04-14T09:58:28.718273+0000","last_peered":"2024-04-14T09:58:28.718273+0000","last_clean":"2024-04-14T09:58:28.718273+0000","last_became_active":"2024-04-14T09:58:23.404837+0000","last_became_peered":"2024-04-14T09:58:23.404837+0000","last_unstale":"2024-04-14T09:58:28.718273+0000","last_undegraded":"2024-04-14T09:58:28.718273+0000","last_fullsized":"2024-04-14T09:58:28.718273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:53.725115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411717+0000","last_change":"2024-04-14T09:58:27.431626+0000","last_active":"2024-04-14T09:58:28.411717+0000","last_peered":"2024-04-14T09:58:28.411717+0000","last_clean":"2024-04-14T09:58:28.411717+0000","last_became_active":"2024-04-14T09:58:27.431160+0000","last_became_peered":"2024-04-14T09:58:27.431160+0000","last_unstale":"2024-04-14T09:58:28.411717+0000","last_undegraded":"2024-04-14T09:58:28.411717+0000","last_fullsized":"2024-04-14T09:58:28.411717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:01.933626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719419+0000","last_change":"2024-04-14T09:58:22.396291+0000","last_active":"2024-04-14T09:58:28.719419+0000","last_peered":"2024-04-14T09:58:28.719419+0000","last_clean":"2024-04-14T09:58:28.719419+0000","last_became_active":"2024-04-14T09:58:22.396071+0000","last_became_peered":"2024-04-14T09:58:22.396071+0000","last_unstale":"2024-04-14T09:58:28.719419+0000","last_undegraded":"2024-04-14T09:58:28.719419+0000","last_fullsized":"2024-04-14T09:58:28.719419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717868+0000","last_change":"2024-04-14T09:58:23.397574+0000","last_active":"2024-04-14T09:58:28.717868+0000","last_peered":"2024-04-14T09:58:28.717868+0000","last_clean":"2024-04-14T09:58:28.717868+0000","last_became_active":"2024-04-14T09:58:23.397261+0000","last_became_peered":"2024-04-14T09:58:23.397261+0000","last_unstale":"2024-04-14T09:58:28.717868+0000","last_undegraded":"2024-04-14T09:58:28.717868+0000","last_fullsized":"2024-04-14T09:58:28.717868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412409+0000","last_change":"2024-04-14T09:58:27.427865+0000","last_active":"2024-04-14T09:58:28.412409+0000","last_peered":"2024-04-14T09:58:28.412409+0000","last_clean":"2024-04-14T09:58:28.412409+0000","last_became_active":"2024-04-14T09:58:27.427483+0000","last_became_peered":"2024-04-14T09:58:27.427483+0000","last_unstale":"2024-04-14T09:58:28.412409+0000","last_undegraded":"2024-04-14T09:58:28.412409+0000","last_fullsized":"2024-04-14T09:58:28.412409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718852+0000","last_change":"2024-04-14T09:58:22.394942+0000","last_active":"2024-04-14T09:58:28.718852+0000","last_peered":"2024-04-14T09:58:28.718852+0000","last_clean":"2024-04-14T09:58:28.718852+0000","last_became_active":"2024-04-14T09:58:22.394679+0000","last_became_peered":"2024-04-14T09:58:22.394679+0000","last_unstale":"2024-04-14T09:58:28.718852+0000","last_undegraded":"2024-04-14T09:58:28.718852+0000","last_fullsized":"2024-04-14T09:58:28.718852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:33.668503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718216+0000","last_change":"2024-04-14T09:58:23.402824+0000","last_active":"2024-04-14T09:58:28.718216+0000","last_peered":"2024-04-14T09:58:28.718216+0000","last_clean":"2024-04-14T09:58:28.718216+0000","last_became_active":"2024-04-14T09:58:23.402246+0000","last_became_peered":"2024-04-14T09:58:23.402246+0000","last_unstale":"2024-04-14T09:58:28.718216+0000","last_undegraded":"2024-04-14T09:58:28.718216+0000","last_fullsized":"2024-04-14T09:58:28.718216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411885+0000","last_change":"2024-04-14T09:58:27.423837+0000","last_active":"2024-04-14T09:58:28.411885+0000","last_peered":"2024-04-14T09:58:28.411885+0000","last_clean":"2024-04-14T09:58:28.411885+0000","last_became_active":"2024-04-14T09:58:27.423439+0000","last_became_peered":"2024-04-14T09:58:27.423439+0000","last_unstale":"2024-04-14T09:58:28.411885+0000","last_undegraded":"2024-04-14T09:58:28.411885+0000","last_fullsized":"2024-04-14T09:58:28.411885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:48.989054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718018+0000","last_change":"2024-04-14T09:58:23.404740+0000","last_active":"2024-04-14T09:58:28.718018+0000","last_peered":"2024-04-14T09:58:28.718018+0000","last_clean":"2024-04-14T09:58:28.718018+0000","last_became_active":"2024-04-14T09:58:23.404362+0000","last_became_peered":"2024-04-14T09:58:23.404362+0000","last_unstale":"2024-04-14T09:58:28.718018+0000","last_undegraded":"2024-04-14T09:58:28.718018+0000","last_fullsized":"2024-04-14T09:58:28.718018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719028+0000","last_change":"2024-04-14T09:58:22.391425+0000","last_active":"2024-04-14T09:58:28.719028+0000","last_peered":"2024-04-14T09:58:28.719028+0000","last_clean":"2024-04-14T09:58:28.719028+0000","last_became_active":"2024-04-14T09:58:22.391062+0000","last_became_peered":"2024-04-14T09:58:22.391062+0000","last_unstale":"2024-04-14T09:58:28.719028+0000","last_undegraded":"2024-04-14T09:58:28.719028+0000","last_fullsized":"2024-04-14T09:58:28.719028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:45.817473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412039+0000","last_change":"2024-04-14T09:58:27.431221+0000","last_active":"2024-04-14T09:58:28.412039+0000","last_peered":"2024-04-14T09:58:28.412039+0000","last_clean":"2024-04-14T09:58:28.412039+0000","last_became_active":"2024-04-14T09:58:27.430764+0000","last_became_peered":"2024-04-14T09:58:27.430764+0000","last_unstale":"2024-04-14T09:58:28.412039+0000","last_undegraded":"2024-04-14T09:58:28.412039+0000","last_fullsized":"2024-04-14T09:58:28.412039+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411673+0000","last_change":"2024-04-14T09:58:23.403246+0000","last_active":"2024-04-14T09:58:28.411673+0000","last_peered":"2024-04-14T09:58:28.411673+0000","last_clean":"2024-04-14T09:58:28.411673+0000","last_became_active":"2024-04-14T09:58:23.402610+0000","last_became_peered":"2024-04-14T09:58:23.402610+0000","last_unstale":"2024-04-14T09:58:28.411673+0000","last_undegraded":"2024-04-14T09:58:28.411673+0000","last_fullsized":"2024-04-14T09:58:28.411673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718903+0000","last_change":"2024-04-14T09:58:22.395168+0000","last_active":"2024-04-14T09:58:28.718903+0000","last_peered":"2024-04-14T09:58:28.718903+0000","last_clean":"2024-04-14T09:58:28.718903+0000","last_became_active":"2024-04-14T09:58:22.394913+0000","last_became_peered":"2024-04-14T09:58:22.394913+0000","last_unstale":"2024-04-14T09:58:28.718903+0000","last_undegraded":"2024-04-14T09:58:28.718903+0000","last_fullsized":"2024-04-14T09:58:28.718903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412208+0000","last_change":"2024-04-14T09:58:27.431150+0000","last_active":"2024-04-14T09:58:28.412208+0000","last_peered":"2024-04-14T09:58:28.412208+0000","last_clean":"2024-04-14T09:58:28.412208+0000","last_became_active":"2024-04-14T09:58:27.430727+0000","last_became_peered":"2024-04-14T09:58:27.430727+0000","last_unstale":"2024-04-14T09:58:28.412208+0000","last_undegraded":"2024-04-14T09:58:28.412208+0000","last_fullsized":"2024-04-14T09:58:28.412208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411542+0000","last_change":"2024-04-14T09:58:23.396679+0000","last_active":"2024-04-14T09:58:28.411542+0000","last_peered":"2024-04-14T09:58:28.411542+0000","last_clean":"2024-04-14T09:58:28.411542+0000","last_became_active":"2024-04-14T09:58:23.396401+0000","last_became_peered":"2024-04-14T09:58:23.396401+0000","last_unstale":"2024-04-14T09:58:28.411542+0000","last_undegraded":"2024-04-14T09:58:28.411542+0000","last_fullsized":"2024-04-14T09:58:28.411542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718109+0000","last_change":"2024-04-14T09:58:22.390340+0000","last_active":"2024-04-14T09:58:28.718109+0000","last_peered":"2024-04-14T09:58:28.718109+0000","last_clean":"2024-04-14T09:58:28.718109+0000","last_became_active":"2024-04-14T09:58:22.390062+0000","last_became_peered":"2024-04-14T09:58:22.390062+0000","last_unstale":"2024-04-14T09:58:28.718109+0000","last_undegraded":"2024-04-14T09:58:28.718109+0000","last_fullsized":"2024-04-14T09:58:28.718109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718409+0000","last_change":"2024-04-14T09:58:27.667944+0000","last_active":"2024-04-14T09:58:28.718409+0000","last_peered":"2024-04-14T09:58:28.718409+0000","last_clean":"2024-04-14T09:58:28.718409+0000","last_became_active":"2024-04-14T09:58:27.667524+0000","last_became_peered":"2024-04-14T09:58:27.667524+0000","last_unstale":"2024-04-14T09:58:28.718409+0000","last_undegraded":"2024-04-14T09:58:28.718409+0000","last_fullsized":"2024-04-14T09:58:28.718409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412175+0000","last_change":"2024-04-14T09:58:23.396159+0000","last_active":"2024-04-14T09:58:28.412175+0000","last_peered":"2024-04-14T09:58:28.412175+0000","last_clean":"2024-04-14T09:58:28.412175+0000","last_became_active":"2024-04-14T09:58:23.395832+0000","last_became_peered":"2024-04-14T09:58:23.395832+0000","last_unstale":"2024-04-14T09:58:28.412175+0000","last_undegraded":"2024-04-14T09:58:28.412175+0000","last_fullsized":"2024-04-14T09:58:28.412175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:07.911238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718345+0000","last_change":"2024-04-14T09:58:22.398706+0000","last_active":"2024-04-14T09:58:28.718345+0000","last_peered":"2024-04-14T09:58:28.718345+0000","last_clean":"2024-04-14T09:58:28.718345+0000","last_became_active":"2024-04-14T09:58:22.398161+0000","last_became_peered":"2024-04-14T09:58:22.398161+0000","last_unstale":"2024-04-14T09:58:28.718345+0000","last_undegraded":"2024-04-14T09:58:28.718345+0000","last_fullsized":"2024-04-14T09:58:28.718345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411920+0000","last_change":"2024-04-14T09:58:27.427979+0000","last_active":"2024-04-14T09:58:28.411920+0000","last_peered":"2024-04-14T09:58:28.411920+0000","last_clean":"2024-04-14T09:58:28.411920+0000","last_became_active":"2024-04-14T09:58:27.427612+0000","last_became_peered":"2024-04-14T09:58:27.427612+0000","last_unstale":"2024-04-14T09:58:28.411920+0000","last_undegraded":"2024-04-14T09:58:28.411920+0000","last_fullsized":"2024-04-14T09:58:28.411920+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:10.049805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719106+0000","last_change":"2024-04-14T09:58:23.403433+0000","last_active":"2024-04-14T09:58:28.719106+0000","last_peered":"2024-04-14T09:58:28.719106+0000","last_clean":"2024-04-14T09:58:28.719106+0000","last_became_active":"2024-04-14T09:58:23.402914+0000","last_became_peered":"2024-04-14T09:58:23.402914+0000","last_unstale":"2024-04-14T09:58:28.719106+0000","last_undegraded":"2024-04-14T09:58:28.719106+0000","last_fullsized":"2024-04-14T09:58:28.719106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719347+0000","last_change":"2024-04-14T09:58:22.390638+0000","last_active":"2024-04-14T09:58:28.719347+0000","last_peered":"2024-04-14T09:58:28.719347+0000","last_clean":"2024-04-14T09:58:28.719347+0000","last_became_active":"2024-04-14T09:58:22.390011+0000","last_became_peered":"2024-04-14T09:58:22.390011+0000","last_unstale":"2024-04-14T09:58:28.719347+0000","last_undegraded":"2024-04-14T09:58:28.719347+0000","last_fullsized":"2024-04-14T09:58:28.719347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411864+0000","last_change":"2024-04-14T09:58:27.669279+0000","last_active":"2024-04-14T09:58:28.411864+0000","last_peered":"2024-04-14T09:58:28.411864+0000","last_clean":"2024-04-14T09:58:28.411864+0000","last_became_active":"2024-04-14T09:58:27.668902+0000","last_became_peered":"2024-04-14T09:58:27.668902+0000","last_unstale":"2024-04-14T09:58:28.411864+0000","last_undegraded":"2024-04-14T09:58:28.411864+0000","last_fullsized":"2024-04-14T09:58:28.411864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:35.570573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412231+0000","last_change":"2024-04-14T09:58:23.406160+0000","last_active":"2024-04-14T09:58:28.412231+0000","last_peered":"2024-04-14T09:58:28.412231+0000","last_clean":"2024-04-14T09:58:28.412231+0000","last_became_active":"2024-04-14T09:58:23.405890+0000","last_became_peered":"2024-04-14T09:58:23.405890+0000","last_unstale":"2024-04-14T09:58:28.412231+0000","last_undegraded":"2024-04-14T09:58:28.412231+0000","last_fullsized":"2024-04-14T09:58:28.412231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719543+0000","last_change":"2024-04-14T09:58:22.395184+0000","last_active":"2024-04-14T09:58:28.719543+0000","last_peered":"2024-04-14T09:58:28.719543+0000","last_clean":"2024-04-14T09:58:28.719543+0000","last_became_active":"2024-04-14T09:58:22.394873+0000","last_became_peered":"2024-04-14T09:58:22.394873+0000","last_unstale":"2024-04-14T09:58:28.719543+0000","last_undegraded":"2024-04-14T09:58:28.719543+0000","last_fullsized":"2024-04-14T09:58:28.719543+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411231+0000","last_change":"2024-04-14T09:58:27.669744+0000","last_active":"2024-04-14T09:58:28.411231+0000","last_peered":"2024-04-14T09:58:28.411231+0000","last_clean":"2024-04-14T09:58:28.411231+0000","last_became_active":"2024-04-14T09:58:27.668513+0000","last_became_peered":"2024-04-14T09:58:27.668513+0000","last_unstale":"2024-04-14T09:58:28.411231+0000","last_undegraded":"2024-04-14T09:58:28.411231+0000","last_fullsized":"2024-04-14T09:58:28.411231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:15.700051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719218+0000","last_change":"2024-04-14T09:58:23.394968+0000","last_active":"2024-04-14T09:58:28.719218+0000","last_peered":"2024-04-14T09:58:28.719218+0000","last_clean":"2024-04-14T09:58:28.719218+0000","last_became_active":"2024-04-14T09:58:23.394596+0000","last_became_peered":"2024-04-14T09:58:23.394596+0000","last_unstale":"2024-04-14T09:58:28.719218+0000","last_undegraded":"2024-04-14T09:58:28.719218+0000","last_fullsized":"2024-04-14T09:58:28.719218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719510+0000","last_change":"2024-04-14T09:58:22.398406+0000","last_active":"2024-04-14T09:58:28.719510+0000","last_peered":"2024-04-14T09:58:28.719510+0000","last_clean":"2024-04-14T09:58:28.719510+0000","last_became_active":"2024-04-14T09:58:22.398116+0000","last_became_peered":"2024-04-14T09:58:22.398116+0000","last_unstale":"2024-04-14T09:58:28.719510+0000","last_undegraded":"2024-04-14T09:58:28.719510+0000","last_fullsized":"2024-04-14T09:58:28.719510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:16.848303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718418+0000","last_change":"2024-04-14T09:58:27.668504+0000","last_active":"2024-04-14T09:58:28.718418+0000","last_peered":"2024-04-14T09:58:28.718418+0000","last_clean":"2024-04-14T09:58:28.718418+0000","last_became_active":"2024-04-14T09:58:27.667630+0000","last_became_peered":"2024-04-14T09:58:27.667630+0000","last_unstale":"2024-04-14T09:58:28.718418+0000","last_undegraded":"2024-04-14T09:58:28.718418+0000","last_fullsized":"2024-04-14T09:58:28.718418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718268+0000","last_change":"2024-04-14T09:58:23.404467+0000","last_active":"2024-04-14T09:58:28.718268+0000","last_peered":"2024-04-14T09:58:28.718268+0000","last_clean":"2024-04-14T09:58:28.718268+0000","last_became_active":"2024-04-14T09:58:23.403864+0000","last_became_peered":"2024-04-14T09:58:23.403864+0000","last_unstale":"2024-04-14T09:58:28.718268+0000","last_undegraded":"2024-04-14T09:58:28.718268+0000","last_fullsized":"2024-04-14T09:58:28.718268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719289+0000","last_change":"2024-04-14T09:58:22.398987+0000","last_active":"2024-04-14T09:58:28.719289+0000","last_peered":"2024-04-14T09:58:28.719289+0000","last_clean":"2024-04-14T09:58:28.719289+0000","last_became_active":"2024-04-14T09:58:22.398682+0000","last_became_peered":"2024-04-14T09:58:22.398682+0000","last_unstale":"2024-04-14T09:58:28.719289+0000","last_undegraded":"2024-04-14T09:58:28.719289+0000","last_fullsized":"2024-04-14T09:58:28.719289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718473+0000","last_change":"2024-04-14T09:58:27.431798+0000","last_active":"2024-04-14T09:58:28.718473+0000","last_peered":"2024-04-14T09:58:28.718473+0000","last_clean":"2024-04-14T09:58:28.718473+0000","last_became_active":"2024-04-14T09:58:27.431417+0000","last_became_peered":"2024-04-14T09:58:27.431417+0000","last_unstale":"2024-04-14T09:58:28.718473+0000","last_undegraded":"2024-04-14T09:58:28.718473+0000","last_fullsized":"2024-04-14T09:58:28.718473+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412488+0000","last_change":"2024-04-14T09:58:23.400432+0000","last_active":"2024-04-14T09:58:28.412488+0000","last_peered":"2024-04-14T09:58:28.412488+0000","last_clean":"2024-04-14T09:58:28.412488+0000","last_became_active":"2024-04-14T09:58:23.400175+0000","last_became_peered":"2024-04-14T09:58:23.400175+0000","last_unstale":"2024-04-14T09:58:28.412488+0000","last_undegraded":"2024-04-14T09:58:28.412488+0000","last_fullsized":"2024-04-14T09:58:28.412488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718166+0000","last_change":"2024-04-14T09:58:22.385714+0000","last_active":"2024-04-14T09:58:28.718166+0000","last_peered":"2024-04-14T09:58:28.718166+0000","last_clean":"2024-04-14T09:58:28.718166+0000","last_became_active":"2024-04-14T09:58:22.385337+0000","last_became_peered":"2024-04-14T09:58:22.385337+0000","last_unstale":"2024-04-14T09:58:28.718166+0000","last_undegraded":"2024-04-14T09:58:28.718166+0000","last_fullsized":"2024-04-14T09:58:28.718166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719243+0000","last_change":"2024-04-14T09:58:27.436131+0000","last_active":"2024-04-14T09:58:28.719243+0000","last_peered":"2024-04-14T09:58:28.719243+0000","last_clean":"2024-04-14T09:58:28.719243+0000","last_became_active":"2024-04-14T09:58:27.435730+0000","last_became_peered":"2024-04-14T09:58:27.435730+0000","last_unstale":"2024-04-14T09:58:28.719243+0000","last_undegraded":"2024-04-14T09:58:28.719243+0000","last_fullsized":"2024-04-14T09:58:28.719243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717989+0000","last_change":"2024-04-14T09:58:23.395456+0000","last_active":"2024-04-14T09:58:28.717989+0000","last_peered":"2024-04-14T09:58:28.717989+0000","last_clean":"2024-04-14T09:58:28.717989+0000","last_became_active":"2024-04-14T09:58:23.394235+0000","last_became_peered":"2024-04-14T09:58:23.394235+0000","last_unstale":"2024-04-14T09:58:28.717989+0000","last_undegraded":"2024-04-14T09:58:28.717989+0000","last_fullsized":"2024-04-14T09:58:28.717989+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718058+0000","last_change":"2024-04-14T09:58:22.394128+0000","last_active":"2024-04-14T09:58:28.718058+0000","last_peered":"2024-04-14T09:58:28.718058+0000","last_clean":"2024-04-14T09:58:28.718058+0000","last_became_active":"2024-04-14T09:58:22.393765+0000","last_became_peered":"2024-04-14T09:58:22.393765+0000","last_unstale":"2024-04-14T09:58:28.718058+0000","last_undegraded":"2024-04-14T09:58:28.718058+0000","last_fullsized":"2024-04-14T09:58:28.718058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718551+0000","last_change":"2024-04-14T09:58:27.435923+0000","last_active":"2024-04-14T09:58:28.718551+0000","last_peered":"2024-04-14T09:58:28.718551+0000","last_clean":"2024-04-14T09:58:28.718551+0000","last_became_active":"2024-04-14T09:58:27.435542+0000","last_became_peered":"2024-04-14T09:58:27.435542+0000","last_unstale":"2024-04-14T09:58:28.718551+0000","last_undegraded":"2024-04-14T09:58:28.718551+0000","last_fullsized":"2024-04-14T09:58:28.718551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718022+0000","last_change":"2024-04-14T09:58:23.397634+0000","last_active":"2024-04-14T09:58:28.718022+0000","last_peered":"2024-04-14T09:58:28.718022+0000","last_clean":"2024-04-14T09:58:28.718022+0000","last_became_active":"2024-04-14T09:58:23.397351+0000","last_became_peered":"2024-04-14T09:58:23.397351+0000","last_unstale":"2024-04-14T09:58:28.718022+0000","last_undegraded":"2024-04-14T09:58:28.718022+0000","last_fullsized":"2024-04-14T09:58:28.718022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:58:17.852536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718440+0000","last_change":"2024-04-14T09:58:22.391011+0000","last_active":"2024-04-14T09:58:28.718440+0000","last_peered":"2024-04-14T09:58:28.718440+0000","last_clean":"2024-04-14T09:58:28.718440+0000","last_became_active":"2024-04-14T09:58:22.389916+0000","last_became_peered":"2024-04-14T09:58:22.389916+0000","last_unstale":"2024-04-14T09:58:28.718440+0000","last_undegraded":"2024-04-14T09:58:28.718440+0000","last_fullsized":"2024-04-14T09:58:28.718440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719004+0000","last_change":"2024-04-14T09:58:27.668355+0000","last_active":"2024-04-14T09:58:28.719004+0000","last_peered":"2024-04-14T09:58:28.719004+0000","last_clean":"2024-04-14T09:58:28.719004+0000","last_became_active":"2024-04-14T09:58:27.667937+0000","last_became_peered":"2024-04-14T09:58:27.667937+0000","last_unstale":"2024-04-14T09:58:28.719004+0000","last_undegraded":"2024-04-14T09:58:28.719004+0000","last_fullsized":"2024-04-14T09:58:28.719004+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:29.400694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411503+0000","last_change":"2024-04-14T09:58:23.402580+0000","last_active":"2024-04-14T09:58:28.411503+0000","last_peered":"2024-04-14T09:58:28.411503+0000","last_clean":"2024-04-14T09:58:28.411503+0000","last_became_active":"2024-04-14T09:58:23.401893+0000","last_became_peered":"2024-04-14T09:58:23.401893+0000","last_unstale":"2024-04-14T09:58:28.411503+0000","last_undegraded":"2024-04-14T09:58:28.411503+0000","last_fullsized":"2024-04-14T09:58:28.411503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717978+0000","last_change":"2024-04-14T09:58:22.384644+0000","last_active":"2024-04-14T09:58:28.717978+0000","last_peered":"2024-04-14T09:58:28.717978+0000","last_clean":"2024-04-14T09:58:28.717978+0000","last_became_active":"2024-04-14T09:58:22.384367+0000","last_became_peered":"2024-04-14T09:58:22.384367+0000","last_unstale":"2024-04-14T09:58:28.717978+0000","last_undegraded":"2024-04-14T09:58:28.717978+0000","last_fullsized":"2024-04-14T09:58:28.717978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718493+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:58:28.718493+0000","last_peered":"2024-04-14T09:58:28.718493+0000","last_clean":"2024-04-14T09:58:28.718493+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:58:28.718493+0000","last_undegraded":"2024-04-14T09:58:28.718493+0000","last_fullsized":"2024-04-14T09:58:28.718493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717982+0000","last_change":"2024-04-14T09:58:27.668840+0000","last_active":"2024-04-14T09:58:28.717982+0000","last_peered":"2024-04-14T09:58:28.717982+0000","last_clean":"2024-04-14T09:58:28.717982+0000","last_became_active":"2024-04-14T09:58:27.668471+0000","last_became_peered":"2024-04-14T09:58:27.668471+0000","last_unstale":"2024-04-14T09:58:28.717982+0000","last_undegraded":"2024-04-14T09:58:28.717982+0000","last_fullsized":"2024-04-14T09:58:28.717982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:24.779710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719240+0000","last_change":"2024-04-14T09:58:23.409162+0000","last_active":"2024-04-14T09:58:28.719240+0000","last_peered":"2024-04-14T09:58:28.719240+0000","last_clean":"2024-04-14T09:58:28.719240+0000","last_became_active":"2024-04-14T09:58:23.408850+0000","last_became_peered":"2024-04-14T09:58:23.408850+0000","last_unstale":"2024-04-14T09:58:28.719240+0000","last_undegraded":"2024-04-14T09:58:28.719240+0000","last_fullsized":"2024-04-14T09:58:28.719240+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:31.024493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:22.384829+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:22.383935+0000","last_became_peered":"2024-04-14T09:58:22.383935+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717969+0000","last_change":"2024-04-14T09:58:27.667909+0000","last_active":"2024-04-14T09:58:28.717969+0000","last_peered":"2024-04-14T09:58:28.717969+0000","last_clean":"2024-04-14T09:58:28.717969+0000","last_became_active":"2024-04-14T09:58:27.667550+0000","last_became_peered":"2024-04-14T09:58:27.667550+0000","last_unstale":"2024-04-14T09:58:28.717969+0000","last_undegraded":"2024-04-14T09:58:28.717969+0000","last_fullsized":"2024-04-14T09:58:28.717969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:51.244440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717961+0000","last_change":"2024-04-14T09:58:23.408028+0000","last_active":"2024-04-14T09:58:28.717961+0000","last_peered":"2024-04-14T09:58:28.717961+0000","last_clean":"2024-04-14T09:58:28.717961+0000","last_became_active":"2024-04-14T09:58:23.407386+0000","last_became_peered":"2024-04-14T09:58:23.407386+0000","last_unstale":"2024-04-14T09:58:28.717961+0000","last_undegraded":"2024-04-14T09:58:28.717961+0000","last_fullsized":"2024-04-14T09:58:28.717961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719337+0000","last_change":"2024-04-14T09:58:22.390083+0000","last_active":"2024-04-14T09:58:28.719337+0000","last_peered":"2024-04-14T09:58:28.719337+0000","last_clean":"2024-04-14T09:58:28.719337+0000","last_became_active":"2024-04-14T09:58:22.389814+0000","last_became_peered":"2024-04-14T09:58:22.389814+0000","last_unstale":"2024-04-14T09:58:28.719337+0000","last_undegraded":"2024-04-14T09:58:28.719337+0000","last_fullsized":"2024-04-14T09:58:28.719337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:05.516120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718671+0000","last_change":"2024-04-14T09:58:27.428137+0000","last_active":"2024-04-14T09:58:28.718671+0000","last_peered":"2024-04-14T09:58:28.718671+0000","last_clean":"2024-04-14T09:58:28.718671+0000","last_became_active":"2024-04-14T09:58:27.427703+0000","last_became_peered":"2024-04-14T09:58:27.427703+0000","last_unstale":"2024-04-14T09:58:28.718671+0000","last_undegraded":"2024-04-14T09:58:28.718671+0000","last_fullsized":"2024-04-14T09:58:28.718671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719613+0000","last_change":"2024-04-14T09:58:23.404910+0000","last_active":"2024-04-14T09:58:28.719613+0000","last_peered":"2024-04-14T09:58:28.719613+0000","last_clean":"2024-04-14T09:58:28.719613+0000","last_became_active":"2024-04-14T09:58:23.404674+0000","last_became_peered":"2024-04-14T09:58:23.404674+0000","last_unstale":"2024-04-14T09:58:28.719613+0000","last_undegraded":"2024-04-14T09:58:28.719613+0000","last_fullsized":"2024-04-14T09:58:28.719613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:55.269064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718569+0000","last_change":"2024-04-14T09:58:22.394100+0000","last_active":"2024-04-14T09:58:28.718569+0000","last_peered":"2024-04-14T09:58:28.718569+0000","last_clean":"2024-04-14T09:58:28.718569+0000","last_became_active":"2024-04-14T09:58:22.393802+0000","last_became_peered":"2024-04-14T09:58:22.393802+0000","last_unstale":"2024-04-14T09:58:28.718569+0000","last_undegraded":"2024-04-14T09:58:28.718569+0000","last_fullsized":"2024-04-14T09:58:28.718569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717532+0000","last_change":"2024-04-14T09:58:27.667932+0000","last_active":"2024-04-14T09:58:28.717532+0000","last_peered":"2024-04-14T09:58:28.717532+0000","last_clean":"2024-04-14T09:58:28.717532+0000","last_became_active":"2024-04-14T09:58:27.667573+0000","last_became_peered":"2024-04-14T09:58:27.667573+0000","last_unstale":"2024-04-14T09:58:28.717532+0000","last_undegraded":"2024-04-14T09:58:28.717532+0000","last_fullsized":"2024-04-14T09:58:28.717532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719102+0000","last_change":"2024-04-14T09:58:23.404327+0000","last_active":"2024-04-14T09:58:28.719102+0000","last_peered":"2024-04-14T09:58:28.719102+0000","last_clean":"2024-04-14T09:58:28.719102+0000","last_became_active":"2024-04-14T09:58:23.403839+0000","last_became_peered":"2024-04-14T09:58:23.403839+0000","last_unstale":"2024-04-14T09:58:28.719102+0000","last_undegraded":"2024-04-14T09:58:28.719102+0000","last_fullsized":"2024-04-14T09:58:28.719102+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:59:25.368221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412068+0000","last_change":"2024-04-14T09:58:22.399651+0000","last_active":"2024-04-14T09:58:28.412068+0000","last_peered":"2024-04-14T09:58:28.412068+0000","last_clean":"2024-04-14T09:58:28.412068+0000","last_became_active":"2024-04-14T09:58:22.399360+0000","last_became_peered":"2024-04-14T09:58:22.399360+0000","last_unstale":"2024-04-14T09:58:28.412068+0000","last_undegraded":"2024-04-14T09:58:28.412068+0000","last_fullsized":"2024-04-14T09:58:28.412068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:01.625429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411723+0000","last_change":"2024-04-14T09:58:27.428173+0000","last_active":"2024-04-14T09:58:28.411723+0000","last_peered":"2024-04-14T09:58:28.411723+0000","last_clean":"2024-04-14T09:58:28.411723+0000","last_became_active":"2024-04-14T09:58:27.427578+0000","last_became_peered":"2024-04-14T09:58:27.427578+0000","last_unstale":"2024-04-14T09:58:28.411723+0000","last_undegraded":"2024-04-14T09:58:28.411723+0000","last_fullsized":"2024-04-14T09:58:28.411723+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:22.952495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718706+0000","last_change":"2024-04-14T09:58:23.401131+0000","last_active":"2024-04-14T09:58:28.718706+0000","last_peered":"2024-04-14T09:58:28.718706+0000","last_clean":"2024-04-14T09:58:28.718706+0000","last_became_active":"2024-04-14T09:58:23.400782+0000","last_became_peered":"2024-04-14T09:58:23.400782+0000","last_unstale":"2024-04-14T09:58:28.718706+0000","last_undegraded":"2024-04-14T09:58:28.718706+0000","last_fullsized":"2024-04-14T09:58:28.718706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718236+0000","last_change":"2024-04-14T09:58:22.384480+0000","last_active":"2024-04-14T09:58:28.718236+0000","last_peered":"2024-04-14T09:58:28.718236+0000","last_clean":"2024-04-14T09:58:28.718236+0000","last_became_active":"2024-04-14T09:58:22.384218+0000","last_became_peered":"2024-04-14T09:58:22.384218+0000","last_unstale":"2024-04-14T09:58:28.718236+0000","last_undegraded":"2024-04-14T09:58:28.718236+0000","last_fullsized":"2024-04-14T09:58:28.718236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:27.426500+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:27.426031+0000","last_became_peered":"2024-04-14T09:58:27.426031+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718325+0000","last_change":"2024-04-14T09:58:23.405791+0000","last_active":"2024-04-14T09:58:28.718325+0000","last_peered":"2024-04-14T09:58:28.718325+0000","last_clean":"2024-04-14T09:58:28.718325+0000","last_became_active":"2024-04-14T09:58:23.405500+0000","last_became_peered":"2024-04-14T09:58:23.405500+0000","last_unstale":"2024-04-14T09:58:28.718325+0000","last_undegraded":"2024-04-14T09:58:28.718325+0000","last_fullsized":"2024-04-14T09:58:28.718325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718933+0000","last_change":"2024-04-14T09:58:22.390322+0000","last_active":"2024-04-14T09:58:28.718933+0000","last_peered":"2024-04-14T09:58:28.718933+0000","last_clean":"2024-04-14T09:58:28.718933+0000","last_became_active":"2024-04-14T09:58:22.390024+0000","last_became_peered":"2024-04-14T09:58:22.390024+0000","last_unstale":"2024-04-14T09:58:28.718933+0000","last_undegraded":"2024-04-14T09:58:28.718933+0000","last_fullsized":"2024-04-14T09:58:28.718933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:00:51.262959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412180+0000","last_change":"2024-04-14T09:58:27.670485+0000","last_active":"2024-04-14T09:58:28.412180+0000","last_peered":"2024-04-14T09:58:28.412180+0000","last_clean":"2024-04-14T09:58:28.412180+0000","last_became_active":"2024-04-14T09:58:27.670080+0000","last_became_peered":"2024-04-14T09:58:27.670080+0000","last_unstale":"2024-04-14T09:58:28.412180+0000","last_undegraded":"2024-04-14T09:58:28.412180+0000","last_fullsized":"2024-04-14T09:58:28.412180+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:48:09.325512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718861+0000","last_change":"2024-04-14T09:58:23.404680+0000","last_active":"2024-04-14T09:58:28.718861+0000","last_peered":"2024-04-14T09:58:28.718861+0000","last_clean":"2024-04-14T09:58:28.718861+0000","last_became_active":"2024-04-14T09:58:23.404418+0000","last_became_peered":"2024-04-14T09:58:23.404418+0000","last_unstale":"2024-04-14T09:58:28.718861+0000","last_undegraded":"2024-04-14T09:58:28.718861+0000","last_fullsized":"2024-04-14T09:58:28.718861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718090+0000","last_change":"2024-04-14T09:58:22.393671+0000","last_active":"2024-04-14T09:58:28.718090+0000","last_peered":"2024-04-14T09:58:28.718090+0000","last_clean":"2024-04-14T09:58:28.718090+0000","last_became_active":"2024-04-14T09:58:22.393431+0000","last_became_peered":"2024-04-14T09:58:22.393431+0000","last_unstale":"2024-04-14T09:58:28.718090+0000","last_undegraded":"2024-04-14T09:58:28.718090+0000","last_fullsized":"2024-04-14T09:58:28.718090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412086+0000","last_change":"2024-04-14T09:58:27.668347+0000","last_active":"2024-04-14T09:58:28.412086+0000","last_peered":"2024-04-14T09:58:28.412086+0000","last_clean":"2024-04-14T09:58:28.412086+0000","last_became_active":"2024-04-14T09:58:27.667469+0000","last_became_peered":"2024-04-14T09:58:27.667469+0000","last_unstale":"2024-04-14T09:58:28.412086+0000","last_undegraded":"2024-04-14T09:58:28.412086+0000","last_fullsized":"2024-04-14T09:58:28.412086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718924+0000","last_change":"2024-04-14T09:58:23.408574+0000","last_active":"2024-04-14T09:58:28.718924+0000","last_peered":"2024-04-14T09:58:28.718924+0000","last_clean":"2024-04-14T09:58:28.718924+0000","last_became_active":"2024-04-14T09:58:23.408295+0000","last_became_peered":"2024-04-14T09:58:23.408295+0000","last_unstale":"2024-04-14T09:58:28.718924+0000","last_undegraded":"2024-04-14T09:58:28.718924+0000","last_fullsized":"2024-04-14T09:58:28.718924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718923+0000","last_change":"2024-04-14T09:58:22.398210+0000","last_active":"2024-04-14T09:58:28.718923+0000","last_peered":"2024-04-14T09:58:28.718923+0000","last_clean":"2024-04-14T09:58:28.718923+0000","last_became_active":"2024-04-14T09:58:22.397939+0000","last_became_peered":"2024-04-14T09:58:22.397939+0000","last_unstale":"2024-04-14T09:58:28.718923+0000","last_undegraded":"2024-04-14T09:58:28.718923+0000","last_fullsized":"2024-04-14T09:58:28.718923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:32:05.174642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718300+0000","last_change":"2024-04-14T09:58:27.668858+0000","last_active":"2024-04-14T09:58:28.718300+0000","last_peered":"2024-04-14T09:58:28.718300+0000","last_clean":"2024-04-14T09:58:28.718300+0000","last_became_active":"2024-04-14T09:58:27.668509+0000","last_became_peered":"2024-04-14T09:58:27.668509+0000","last_unstale":"2024-04-14T09:58:28.718300+0000","last_undegraded":"2024-04-14T09:58:28.718300+0000","last_fullsized":"2024-04-14T09:58:28.718300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:09:44.846448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719155+0000","last_change":"2024-04-14T09:58:23.403359+0000","last_active":"2024-04-14T09:58:28.719155+0000","last_peered":"2024-04-14T09:58:28.719155+0000","last_clean":"2024-04-14T09:58:28.719155+0000","last_became_active":"2024-04-14T09:58:23.403105+0000","last_became_peered":"2024-04-14T09:58:23.403105+0000","last_unstale":"2024-04-14T09:58:28.719155+0000","last_undegraded":"2024-04-14T09:58:28.719155+0000","last_fullsized":"2024-04-14T09:58:28.719155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:00.779338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:32.895716+0000","last_change":"2024-04-14T09:58:22.393783+0000","last_active":"2024-04-14T09:58:32.895716+0000","last_peered":"2024-04-14T09:58:32.895716+0000","last_clean":"2024-04-14T09:58:32.895716+0000","last_became_active":"2024-04-14T09:58:22.393497+0000","last_became_peered":"2024-04-14T09:58:22.393497+0000","last_unstale":"2024-04-14T09:58:32.895716+0000","last_undegraded":"2024-04-14T09:58:32.895716+0000","last_fullsized":"2024-04-14T09:58:32.895716+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:06:06.907005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718743+0000","last_change":"2024-04-14T09:58:27.435279+0000","last_active":"2024-04-14T09:58:28.718743+0000","last_peered":"2024-04-14T09:58:28.718743+0000","last_clean":"2024-04-14T09:58:28.718743+0000","last_became_active":"2024-04-14T09:58:27.434860+0000","last_became_peered":"2024-04-14T09:58:27.434860+0000","last_unstale":"2024-04-14T09:58:28.718743+0000","last_undegraded":"2024-04-14T09:58:28.718743+0000","last_fullsized":"2024-04-14T09:58:28.718743+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:05.043045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412292+0000","last_change":"2024-04-14T09:58:23.406709+0000","last_active":"2024-04-14T09:58:28.412292+0000","last_peered":"2024-04-14T09:58:28.412292+0000","last_clean":"2024-04-14T09:58:28.412292+0000","last_became_active":"2024-04-14T09:58:23.406119+0000","last_became_peered":"2024-04-14T09:58:23.406119+0000","last_unstale":"2024-04-14T09:58:28.412292+0000","last_undegraded":"2024-04-14T09:58:28.412292+0000","last_fullsized":"2024-04-14T09:58:28.412292+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:04:34.672736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719263+0000","last_change":"2024-04-14T09:58:22.383968+0000","last_active":"2024-04-14T09:58:28.719263+0000","last_peered":"2024-04-14T09:58:28.719263+0000","last_clean":"2024-04-14T09:58:28.719263+0000","last_became_active":"2024-04-14T09:58:22.383573+0000","last_became_peered":"2024-04-14T09:58:22.383573+0000","last_unstale":"2024-04-14T09:58:28.719263+0000","last_undegraded":"2024-04-14T09:58:28.719263+0000","last_fullsized":"2024-04-14T09:58:28.719263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412330+0000","last_change":"2024-04-14T09:58:27.428066+0000","last_active":"2024-04-14T09:58:28.412330+0000","last_peered":"2024-04-14T09:58:28.412330+0000","last_clean":"2024-04-14T09:58:28.412330+0000","last_became_active":"2024-04-14T09:58:27.427579+0000","last_became_peered":"2024-04-14T09:58:27.427579+0000","last_unstale":"2024-04-14T09:58:28.412330+0000","last_undegraded":"2024-04-14T09:58:28.412330+0000","last_fullsized":"2024-04-14T09:58:28.412330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718449+0000","last_change":"2024-04-14T09:58:23.404342+0000","last_active":"2024-04-14T09:58:28.718449+0000","last_peered":"2024-04-14T09:58:28.718449+0000","last_clean":"2024-04-14T09:58:28.718449+0000","last_became_active":"2024-04-14T09:58:23.403726+0000","last_became_peered":"2024-04-14T09:58:23.403726+0000","last_unstale":"2024-04-14T09:58:28.718449+0000","last_undegraded":"2024-04-14T09:58:28.718449+0000","last_fullsized":"2024-04-14T09:58:28.718449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718147+0000","last_change":"2024-04-14T09:58:22.392609+0000","last_active":"2024-04-14T09:58:28.718147+0000","last_peered":"2024-04-14T09:58:28.718147+0000","last_clean":"2024-04-14T09:58:28.718147+0000","last_became_active":"2024-04-14T09:58:22.392332+0000","last_became_peered":"2024-04-14T09:58:22.392332+0000","last_unstale":"2024-04-14T09:58:28.718147+0000","last_undegraded":"2024-04-14T09:58:28.718147+0000","last_fullsized":"2024-04-14T09:58:28.718147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411427+0000","last_change":"2024-04-14T09:58:27.434042+0000","last_active":"2024-04-14T09:58:28.411427+0000","last_peered":"2024-04-14T09:58:28.411427+0000","last_clean":"2024-04-14T09:58:28.411427+0000","last_became_active":"2024-04-14T09:58:27.433635+0000","last_became_peered":"2024-04-14T09:58:27.433635+0000","last_unstale":"2024-04-14T09:58:28.411427+0000","last_undegraded":"2024-04-14T09:58:28.411427+0000","last_fullsized":"2024-04-14T09:58:28.411427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:25.171487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717663+0000","last_change":"2024-04-14T09:58:23.410881+0000","last_active":"2024-04-14T09:58:28.717663+0000","last_peered":"2024-04-14T09:58:28.717663+0000","last_clean":"2024-04-14T09:58:28.717663+0000","last_became_active":"2024-04-14T09:58:23.410383+0000","last_became_peered":"2024-04-14T09:58:23.410383+0000","last_unstale":"2024-04-14T09:58:28.717663+0000","last_undegraded":"2024-04-14T09:58:28.717663+0000","last_fullsized":"2024-04-14T09:58:28.717663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719207+0000","last_change":"2024-04-14T09:58:22.392621+0000","last_active":"2024-04-14T09:58:28.719207+0000","last_peered":"2024-04-14T09:58:28.719207+0000","last_clean":"2024-04-14T09:58:28.719207+0000","last_became_active":"2024-04-14T09:58:22.390883+0000","last_became_peered":"2024-04-14T09:58:22.390883+0000","last_unstale":"2024-04-14T09:58:28.719207+0000","last_undegraded":"2024-04-14T09:58:28.719207+0000","last_fullsized":"2024-04-14T09:58:28.719207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:06:45.200136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411485+0000","last_change":"2024-04-14T09:58:27.668298+0000","last_active":"2024-04-14T09:58:28.411485+0000","last_peered":"2024-04-14T09:58:28.411485+0000","last_clean":"2024-04-14T09:58:28.411485+0000","last_became_active":"2024-04-14T09:58:27.667944+0000","last_became_peered":"2024-04-14T09:58:27.667944+0000","last_unstale":"2024-04-14T09:58:28.411485+0000","last_undegraded":"2024-04-14T09:58:28.411485+0000","last_fullsized":"2024-04-14T09:58:28.411485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:44:39.538111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718701+0000","last_change":"2024-04-14T09:58:27.669462+0000","last_active":"2024-04-14T09:58:28.718701+0000","last_peered":"2024-04-14T09:58:28.718701+0000","last_clean":"2024-04-14T09:58:28.718701+0000","last_became_active":"2024-04-14T09:58:27.669027+0000","last_became_peered":"2024-04-14T09:58:27.669027+0000","last_unstale":"2024-04-14T09:58:28.718701+0000","last_undegraded":"2024-04-14T09:58:28.718701+0000","last_fullsized":"2024-04-14T09:58:28.718701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:01:35.056967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717917+0000","last_change":"2024-04-14T09:58:23.398529+0000","last_active":"2024-04-14T09:58:28.717917+0000","last_peered":"2024-04-14T09:58:28.717917+0000","last_clean":"2024-04-14T09:58:28.717917+0000","last_became_active":"2024-04-14T09:58:23.397726+0000","last_became_peered":"2024-04-14T09:58:23.397726+0000","last_unstale":"2024-04-14T09:58:28.717917+0000","last_undegraded":"2024-04-14T09:58:28.717917+0000","last_fullsized":"2024-04-14T09:58:28.717917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717881+0000","last_change":"2024-04-14T09:58:22.384888+0000","last_active":"2024-04-14T09:58:28.717881+0000","last_peered":"2024-04-14T09:58:28.717881+0000","last_clean":"2024-04-14T09:58:28.717881+0000","last_became_active":"2024-04-14T09:58:22.383944+0000","last_became_peered":"2024-04-14T09:58:22.383944+0000","last_unstale":"2024-04-14T09:58:28.717881+0000","last_undegraded":"2024-04-14T09:58:28.717881+0000","last_fullsized":"2024-04-14T09:58:28.717881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:47.619120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719260+0000","last_change":"2024-04-14T09:58:27.429696+0000","last_active":"2024-04-14T09:58:28.719260+0000","last_peered":"2024-04-14T09:58:28.719260+0000","last_clean":"2024-04-14T09:58:28.719260+0000","last_became_active":"2024-04-14T09:58:27.429288+0000","last_became_peered":"2024-04-14T09:58:27.429288+0000","last_unstale":"2024-04-14T09:58:28.719260+0000","last_undegraded":"2024-04-14T09:58:28.719260+0000","last_fullsized":"2024-04-14T09:58:28.719260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:01:04.811811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411313+0000","last_change":"2024-04-14T09:58:23.400094+0000","last_active":"2024-04-14T09:58:28.411313+0000","last_peered":"2024-04-14T09:58:28.411313+0000","last_clean":"2024-04-14T09:58:28.411313+0000","last_became_active":"2024-04-14T09:58:23.399785+0000","last_became_peered":"2024-04-14T09:58:23.399785+0000","last_unstale":"2024-04-14T09:58:28.411313+0000","last_undegraded":"2024-04-14T09:58:28.411313+0000","last_fullsized":"2024-04-14T09:58:28.411313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411504+0000","last_change":"2024-04-14T09:58:22.397732+0000","last_active":"2024-04-14T09:58:28.411504+0000","last_peered":"2024-04-14T09:58:28.411504+0000","last_clean":"2024-04-14T09:58:28.411504+0000","last_became_active":"2024-04-14T09:58:22.397449+0000","last_became_peered":"2024-04-14T09:58:22.397449+0000","last_unstale":"2024-04-14T09:58:28.411504+0000","last_undegraded":"2024-04-14T09:58:28.411504+0000","last_fullsized":"2024-04-14T09:58:28.411504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:26:32.019121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718183+0000","last_change":"2024-04-14T09:58:22.393706+0000","last_active":"2024-04-14T09:58:28.718183+0000","last_peered":"2024-04-14T09:58:28.718183+0000","last_clean":"2024-04-14T09:58:28.718183+0000","last_became_active":"2024-04-14T09:58:22.393405+0000","last_became_peered":"2024-04-14T09:58:22.393405+0000","last_unstale":"2024-04-14T09:58:28.718183+0000","last_undegraded":"2024-04-14T09:58:28.718183+0000","last_fullsized":"2024-04-14T09:58:28.718183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:10:42.836041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718830+0000","last_change":"2024-04-14T09:58:23.402551+0000","last_active":"2024-04-14T09:58:28.718830+0000","last_peered":"2024-04-14T09:58:28.718830+0000","last_clean":"2024-04-14T09:58:28.718830+0000","last_became_active":"2024-04-14T09:58:23.402184+0000","last_became_peered":"2024-04-14T09:58:23.402184+0000","last_unstale":"2024-04-14T09:58:28.718830+0000","last_undegraded":"2024-04-14T09:58:28.718830+0000","last_fullsized":"2024-04-14T09:58:28.718830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717894+0000","last_change":"2024-04-14T09:58:27.432957+0000","last_active":"2024-04-14T09:58:28.717894+0000","last_peered":"2024-04-14T09:58:28.717894+0000","last_clean":"2024-04-14T09:58:28.717894+0000","last_became_active":"2024-04-14T09:58:27.432530+0000","last_became_peered":"2024-04-14T09:58:27.432530+0000","last_unstale":"2024-04-14T09:58:28.717894+0000","last_undegraded":"2024-04-14T09:58:28.717894+0000","last_fullsized":"2024-04-14T09:58:28.717894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:14:57.757589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411784+0000","last_change":"2024-04-14T09:58:22.391395+0000","last_active":"2024-04-14T09:58:28.411784+0000","last_peered":"2024-04-14T09:58:28.411784+0000","last_clean":"2024-04-14T09:58:28.411784+0000","last_became_active":"2024-04-14T09:58:22.391132+0000","last_became_peered":"2024-04-14T09:58:22.391132+0000","last_unstale":"2024-04-14T09:58:28.411784+0000","last_undegraded":"2024-04-14T09:58:28.411784+0000","last_fullsized":"2024-04-14T09:58:28.411784+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:21.362095+0000","last_clean_scrub_stamp":"2024-04-14T09:58:21.362095+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:56:45.950958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411949+0000","last_change":"2024-04-14T09:58:23.396095+0000","last_active":"2024-04-14T09:58:28.411949+0000","last_peered":"2024-04-14T09:58:28.411949+0000","last_clean":"2024-04-14T09:58:28.411949+0000","last_became_active":"2024-04-14T09:58:23.395823+0000","last_became_peered":"2024-04-14T09:58:23.395823+0000","last_unstale":"2024-04-14T09:58:28.411949+0000","last_undegraded":"2024-04-14T09:58:28.411949+0000","last_fullsized":"2024-04-14T09:58:28.411949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:28:06.520353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412451+0000","last_change":"2024-04-14T09:58:27.432961+0000","last_active":"2024-04-14T09:58:28.412451+0000","last_peered":"2024-04-14T09:58:28.412451+0000","last_clean":"2024-04-14T09:58:28.412451+0000","last_became_active":"2024-04-14T09:58:27.432561+0000","last_became_peered":"2024-04-14T09:58:27.432561+0000","last_unstale":"2024-04-14T09:58:28.412451+0000","last_undegraded":"2024-04-14T09:58:28.412451+0000","last_fullsized":"2024-04-14T09:58:28.412451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:26.398802+0000","last_clean_scrub_stamp":"2024-04-14T09:58:26.398802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:25:05.795116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718199+0000","last_change":"2024-04-14T09:58:23.407620+0000","last_active":"2024-04-14T09:58:28.718199+0000","last_peered":"2024-04-14T09:58:28.718199+0000","last_clean":"2024-04-14T09:58:28.718199+0000","last_became_active":"2024-04-14T09:58:23.407229+0000","last_became_peered":"2024-04-14T09:58:23.407229+0000","last_unstale":"2024-04-14T09:58:28.718199+0000","last_undegraded":"2024-04-14T09:58:28.718199+0000","last_fullsized":"2024-04-14T09:58:28.718199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717968+0000","last_change":"2024-04-14T09:58:23.401653+0000","last_active":"2024-04-14T09:58:28.717968+0000","last_peered":"2024-04-14T09:58:28.717968+0000","last_clean":"2024-04-14T09:58:28.717968+0000","last_became_active":"2024-04-14T09:58:23.401364+0000","last_became_peered":"2024-04-14T09:58:23.401364+0000","last_unstale":"2024-04-14T09:58:28.717968+0000","last_undegraded":"2024-04-14T09:58:28.717968+0000","last_fullsized":"2024-04-14T09:58:28.717968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:38:48.623353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718067+0000","last_change":"2024-04-14T09:58:23.408171+0000","last_active":"2024-04-14T09:58:28.718067+0000","last_peered":"2024-04-14T09:58:28.718067+0000","last_clean":"2024-04-14T09:58:28.718067+0000","last_became_active":"2024-04-14T09:58:23.407239+0000","last_became_peered":"2024-04-14T09:58:23.407239+0000","last_unstale":"2024-04-14T09:58:28.718067+0000","last_undegraded":"2024-04-14T09:58:28.718067+0000","last_fullsized":"2024-04-14T09:58:28.718067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718730+0000","last_change":"2024-04-14T09:58:23.404101+0000","last_active":"2024-04-14T09:58:28.718730+0000","last_peered":"2024-04-14T09:58:28.718730+0000","last_clean":"2024-04-14T09:58:28.718730+0000","last_became_active":"2024-04-14T09:58:23.403370+0000","last_became_peered":"2024-04-14T09:58:23.403370+0000","last_unstale":"2024-04-14T09:58:28.718730+0000","last_undegraded":"2024-04-14T09:58:28.718730+0000","last_fullsized":"2024-04-14T09:58:28.718730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:17:06.376909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412345+0000","last_change":"2024-04-14T09:58:23.404808+0000","last_active":"2024-04-14T09:58:28.412345+0000","last_peered":"2024-04-14T09:58:28.412345+0000","last_clean":"2024-04-14T09:58:28.412345+0000","last_became_active":"2024-04-14T09:58:23.404405+0000","last_became_peered":"2024-04-14T09:58:23.404405+0000","last_unstale":"2024-04-14T09:58:28.412345+0000","last_undegraded":"2024-04-14T09:58:28.412345+0000","last_fullsized":"2024-04-14T09:58:28.412345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719094+0000","last_change":"2024-04-14T09:58:23.404182+0000","last_active":"2024-04-14T09:58:28.719094+0000","last_peered":"2024-04-14T09:58:28.719094+0000","last_clean":"2024-04-14T09:58:28.719094+0000","last_became_active":"2024-04-14T09:58:23.403910+0000","last_became_peered":"2024-04-14T09:58:23.403910+0000","last_unstale":"2024-04-14T09:58:28.719094+0000","last_undegraded":"2024-04-14T09:58:28.719094+0000","last_fullsized":"2024-04-14T09:58:28.719094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719413+0000","last_change":"2024-04-14T09:58:23.408207+0000","last_active":"2024-04-14T09:58:28.719413+0000","last_peered":"2024-04-14T09:58:28.719413+0000","last_clean":"2024-04-14T09:58:28.719413+0000","last_became_active":"2024-04-14T09:58:23.406767+0000","last_became_peered":"2024-04-14T09:58:23.406767+0000","last_unstale":"2024-04-14T09:58:28.719413+0000","last_undegraded":"2024-04-14T09:58:28.719413+0000","last_fullsized":"2024-04-14T09:58:28.719413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412204+0000","last_change":"2024-04-14T09:58:23.406514+0000","last_active":"2024-04-14T09:58:28.412204+0000","last_peered":"2024-04-14T09:58:28.412204+0000","last_clean":"2024-04-14T09:58:28.412204+0000","last_became_active":"2024-04-14T09:58:23.405465+0000","last_became_peered":"2024-04-14T09:58:23.405465+0000","last_unstale":"2024-04-14T09:58:28.412204+0000","last_undegraded":"2024-04-14T09:58:28.412204+0000","last_fullsized":"2024-04-14T09:58:28.412204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717813+0000","last_change":"2024-04-14T09:58:23.406224+0000","last_active":"2024-04-14T09:58:28.717813+0000","last_peered":"2024-04-14T09:58:28.717813+0000","last_clean":"2024-04-14T09:58:28.717813+0000","last_became_active":"2024-04-14T09:58:23.405960+0000","last_became_peered":"2024-04-14T09:58:23.405960+0000","last_unstale":"2024-04-14T09:58:28.717813+0000","last_undegraded":"2024-04-14T09:58:28.717813+0000","last_fullsized":"2024-04-14T09:58:28.717813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411302+0000","last_change":"2024-04-14T09:58:23.397512+0000","last_active":"2024-04-14T09:58:28.411302+0000","last_peered":"2024-04-14T09:58:28.411302+0000","last_clean":"2024-04-14T09:58:28.411302+0000","last_became_active":"2024-04-14T09:58:23.397243+0000","last_became_peered":"2024-04-14T09:58:23.397243+0000","last_unstale":"2024-04-14T09:58:28.411302+0000","last_undegraded":"2024-04-14T09:58:28.411302+0000","last_fullsized":"2024-04-14T09:58:28.411302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718006+0000","last_change":"2024-04-14T09:58:23.397450+0000","last_active":"2024-04-14T09:58:28.718006+0000","last_peered":"2024-04-14T09:58:28.718006+0000","last_clean":"2024-04-14T09:58:28.718006+0000","last_became_active":"2024-04-14T09:58:23.397165+0000","last_became_peered":"2024-04-14T09:58:23.397165+0000","last_unstale":"2024-04-14T09:58:28.718006+0000","last_undegraded":"2024-04-14T09:58:28.718006+0000","last_fullsized":"2024-04-14T09:58:28.718006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:07:06.017332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718469+0000","last_change":"2024-04-14T09:58:23.407381+0000","last_active":"2024-04-14T09:58:28.718469+0000","last_peered":"2024-04-14T09:58:28.718469+0000","last_clean":"2024-04-14T09:58:28.718469+0000","last_became_active":"2024-04-14T09:58:23.407118+0000","last_became_peered":"2024-04-14T09:58:23.407118+0000","last_unstale":"2024-04-14T09:58:28.718469+0000","last_undegraded":"2024-04-14T09:58:28.718469+0000","last_fullsized":"2024-04-14T09:58:28.718469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:03:00.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718613+0000","last_change":"2024-04-14T09:58:23.404570+0000","last_active":"2024-04-14T09:58:28.718613+0000","last_peered":"2024-04-14T09:58:28.718613+0000","last_clean":"2024-04-14T09:58:28.718613+0000","last_became_active":"2024-04-14T09:58:23.404262+0000","last_became_peered":"2024-04-14T09:58:23.404262+0000","last_unstale":"2024-04-14T09:58:28.718613+0000","last_undegraded":"2024-04-14T09:58:28.718613+0000","last_fullsized":"2024-04-14T09:58:28.718613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:31:31.537685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719427+0000","last_change":"2024-04-14T09:58:23.404295+0000","last_active":"2024-04-14T09:58:28.719427+0000","last_peered":"2024-04-14T09:58:28.719427+0000","last_clean":"2024-04-14T09:58:28.719427+0000","last_became_active":"2024-04-14T09:58:23.404005+0000","last_became_peered":"2024-04-14T09:58:23.404005+0000","last_unstale":"2024-04-14T09:58:28.719427+0000","last_undegraded":"2024-04-14T09:58:28.719427+0000","last_fullsized":"2024-04-14T09:58:28.719427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:08:01.010571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718467+0000","last_change":"2024-04-14T09:58:23.407616+0000","last_active":"2024-04-14T09:58:28.718467+0000","last_peered":"2024-04-14T09:58:28.718467+0000","last_clean":"2024-04-14T09:58:28.718467+0000","last_became_active":"2024-04-14T09:58:23.407260+0000","last_became_peered":"2024-04-14T09:58:23.407260+0000","last_unstale":"2024-04-14T09:58:28.718467+0000","last_undegraded":"2024-04-14T09:58:28.718467+0000","last_fullsized":"2024-04-14T09:58:28.718467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718039+0000","last_change":"2024-04-14T09:58:23.410650+0000","last_active":"2024-04-14T09:58:28.718039+0000","last_peered":"2024-04-14T09:58:28.718039+0000","last_clean":"2024-04-14T09:58:28.718039+0000","last_became_active":"2024-04-14T09:58:23.410379+0000","last_became_peered":"2024-04-14T09:58:23.410379+0000","last_unstale":"2024-04-14T09:58:28.718039+0000","last_undegraded":"2024-04-14T09:58:28.718039+0000","last_fullsized":"2024-04-14T09:58:28.718039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717749+0000","last_change":"2024-04-14T09:58:23.398466+0000","last_active":"2024-04-14T09:58:28.717749+0000","last_peered":"2024-04-14T09:58:28.717749+0000","last_clean":"2024-04-14T09:58:28.717749+0000","last_became_active":"2024-04-14T09:58:23.398189+0000","last_became_peered":"2024-04-14T09:58:23.398189+0000","last_unstale":"2024-04-14T09:58:28.717749+0000","last_undegraded":"2024-04-14T09:58:28.717749+0000","last_fullsized":"2024-04-14T09:58:28.717749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:33:18.920021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718017+0000","last_change":"2024-04-14T09:58:23.393259+0000","last_active":"2024-04-14T09:58:28.718017+0000","last_peered":"2024-04-14T09:58:28.718017+0000","last_clean":"2024-04-14T09:58:28.718017+0000","last_became_active":"2024-04-14T09:58:23.392971+0000","last_became_peered":"2024-04-14T09:58:23.392971+0000","last_unstale":"2024-04-14T09:58:28.718017+0000","last_undegraded":"2024-04-14T09:58:28.718017+0000","last_fullsized":"2024-04-14T09:58:28.718017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:28:31.971521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718832+0000","last_change":"2024-04-14T09:58:23.398828+0000","last_active":"2024-04-14T09:58:28.718832+0000","last_peered":"2024-04-14T09:58:28.718832+0000","last_clean":"2024-04-14T09:58:28.718832+0000","last_became_active":"2024-04-14T09:58:23.398386+0000","last_became_peered":"2024-04-14T09:58:23.398386+0000","last_unstale":"2024-04-14T09:58:28.718832+0000","last_undegraded":"2024-04-14T09:58:28.718832+0000","last_fullsized":"2024-04-14T09:58:28.718832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:51:21.841388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411945+0000","last_change":"2024-04-14T09:58:23.407691+0000","last_active":"2024-04-14T09:58:28.411945+0000","last_peered":"2024-04-14T09:58:28.411945+0000","last_clean":"2024-04-14T09:58:28.411945+0000","last_became_active":"2024-04-14T09:58:23.407271+0000","last_became_peered":"2024-04-14T09:58:23.407271+0000","last_unstale":"2024-04-14T09:58:28.411945+0000","last_undegraded":"2024-04-14T09:58:28.411945+0000","last_fullsized":"2024-04-14T09:58:28.411945+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.412261+0000","last_change":"2024-04-14T09:58:23.405452+0000","last_active":"2024-04-14T09:58:28.412261+0000","last_peered":"2024-04-14T09:58:28.412261+0000","last_clean":"2024-04-14T09:58:28.412261+0000","last_became_active":"2024-04-14T09:58:23.404804+0000","last_became_peered":"2024-04-14T09:58:23.404804+0000","last_unstale":"2024-04-14T09:58:28.412261+0000","last_undegraded":"2024-04-14T09:58:28.412261+0000","last_fullsized":"2024-04-14T09:58:28.412261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:43:46.821705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718106+0000","last_change":"2024-04-14T09:58:23.413350+0000","last_active":"2024-04-14T09:58:28.718106+0000","last_peered":"2024-04-14T09:58:28.718106+0000","last_clean":"2024-04-14T09:58:28.718106+0000","last_became_active":"2024-04-14T09:58:23.413030+0000","last_became_peered":"2024-04-14T09:58:23.413030+0000","last_unstale":"2024-04-14T09:58:28.718106+0000","last_undegraded":"2024-04-14T09:58:28.718106+0000","last_fullsized":"2024-04-14T09:58:28.718106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:08:16.980645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719331+0000","last_change":"2024-04-14T09:58:23.411335+0000","last_active":"2024-04-14T09:58:28.719331+0000","last_peered":"2024-04-14T09:58:28.719331+0000","last_clean":"2024-04-14T09:58:28.719331+0000","last_became_active":"2024-04-14T09:58:23.409283+0000","last_became_peered":"2024-04-14T09:58:23.409283+0000","last_unstale":"2024-04-14T09:58:28.719331+0000","last_undegraded":"2024-04-14T09:58:28.719331+0000","last_fullsized":"2024-04-14T09:58:28.719331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719533+0000","last_change":"2024-04-14T09:58:23.408154+0000","last_active":"2024-04-14T09:58:28.719533+0000","last_peered":"2024-04-14T09:58:28.719533+0000","last_clean":"2024-04-14T09:58:28.719533+0000","last_became_active":"2024-04-14T09:58:23.407848+0000","last_became_peered":"2024-04-14T09:58:23.407848+0000","last_unstale":"2024-04-14T09:58:28.719533+0000","last_undegraded":"2024-04-14T09:58:28.719533+0000","last_fullsized":"2024-04-14T09:58:28.719533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:36:11.667577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.411189+0000","last_change":"2024-04-14T09:58:23.399466+0000","last_active":"2024-04-14T09:58:28.411189+0000","last_peered":"2024-04-14T09:58:28.411189+0000","last_clean":"2024-04-14T09:58:28.411189+0000","last_became_active":"2024-04-14T09:58:23.399192+0000","last_became_peered":"2024-04-14T09:58:23.399192+0000","last_unstale":"2024-04-14T09:58:28.411189+0000","last_undegraded":"2024-04-14T09:58:28.411189+0000","last_fullsized":"2024-04-14T09:58:28.411189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:10.136601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718615+0000","last_change":"2024-04-14T09:58:23.402089+0000","last_active":"2024-04-14T09:58:28.718615+0000","last_peered":"2024-04-14T09:58:28.718615+0000","last_clean":"2024-04-14T09:58:28.718615+0000","last_became_active":"2024-04-14T09:58:23.401791+0000","last_became_peered":"2024-04-14T09:58:23.401791+0000","last_unstale":"2024-04-14T09:58:28.718615+0000","last_undegraded":"2024-04-14T09:58:28.718615+0000","last_fullsized":"2024-04-14T09:58:28.718615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:21:44.956580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717901+0000","last_change":"2024-04-14T09:58:23.400405+0000","last_active":"2024-04-14T09:58:28.717901+0000","last_peered":"2024-04-14T09:58:28.717901+0000","last_clean":"2024-04-14T09:58:28.717901+0000","last_became_active":"2024-04-14T09:58:23.400094+0000","last_became_peered":"2024-04-14T09:58:23.400094+0000","last_unstale":"2024-04-14T09:58:28.717901+0000","last_undegraded":"2024-04-14T09:58:28.717901+0000","last_fullsized":"2024-04-14T09:58:28.717901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:59:31.538100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.718700+0000","last_change":"2024-04-14T09:58:23.401268+0000","last_active":"2024-04-14T09:58:28.718700+0000","last_peered":"2024-04-14T09:58:28.718700+0000","last_clean":"2024-04-14T09:58:28.718700+0000","last_became_active":"2024-04-14T09:58:23.400978+0000","last_became_peered":"2024-04-14T09:58:23.400978+0000","last_unstale":"2024-04-14T09:58:28.718700+0000","last_undegraded":"2024-04-14T09:58:28.718700+0000","last_fullsized":"2024-04-14T09:58:28.718700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:27:47.211967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.717724+0000","last_change":"2024-04-14T09:58:23.410361+0000","last_active":"2024-04-14T09:58:28.717724+0000","last_peered":"2024-04-14T09:58:28.717724+0000","last_clean":"2024-04-14T09:58:28.717724+0000","last_became_active":"2024-04-14T09:58:23.407726+0000","last_became_peered":"2024-04-14T09:58:23.407726+0000","last_unstale":"2024-04-14T09:58:28.717724+0000","last_undegraded":"2024-04-14T09:58:28.717724+0000","last_fullsized":"2024-04-14T09:58:28.717724+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:36:20.747237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719465+0000","last_change":"2024-04-14T09:58:23.402602+0000","last_active":"2024-04-14T09:58:28.719465+0000","last_peered":"2024-04-14T09:58:28.719465+0000","last_clean":"2024-04-14T09:58:28.719465+0000","last_became_active":"2024-04-14T09:58:23.402243+0000","last_became_peered":"2024-04-14T09:58:23.402243+0000","last_unstale":"2024-04-14T09:58:28.719465+0000","last_undegraded":"2024-04-14T09:58:28.719465+0000","last_fullsized":"2024-04-14T09:58:28.719465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:37.707556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719506+0000","last_change":"2024-04-14T09:58:23.399802+0000","last_active":"2024-04-14T09:58:28.719506+0000","last_peered":"2024-04-14T09:58:28.719506+0000","last_clean":"2024-04-14T09:58:28.719506+0000","last_became_active":"2024-04-14T09:58:23.399467+0000","last_became_peered":"2024-04-14T09:58:23.399467+0000","last_unstale":"2024-04-14T09:58:28.719506+0000","last_undegraded":"2024-04-14T09:58:28.719506+0000","last_fullsized":"2024-04-14T09:58:28.719506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:04:57.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-14T09:58:28.719375+0000","last_change":"2024-04-14T09:58:23.406066+0000","last_active":"2024-04-14T09:58:28.719375+0000","last_peered":"2024-04-14T09:58:28.719375+0000","last_clean":"2024-04-14T09:58:28.719375+0000","last_became_active":"2024-04-14T09:58:23.405739+0000","last_became_peered":"2024-04-14T09:58:23.405739+0000","last_unstale":"2024-04-14T09:58:28.719375+0000","last_undegraded":"2024-04-14T09:58:28.719375+0000","last_fullsized":"2024-04-14T09:58:28.719375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:22.366328+0000","last_clean_scrub_stamp":"2024-04-14T09:58:22.366328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:05:59.665089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":864256,"data_stored":695877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":270336,"data_stored":105017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":278528,"data_stored":105053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":108769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":104927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":105087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":872448,"data_stored":695933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:58:51.299 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T09:58:51.300 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-14T09:58:51.300 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-14T09:58:51.300 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-14T09:58:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.437+0000 7f23b3f1e640 1 Processor -- start 2024-04-14T09:58:51.437 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.437+0000 7f23b3f1e640 1 -- start start 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b3f1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b3f1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b3f1e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23ac0ccba0 con 0x7f23ac15c330 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b3f1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f23ac0d01c0 con 0x7f23ac0b46c0 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b3f1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac0cd770 con 0x7f23ac0d0da0 2024-04-14T09:58:51.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b24bb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b14b9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b24bb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51472/0 (socket says 172.21.15.40:51472) 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b24bb640 1 -- 172.21.15.40:0/1172040140 learned_addr learned my addr 172.21.15.40:0/1172040140 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b14b9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57362/0 (socket says 172.21.15.40:57362) 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.438+0000 7f23b1cba640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f23ac15c330 0x7f23ac0d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56428/0 (socket says 172.21.15.40:56428) 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b14b9640 1 -- 172.21.15.40:0/1172040140 >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 msgr2=0x7f23ac0cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b14b9640 1 --2- 172.21.15.40:0/1172040140 >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b14b9640 1 -- 172.21.15.40:0/1172040140 >> v1:172.21.15.136:6789/0 conn(0x7f23ac15c330 legacy=0x7f23ac0d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b14b9640 1 -- 172.21.15.40:0/1172040140 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac0cce40 con 0x7f23ac0d0da0 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b0cb8640 1 -- 172.21.15.40:0/1172040140 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999438604 0 0) 0x7f23ac0ccba0 con 0x7f23ac15c330 2024-04-14T09:58:51.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b24bb640 1 --2- 172.21.15.40:0/1172040140 >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b14b9640 1 --2- 172.21.15.40:0/1172040140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f239c0097a0 tx=0x7f239c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626e4786627bebf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.439+0000 7f23b0cb8640 1 -- 172.21.15.40:0/1172040140 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c035020 con 0x7f23ac0d0da0 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b0cb8640 1 -- 172.21.15.40:0/1172040140 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f239c031830 con 0x7f23ac0d0da0 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b0cb8640 1 -- 172.21.15.40:0/1172040140 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c031c00 con 0x7f23ac0d0da0 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 -- 172.21.15.40:0/1172040140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 msgr2=0x7f23ac0cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/1172040140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f239c0097a0 tx=0x7f239c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 -- 172.21.15.40:0/1172040140 shutdown_connections 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/1172040140 >> v2:172.21.15.136:3300/0 conn(0x7f23ac0b46c0 0x7f23ac0cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/1172040140 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac0cdc00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 -- 172.21.15.40:0/1172040140 >> 172.21.15.40:0/1172040140 conn(0x7f23ac0b3ba0 msgr2=0x7f23ac0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 -- 172.21.15.40:0/1172040140 shutdown_connections 2024-04-14T09:58:51.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.440+0000 7f23b3f1e640 1 -- 172.21.15.40:0/1172040140 wait complete. 2024-04-14T09:58:51.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.441+0000 7f23b3f1e640 1 Processor -- start 2024-04-14T09:58:51.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.441+0000 7f23b3f1e640 1 -- start start 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 0x7f23ac09da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac1e4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 0x7f23ac15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac06f610 con 0x7f23ac0b46c0 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac0cd400 con 0x7f23ac15c330 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b3f1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f23ac06f790 con 0x7f23ac0d0da0 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b1cba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 0x7f23ac09da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b1cba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 0x7f23ac09da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55200/0 (socket says 172.21.15.40:55200) 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b1cba640 1 -- 172.21.15.40:0/164454126 learned_addr learned my addr 172.21.15.40:0/164454126 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 0x7f23ac15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b14b9640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac1e4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 -- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 msgr2=0x7f23ac1e4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac1e4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 -- 172.21.15.40:0/164454126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 msgr2=0x7f23ac09da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 0x7f23ac09da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.442+0000 7f23b24bb640 1 -- 172.21.15.40:0/164454126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac09e2f0 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23b24bb640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 0x7f23ac15e630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a400cb80 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23a400cd40 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4003bd0 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac09e5d0 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.443+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac09eb90 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.444+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23ac0cde30 con 0x7f23ac15c330 2024-04-14T09:58:51.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.444+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23a401b030 con 0x7f23ac15c330 2024-04-14T09:58:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.445+0000 7f23a27fc640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 0x7f239006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.445+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f23a408c0f0 con 0x7f23ac15c330 2024-04-14T09:58:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.445+0000 7f23b1cba640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 0x7f239006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.445+0000 7f23b1cba640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 0x7f239006edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000f60 tx=0x7f23a8007ea0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.449+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f23ac0cde30 con 0x7f23ac15c330 2024-04-14T09:58:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.675+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f23ac0ce280 con 0x7f23ac15c330 2024-04-14T09:58:51.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.676+0000 7f23a27fc640 1 -- 172.21.15.40:0/164454126 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f23ac0ce280 con 0x7f23ac15c330 2024-04-14T09:58:51.676 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:51.676 INFO:teuthology.orchestra.run.smithi040.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 msgr2=0x7f239006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 0x7f239006edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23a8000f60 tx=0x7f23a8007ea0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 msgr2=0x7f23ac15e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 0x7f23ac15e630 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a400c490 comp rx=0 tx=0).stop 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 shutdown_connections 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f239006c8f0 0x7f239006edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f23ac15c330 0x7f23ac15e630 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23ac0d0da0 0x7f23ac1e4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 --2- 172.21.15.40:0/164454126 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f23ac0b46c0 0x7f23ac09da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 >> 172.21.15.40:0/164454126 conn(0x7f23ac0b3ba0 msgr2=0x7f23ac0b3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 shutdown_connections 2024-04-14T09:58:51.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.678+0000 7f23b3f1e640 1 -- 172.21.15.40:0/164454126 wait complete. 2024-04-14T09:58:51.688 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-14T09:58:51.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.791+0000 7fcfa60de640 1 Processor -- start 2024-04-14T09:58:51.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.791+0000 7fcfa60de640 1 -- start start 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcfa60de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa00d2f10 0x7fcfa00cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcfa60de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcfa00d0e90 0x7fcfa00d1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcfa60de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa00ceda0 con 0x7fcfa015e510 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcfa60de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa00cf040 con 0x7fcfa00d0e90 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcfa60de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa00cf320 con 0x7fcfa00d2f10 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9f7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fcfa015e510 0x7fcfa00d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56444/0 (socket says 172.21.15.40:56444) 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9f7fe640 1 -- 172.21.15.40:0/3480506477 learned_addr learned my addr 172.21.15.40:0/3480506477 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcfa00d0e90 0x7fcfa00d1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9effd640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa00d2f10 0x7fcfa00cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9ffff640 1 -- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa00d2f10 msgr2=0x7fcfa00cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9ffff640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa00d2f10 0x7fcfa00cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9ffff640 1 -- 172.21.15.40:0/3480506477 >> v1:172.21.15.136:6789/0 conn(0x7fcfa015e510 legacy=0x7fcfa00d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9e7fc640 1 -- 172.21.15.40:0/3480506477 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127916354 0 0) 0x7fcfa00ceda0 con 0x7fcfa015e510 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.792+0000 7fcf9ffff640 1 -- 172.21.15.40:0/3480506477 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00cf600 con 0x7fcfa00d0e90 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.793+0000 7fcf9ffff640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d0e90 0x7fcfa00d1320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009d90 tx=0x7fcf9802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f690741d31340f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.793+0000 7fcf9e7fc640 1 -- 172.21.15.40:0/3480506477 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98039070 con 0x7fcfa00d0e90 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.793+0000 7fcf9e7fc640 1 -- 172.21.15.40:0/3480506477 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9802cbc0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.793+0000 7fcf9e7fc640 1 -- 172.21.15.40:0/3480506477 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf98034440 con 0x7fcfa00d0e90 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 -- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d0e90 msgr2=0x7fcfa00d1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d0e90 0x7fcfa00d1320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcf98009d90 tx=0x7fcf9802be10 comp rx=0 tx=0).stop 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 -- 172.21.15.40:0/3480506477 shutdown_connections 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d0e90 0x7fcfa00d1320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3480506477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa00d2f10 0x7fcfa00cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 -- 172.21.15.40:0/3480506477 >> 172.21.15.40:0/3480506477 conn(0x7fcfa009d570 msgr2=0x7fcfa00d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 -- 172.21.15.40:0/3480506477 shutdown_connections 2024-04-14T09:58:51.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.794+0000 7fcfa60de640 1 -- 172.21.15.40:0/3480506477 wait complete. 2024-04-14T09:58:51.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.795+0000 7fcfa60de640 1 Processor -- start 2024-04-14T09:58:51.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.795+0000 7fcfa60de640 1 -- start start 2024-04-14T09:58:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d2f10 0x7fcfa00ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa015e510 0x7fcfa01f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa00d19e0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa00d1860 con 0x7fcfa00d2f10 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcfa60de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa00b3ad0 con 0x7fcfa015e510 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55208/0 (socket says 172.21.15.40:55208) 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 -- 172.21.15.40:0/3626389147 learned_addr learned my addr 172.21.15.40:0/3626389147 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9effd640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d2f10 0x7fcfa00ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9ffff640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa015e510 0x7fcfa01f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 -- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa015e510 msgr2=0x7fcfa01f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa015e510 0x7fcfa01f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 -- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d2f10 msgr2=0x7fcfa00ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d2f10 0x7fcfa00ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.796+0000 7fcf9f7fe640 1 -- 172.21.15.40:0/3626389147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa00cd770 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcf9f7fe640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c430 tx=0x7fcf9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900074e0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf900047e0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa015ec00 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf90004bd0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.797+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa015f440 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.798+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa00cd4e0 con 0x7fcfa00d0e90 2024-04-14T09:58:51.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.798+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf90011070 con 0x7fcfa00d0e90 2024-04-14T09:58:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.799+0000 7fcf87fff640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 0x7fcf8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.799+0000 7fcf9effd640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 0x7fcf8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.799+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcf9008b940 con 0x7fcfa00d0e90 2024-04-14T09:58:51.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.799+0000 7fcf9effd640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 0x7fcf8c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00a21b0 tx=0x7fcf94009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:51.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.803+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcfa015ec00 con 0x7fcfa00d0e90 2024-04-14T09:58:51.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.990+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfa006d050 con 0x7fcfa00d0e90 2024-04-14T09:58:51.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.991+0000 7fcf87fff640 1 -- 172.21.15.40:0/3626389147 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7fcf90059470 con 0x7fcfa00d0e90 2024-04-14T09:58:51.991 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:51.992 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 msgr2=0x7fcf8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 0x7fcf8c06edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00a21b0 tx=0x7fcf94009190 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 msgr2=0x7fcfa0161660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcf9000c430 tx=0x7fcf9000c8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 shutdown_connections 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcf8c06c8f0 0x7fcf8c06edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcfa015e510 0x7fcfa01f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcfa00d2f10 0x7fcfa00ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 --2- 172.21.15.40:0/3626389147 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcfa00d0e90 0x7fcfa0161660 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 >> 172.21.15.40:0/3626389147 conn(0x7fcfa009d570 msgr2=0x7fcfa006d270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 shutdown_connections 2024-04-14T09:58:51.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:51.994+0000 7fcfa60de640 1 -- 172.21.15.40:0/3626389147 wait complete. 2024-04-14T09:58:52.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:58:52.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.110+0000 7fe6e0bc8640 1 Processor -- start 2024-04-14T09:58:52.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.110+0000 7fe6e0bc8640 1 -- start start 2024-04-14T09:58:52.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6e0bc8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6e0bc8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 0x7fe6dc09b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6e0bc8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6dc15c900 con 0x7fe6dc0d0830 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6e0bc8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe6dc06f890 con 0x7fe6dc0b1590 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6e0bc8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe6dc0cd6e0 con 0x7fe6dc070d30 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6dad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 0x7fe6dc09b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6da59c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6dc0d0830 0x7fe6dc09aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56460/0 (socket says 172.21.15.40:56460) 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6da59c640 1 -- 172.21.15.40:0/1504674774 learned_addr learned my addr 172.21.15.40:0/1504674774 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51516/0 (socket says 172.21.15.40:51516) 2024-04-14T09:58:52.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6dad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 0x7fe6dc09b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:57398/0 (socket says 172.21.15.40:57398) 2024-04-14T09:58:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 msgr2=0x7fe6dc09b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 --2- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 0x7fe6dc09b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/1504674774 >> v1:172.21.15.136:6789/0 conn(0x7fe6dc0d0830 legacy=0x7fe6dc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/1504674774 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc0cd9c0 con 0x7fe6dc0b1590 2024-04-14T09:58:52.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.111+0000 7fe6d959a640 1 -- 172.21.15.40:0/1504674774 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179188033 0 0) 0x7fe6dc15c900 con 0x7fe6dc0d0830 2024-04-14T09:58:52.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.112+0000 7fe6d9d9b640 1 --2- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00097a0 tx=0x7fe6d002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d225cc2016882cd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.112+0000 7fe6d959a640 1 -- 172.21.15.40:0/1504674774 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0035020 con 0x7fe6dc0b1590 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.112+0000 7fe6d959a640 1 -- 172.21.15.40:0/1504674774 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d0031830 con 0x7fe6dc0b1590 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.112+0000 7fe6d959a640 1 -- 172.21.15.40:0/1504674774 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0031c00 con 0x7fe6dc0b1590 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc0b1590 msgr2=0x7fe6dc0cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00097a0 tx=0x7fe6d002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/1504674774 shutdown_connections 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc070d30 0x7fe6dc09b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/1504674774 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc0cfdc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/1504674774 >> 172.21.15.40:0/1504674774 conn(0x7fe6dc0b3ad0 msgr2=0x7fe6dc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/1504674774 shutdown_connections 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.113+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/1504674774 wait complete. 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.114+0000 7fe6e0bc8640 1 Processor -- start 2024-04-14T09:58:52.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.114+0000 7fe6e0bc8640 1 -- start start 2024-04-14T09:58:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc070d30 0x7fe6dc150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc0d0830 0x7fe6dc09e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe6dc06f520 con 0x7fe6dc0b1590 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6dc0cdf80 con 0x7fe6dc070d30 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6e0bc8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe6dc09b690 con 0x7fe6dc0d0830 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6da59c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc070d30 0x7fe6dc150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55222/0 (socket says 172.21.15.40:55222) 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/3764227301 learned_addr learned my addr 172.21.15.40:0/3764227301 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6dad9d640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc0d0830 0x7fe6dc09e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc0d0830 msgr2=0x7fe6dc09e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc0d0830 0x7fe6dc09e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc070d30 msgr2=0x7fe6dc150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc070d30 0x7fe6dc150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 -- 172.21.15.40:0/3764227301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6dc1509a0 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.115+0000 7fe6d9d9b640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098c0 tx=0x7fe6d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.116+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0035040 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.116+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6d003b920 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.116+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6d003bd10 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.116+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6dc0caa20 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.116+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6dc09beb0 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.117+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6dc075760 con 0x7fe6dc0b1590 2024-04-14T09:58:52.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.117+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe6d0038020 con 0x7fe6dc0b1590 2024-04-14T09:58:52.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.117+0000 7fe6caffd640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 0x7fe6bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.118+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe6d00ade50 con 0x7fe6dc0b1590 2024-04-14T09:58:52.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.118+0000 7fe6da59c640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 0x7fe6bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.118+0000 7fe6da59c640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 0x7fe6bc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.122+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe6dc1509a0 con 0x7fe6dc0b1590 2024-04-14T09:58:52.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.305+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe6dc15bb80 con 0x7fe6dc0b1590 2024-04-14T09:58:52.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.305+0000 7fe6caffd640 1 -- 172.21.15.40:0/3764227301 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe6d007b8e0 con 0x7fe6dc0b1590 2024-04-14T09:58:52.305 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 msgr2=0x7fe6bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 0x7fe6bc06edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc007fd0 tx=0x7fe6cc007de0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 msgr2=0x7fe6dc09e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe6d00098c0 tx=0x7fe6d00046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 shutdown_connections 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe6bc06c8f0 0x7fe6bc06edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6dc0d0830 0x7fe6dc09e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6dc0b1590 0x7fe6dc09e0d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 --2- 172.21.15.40:0/3764227301 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6dc070d30 0x7fe6dc150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 >> 172.21.15.40:0/3764227301 conn(0x7fe6dc0b3ad0 msgr2=0x7fe6dc0b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 shutdown_connections 2024-04-14T09:58:52.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.308+0000 7fe6e0bc8640 1 -- 172.21.15.40:0/3764227301 wait complete. 2024-04-14T09:58:52.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:58:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 Processor -- start 2024-04-14T09:58:52.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 -- start start 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e3d0 0x7f17f40d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17f40c7e30 0x7f17f40d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17f40d2f30 con 0x7f17f415e7b0 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f17f40cf000 con 0x7f17f40c7e30 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.423+0000 7f17fbe80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40cf2e0 con 0x7f17f415e3d0 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17f40c7e30 0x7f17f40d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f17f40c7e30 0x7f17f40d4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55228/0 (socket says 172.21.15.40:55228) 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 -- 172.21.15.40:0/4048271676 learned_addr learned my addr 172.21.15.40:0/4048271676 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f9c1c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e3d0 0x7f17f40d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f8c1a640 1 -- 172.21.15.40:0/4048271676 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 700567234 0 0) 0x7f17f40d2f30 con 0x7f17f415e7b0 2024-04-14T09:58:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f8c1a640 1 -- 172.21.15.40:0/4048271676 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e0003520 con 0x7f17f415e7b0 2024-04-14T09:58:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 -- 172.21.15.40:0/4048271676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e3d0 msgr2=0x7f17f40d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 --2- 172.21.15.40:0/4048271676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e3d0 0x7f17f40d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 -- 172.21.15.40:0/4048271676 >> v1:172.21.15.136:6789/0 conn(0x7f17f415e7b0 legacy=0x7f17f40d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.424+0000 7f17f941b640 1 -- 172.21.15.40:0/4048271676 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f40cf5c0 con 0x7f17f40c7e30 2024-04-14T09:58:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17f941b640 1 --2- 172.21.15.40:0/4048271676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40d4570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009870 tx=0x7f17e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448e4d6222bcd13f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17f8c1a640 1 -- 172.21.15.40:0/4048271676 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4034070 con 0x7f17f40c7e30 2024-04-14T09:58:52.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17f8c1a640 1 -- 172.21.15.40:0/4048271676 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e4030840 con 0x7f17f40c7e30 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17f8c1a640 1 -- 172.21.15.40:0/4048271676 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4030bf0 con 0x7f17f40c7e30 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 -- 172.21.15.40:0/4048271676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 msgr2=0x7f17f40d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4048271676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40d4570 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17e4009870 tx=0x7f17e402b980 comp rx=0 tx=0).stop 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 -- 172.21.15.40:0/4048271676 shutdown_connections 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4048271676 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40d4570 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4048271676 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e3d0 0x7f17f40d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.425+0000 7f17fbe80640 1 -- 172.21.15.40:0/4048271676 >> 172.21.15.40:0/4048271676 conn(0x7f17f408dc90 msgr2=0x7f17f409d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.426+0000 7f17fbe80640 1 -- 172.21.15.40:0/4048271676 shutdown_connections 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.426+0000 7f17fbe80640 1 -- 172.21.15.40:0/4048271676 wait complete. 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 Processor -- start 2024-04-14T09:58:52.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 -- start start 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17f415e3d0 0x7f17f40cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 0x7f17f41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40d2a00 con 0x7f17f40c7e30 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f17f40d2880 con 0x7f17f415e3d0 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17fbe80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f17f40d2b80 con 0x7f17f415e7b0 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17f9c1c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.427+0000 7f17f9c1c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55232/0 (socket says 172.21.15.40:55232) 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 -- 172.21.15.40:0/4267741525 learned_addr learned my addr 172.21.15.40:0/4267741525 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f941b640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17f415e3d0 0x7f17f40cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17fa41d640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 0x7f17f41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 -- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 msgr2=0x7f17f41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 0x7f17f41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 -- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17f415e3d0 msgr2=0x7f17f40cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17f415e3d0 0x7f17f40cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 -- 172.21.15.40:0/4267741525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f41e7f50 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17fa41d640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 0x7f17f41588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17f9c1c640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f0017070 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17f000c9d0 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f40b89a0 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17f000cdc0 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.428+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f40b9240 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.429+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f4075760 con 0x7f17f40c7e30 2024-04-14T09:58:52.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.430+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17f001a070 con 0x7f17f40c7e30 2024-04-14T09:58:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.430+0000 7f17ea7fc640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.430+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f17f008c180 con 0x7f17f40c7e30 2024-04-14T09:58:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.430+0000 7f17f941b640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.431+0000 7f17f941b640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 0x7f17d806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036000 tx=0x7f17e4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.434+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f17f0059c20 con 0x7f17f40c7e30 2024-04-14T09:58:52.515 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:58:52.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:58:52.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.619+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f17f40d51d0 con 0x7f17f40c7e30 2024-04-14T09:58:52.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.619+0000 7f17ea7fc640 1 -- 172.21.15.40:0/4267741525 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f17f005df20 con 0x7f17f40c7e30 2024-04-14T09:58:52.619 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:52.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 msgr2=0x7f17d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 0x7f17d806edb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f17e4036000 tx=0x7f17e4008030 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 msgr2=0x7f17f40b8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f17f000e9e0 tx=0x7f17f000eea0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 shutdown_connections 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f17d806c8f0 0x7f17d806edb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f17f415e7b0 0x7f17f41588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f17f415e3d0 0x7f17f40cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 --2- 172.21.15.40:0/4267741525 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f17f40c7e30 0x7f17f40b8040 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 >> 172.21.15.40:0/4267741525 conn(0x7f17f408dc90 msgr2=0x7f17f415cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 shutdown_connections 2024-04-14T09:58:52.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.621+0000 7f17fbe80640 1 -- 172.21.15.40:0/4267741525 wait complete. 2024-04-14T09:58:52.631 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:58:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 Processor -- start 2024-04-14T09:58:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 -- start start 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 0x7fa17c0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 0x7fa17c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c15e9a0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa17c06fa80 con 0x7fa17c15e5c0 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.736+0000 7fa182911640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c06fd60 con 0x7fa17c06b520 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 0x7fa17c0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17b7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa17c0b00c0 0x7fa17c070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56472/0 (socket says 172.21.15.40:56472) 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa180eae640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 0x7fa17c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17b7fe640 1 -- 172.21.15.40:0/3448261110 learned_addr learned my addr 172.21.15.40:0/3448261110 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17affd640 1 -- 172.21.15.40:0/3448261110 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923245550 0 0) 0x7fa17c15e9a0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17affd640 1 -- 172.21.15.40:0/3448261110 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa164003520 con 0x7fa17c0b00c0 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa180eae640 1 -- 172.21.15.40:0/3448261110 >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 msgr2=0x7fa17c0b4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa180eae640 1 --2- 172.21.15.40:0/3448261110 >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 0x7fa17c0b4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa180eae640 1 -- 172.21.15.40:0/3448261110 >> v1:172.21.15.136:6789/0 conn(0x7fa17c0b00c0 legacy=0x7fa17c070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa180eae640 1 -- 172.21.15.40:0/3448261110 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c070040 con 0x7fa17c06b520 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.737+0000 7fa17bfff640 1 --2- 172.21.15.40:0/3448261110 >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 0x7fa17c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:52.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa180eae640 1 --2- 172.21.15.40:0/3448261110 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 0x7fa17c06b9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa174009d90 tx=0x7fa17402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d56d5e0aa8bff9f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa17affd640 1 -- 172.21.15.40:0/3448261110 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174039070 con 0x7fa17c06b520 2024-04-14T09:58:52.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa17affd640 1 -- 172.21.15.40:0/3448261110 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17402cbc0 con 0x7fa17c06b520 2024-04-14T09:58:52.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa17affd640 1 -- 172.21.15.40:0/3448261110 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174034440 con 0x7fa17c06b520 2024-04-14T09:58:52.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa182911640 1 -- 172.21.15.40:0/3448261110 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 msgr2=0x7fa17c06b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.738+0000 7fa182911640 1 --2- 172.21.15.40:0/3448261110 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 0x7fa17c06b9d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa174009d90 tx=0x7fa17402be10 comp rx=0 tx=0).stop 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 -- 172.21.15.40:0/3448261110 shutdown_connections 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 --2- 172.21.15.40:0/3448261110 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c06b520 0x7fa17c06b9d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 --2- 172.21.15.40:0/3448261110 >> v2:172.21.15.136:3300/0 conn(0x7fa17c15e5c0 0x7fa17c0b4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 -- 172.21.15.40:0/3448261110 >> 172.21.15.40:0/3448261110 conn(0x7fa17c0b2db0 msgr2=0x7fa17c0b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 -- 172.21.15.40:0/3448261110 shutdown_connections 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.739+0000 7fa182911640 1 -- 172.21.15.40:0/3448261110 wait complete. 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.740+0000 7fa182911640 1 Processor -- start 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.740+0000 7fa182911640 1 -- start start 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.740+0000 7fa182911640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c06b520 0x7fa17c15b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c15e5c0 0x7fa17c14cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0ad8b0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0b09d0 con 0x7fa17c06b520 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c0ada30 con 0x7fa17c15e5c0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55242/0 (socket says 172.21.15.40:55242) 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 -- 172.21.15.40:0/826750478 learned_addr learned my addr 172.21.15.40:0/826750478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17bfff640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c06b520 0x7fa17c15b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa180eae640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c15e5c0 0x7fa17c14cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 -- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c15e5c0 msgr2=0x7fa17c14cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c15e5c0 0x7fa17c14cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 -- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c06b520 msgr2=0x7fa17c15b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c06b520 0x7fa17c15b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 -- 172.21.15.40:0/826750478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c152fc0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa17b7fe640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa17000c430 tx=0x7fa17000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa170017070 con 0x7fa17c0b00c0 2024-04-14T09:58:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa170005ce0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c1532a0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1700072f0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.741+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c14d010 con 0x7fa17c0b00c0 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.742+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17c075760 con 0x7fa17c0b00c0 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.743+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa17001a070 con 0x7fa17c0b00c0 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.743+0000 7fa178ff9640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 0x7fa16806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.743+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa17008b2b0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.743+0000 7fa17bfff640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 0x7fa16806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:52.745 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.744+0000 7fa17bfff640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 0x7fa16806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009560 tx=0x7fa16c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:52.747 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.747+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa170058d60 con 0x7fa17c0b00c0 2024-04-14T09:58:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.931+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa17c14d2d0 con 0x7fa17c0b00c0 2024-04-14T09:58:52.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.931+0000 7fa178ff9640 1 -- 172.21.15.40:0/826750478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fa17005d060 con 0x7fa17c0b00c0 2024-04-14T09:58:52.931 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:58:52.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 msgr2=0x7fa16806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 0x7fa16806edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa16c009560 tx=0x7fa16c009190 comp rx=0 tx=0).stop 2024-04-14T09:58:52.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 msgr2=0x7fa17c152890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa17000c430 tx=0x7fa17000c8f0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 shutdown_connections 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa16806c8f0 0x7fa16806edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c15e5c0 0x7fa17c14cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa17c0b00c0 0x7fa17c152890 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.933+0000 7fa182911640 1 --2- 172.21.15.40:0/826750478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c06b520 0x7fa17c15b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.934+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 >> 172.21.15.40:0/826750478 conn(0x7fa17c0b2db0 msgr2=0x7fa17c157ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.934+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 shutdown_connections 2024-04-14T09:58:52.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:52.934+0000 7fa182911640 1 -- 172.21.15.40:0/826750478 wait complete. 2024-04-14T09:58:52.944 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:58:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.049+0000 7f5240e88640 1 Processor -- start 2024-04-14T09:58:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.049+0000 7f5240e88640 1 -- start start 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5240e88640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c071020 0x7f523c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5240e88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5240e88640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f523c06cc40 con 0x7f523c0cd9d0 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5240e88640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f523c09b3c0 con 0x7f523c071020 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5240e88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f523c06c960 con 0x7f523c09af80 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c071020 0x7f523c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f523c071020 0x7f523c09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55258/0 (socket says 172.21.15.40:55258) 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 -- 172.21.15.40:0/184845702 learned_addr learned my addr 172.21.15.40:0/184845702 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5233fff640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 -- 172.21.15.40:0/184845702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 msgr2=0x7f523c0cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f5239d9b640 1 -- 172.21.15.40:0/184845702 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246164443 0 0) 0x7f523c06cc40 con 0x7f523c0cd9d0 2024-04-14T09:58:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 -- 172.21.15.40:0/184845702 >> v1:172.21.15.136:6789/0 conn(0x7f523c0cd9d0 legacy=0x7f523c0cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.050+0000 7f523a59c640 1 -- 172.21.15.40:0/184845702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c0cc6d0 con 0x7f523c071020 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f523a59c640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c071020 0x7f523c09aa40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a605cab8f7a42f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f5239d9b640 1 -- 172.21.15.40:0/184845702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c02f840 con 0x7f523c071020 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f5239d9b640 1 -- 172.21.15.40:0/184845702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f522c02f9e0 con 0x7f523c071020 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f5239d9b640 1 -- 172.21.15.40:0/184845702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522c02fdb0 con 0x7f523c071020 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f5240e88640 1 -- 172.21.15.40:0/184845702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c071020 msgr2=0x7f523c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.051+0000 7f5240e88640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c071020 0x7f523c09aa40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f522c009870 tx=0x7f522c02ba20 comp rx=0 tx=0).stop 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 -- 172.21.15.40:0/184845702 shutdown_connections 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 --2- 172.21.15.40:0/184845702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c071020 0x7f523c09aa40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 -- 172.21.15.40:0/184845702 >> 172.21.15.40:0/184845702 conn(0x7f523c0b3ad0 msgr2=0x7f523c0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 -- 172.21.15.40:0/184845702 shutdown_connections 2024-04-14T09:58:53.053 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.052+0000 7f5240e88640 1 -- 172.21.15.40:0/184845702 wait complete. 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.053+0000 7f5240e88640 1 Processor -- start 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.053+0000 7f5240e88640 1 -- start start 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f523c071020 0x7f523c161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0ccf70 con 0x7f523c0cd9d0 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f523c0ccc90 con 0x7f523c071020 2024-04-14T09:58:53.055 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f523c06db50 con 0x7f523c09af80 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55264/0 (socket says 172.21.15.40:55264) 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 -- 172.21.15.40:0/1942224069 learned_addr learned my addr 172.21.15.40:0/1942224069 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5233fff640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523a59c640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f523c071020 0x7f523c161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 -- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 msgr2=0x7f523c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 -- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f523c071020 msgr2=0x7f523c161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f523c071020 0x7f523c161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 -- 172.21.15.40:0/1942224069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523c1605c0 con 0x7f523c0cd9d0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f523ad9d640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f523400c760 tx=0x7f523400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234003da0 con 0x7f523c0cd9d0 2024-04-14T09:58:53.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5234005070 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523c160900 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234005460 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.054+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f523c161140 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.055+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f523c075760 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.056+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5234005600 con 0x7f523c0cd9d0 2024-04-14T09:58:53.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.056+0000 7f5232ffd640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 0x7f521c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.056+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f523408bd50 con 0x7f523c0cd9d0 2024-04-14T09:58:53.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.056+0000 7f523a59c640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 0x7f521c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.057+0000 7f523a59c640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 0x7f521c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f522c036000 tx=0x7f522c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.060+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f523408f030 con 0x7f523c0cd9d0 2024-04-14T09:58:53.241 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.242+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f523c09ad00 con 0x7f523c0cd9d0 2024-04-14T09:58:53.242 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.242+0000 7f5232ffd640 1 -- 172.21.15.40:0/1942224069 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f523c160900 con 0x7f523c0cd9d0 2024-04-14T09:58:53.242 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 msgr2=0x7f521c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 0x7f521c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f522c036000 tx=0x7f522c008030 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 msgr2=0x7f523c15f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f523400c760 tx=0x7f523400cc20 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 shutdown_connections 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f521c06c8f0 0x7f521c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f523c0cd9d0 0x7f523c15f940 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f523c09af80 0x7f523c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 --2- 172.21.15.40:0/1942224069 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f523c071020 0x7f523c161940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 >> 172.21.15.40:0/1942224069 conn(0x7f523c0b3ad0 msgr2=0x7f523c0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 shutdown_connections 2024-04-14T09:58:53.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.244+0000 7f5240e88640 1 -- 172.21.15.40:0/1942224069 wait complete. 2024-04-14T09:58:53.255 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.356+0000 7f182d60f640 1 Processor -- start 2024-04-14T09:58:53.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.356+0000 7f182d60f640 1 -- start start 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f182d60f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f182813deb0 0x7f18280b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f182d60f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18280b2100 0x7f182815b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f182d60f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f182815faf0 con 0x7f182815be10 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f182d60f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f182815ed30 con 0x7f18280b2100 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f182d60f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f182815f010 con 0x7f182813deb0 2024-04-14T09:58:53.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18267fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f18280b2100 0x7f182815b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18277fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f182815be10 0x7f18280b4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40976/0 (socket says 172.21.15.40:40976) 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18277fe640 1 -- 172.21.15.40:0/929439695 learned_addr learned my addr 172.21.15.40:0/929439695 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f1826ffd640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f182813deb0 0x7f18280b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18267fc640 1 -- 172.21.15.40:0/929439695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f182813deb0 msgr2=0x7f18280b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18267fc640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f182813deb0 0x7f18280b1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18267fc640 1 -- 172.21.15.40:0/929439695 >> v1:172.21.15.40:6789/0 conn(0x7f182815be10 legacy=0x7f18280b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f18267fc640 1 -- 172.21.15.40:0/929439695 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182815f2f0 con 0x7f18280b2100 2024-04-14T09:58:53.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.357+0000 7f1825ffb640 1 -- 172.21.15.40:0/929439695 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 761587057 0 0) 0x7f182815faf0 con 0x7f182815be10 2024-04-14T09:58:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.358+0000 7f18267fc640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18280b2100 0x7f182815b8d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1acc990071a5b30 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.358+0000 7f1825ffb640 1 -- 172.21.15.40:0/929439695 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c035020 con 0x7f18280b2100 2024-04-14T09:58:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.358+0000 7f1825ffb640 1 -- 172.21.15.40:0/929439695 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c031830 con 0x7f18280b2100 2024-04-14T09:58:53.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.358+0000 7f1825ffb640 1 -- 172.21.15.40:0/929439695 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c031c00 con 0x7f18280b2100 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 -- 172.21.15.40:0/929439695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18280b2100 msgr2=0x7f182815b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18280b2100 0x7f182815b8d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 -- 172.21.15.40:0/929439695 shutdown_connections 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f18280b2100 0x7f182815b8d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 --2- 172.21.15.40:0/929439695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f182813deb0 0x7f18280b1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 -- 172.21.15.40:0/929439695 >> 172.21.15.40:0/929439695 conn(0x7f182806ebf0 msgr2=0x7f182806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 -- 172.21.15.40:0/929439695 shutdown_connections 2024-04-14T09:58:53.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.359+0000 7f182d60f640 1 -- 172.21.15.40:0/929439695 wait complete. 2024-04-14T09:58:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.360+0000 7f182d60f640 1 Processor -- start 2024-04-14T09:58:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.360+0000 7f182d60f640 1 -- start start 2024-04-14T09:58:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18280b2100 0x7f182813b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182815be10 0x7f182815a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f182815c420 con 0x7f182813deb0 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f182815c2a0 con 0x7f182815be10 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f182d60f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f182813e290 con 0x7f18280b2100 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55276/0 (socket says 172.21.15.40:55276) 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 -- 172.21.15.40:0/1433867278 learned_addr learned my addr 172.21.15.40:0/1433867278 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f1826ffd640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18280b2100 0x7f182813b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18277fe640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182815be10 0x7f182815a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 -- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18280b2100 msgr2=0x7f182813b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18280b2100 0x7f182813b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 -- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182815be10 msgr2=0x7f182815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182815be10 0x7f182815a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.361+0000 7f18267fc640 1 -- 172.21.15.40:0/1433867278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18281e6ff0 con 0x7f182813deb0 2024-04-14T09:58:53.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f18267fc640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c035040 con 0x7f182813deb0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f181c004230 con 0x7f182813deb0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18281e72d0 con 0x7f182813deb0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c03a640 con 0x7f182813deb0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.362+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18281e7890 con 0x7f182813deb0 2024-04-14T09:58:53.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.363+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18280756f0 con 0x7f182813deb0 2024-04-14T09:58:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.363+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f181c038020 con 0x7f182813deb0 2024-04-14T09:58:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.363+0000 7f180f7fe640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 0x7f181406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.364+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f181c0adad0 con 0x7f182813deb0 2024-04-14T09:58:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.364+0000 7f1826ffd640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 0x7f181406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.364+0000 7f1826ffd640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 0x7f181406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1820009b40 tx=0x7f1820009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.368+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f181c07b570 con 0x7f182813deb0 2024-04-14T09:58:53.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.593+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f182806c210 con 0x7f182813deb0 2024-04-14T09:58:53.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.593+0000 7f180f7fe640 1 -- 172.21.15.40:0/1433867278 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f181c07f870 con 0x7f182813deb0 2024-04-14T09:58:53.593 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:53.593 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:53.594 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:58:53.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 msgr2=0x7f181406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 0x7f181406edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1820009b40 tx=0x7f1820009190 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 msgr2=0x7f182815a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f181c0097a0 tx=0x7f181c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 shutdown_connections 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f181406c8f0 0x7f181406edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f182815be10 0x7f182815a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f182813deb0 0x7f182815a070 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 --2- 172.21.15.40:0/1433867278 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18280b2100 0x7f182813b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 >> 172.21.15.40:0/1433867278 conn(0x7f182806ebf0 msgr2=0x7f18280ce890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 shutdown_connections 2024-04-14T09:58:53.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.596+0000 7f182d60f640 1 -- 172.21.15.40:0/1433867278 wait complete. 2024-04-14T09:58:53.606 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:53.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.709+0000 7f0c9b55e640 1 Processor -- start 2024-04-14T09:58:53.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.709+0000 7f0c9b55e640 1 -- start start 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c9b55e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c940b0790 0x7f0c940b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c9b55e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9406bcf0 0x7f0c9406e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c9b55e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c940724c0 con 0x7f0c9415e590 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c9b55e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0c9406c4b0 con 0x7f0c940b0790 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c9b55e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9415e970 con 0x7f0c9406bcf0 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c98af9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0c940b0790 0x7f0c940b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c992fa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0c9415e590 0x7f0c940ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40992/0 (socket says 172.21.15.40:40992) 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c992fa640 1 -- 172.21.15.40:0/2468817612 learned_addr learned my addr 172.21.15.40:0/2468817612 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:53.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c99afb640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9406bcf0 0x7f0c9406e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c8bfff640 1 -- 172.21.15.40:0/2468817612 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846789513 0 0) 0x7f0c940724c0 con 0x7f0c9415e590 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c8bfff640 1 -- 172.21.15.40:0/2468817612 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c80003520 con 0x7f0c9415e590 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c98af9640 1 -- 172.21.15.40:0/2468817612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9406bcf0 msgr2=0x7f0c9406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c98af9640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9406bcf0 0x7f0c9406e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c98af9640 1 -- 172.21.15.40:0/2468817612 >> v1:172.21.15.40:6789/0 conn(0x7f0c9415e590 legacy=0x7f0c940ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.710+0000 7f0c98af9640 1 -- 172.21.15.40:0/2468817612 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9406c1d0 con 0x7f0c940b0790 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.711+0000 7f0c98af9640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c940b0790 0x7f0c940b49e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c840097a0 tx=0x7f0c8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffe14b2440abc29 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.711+0000 7f0c8bfff640 1 -- 172.21.15.40:0/2468817612 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84035020 con 0x7f0c940b0790 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.711+0000 7f0c8bfff640 1 -- 172.21.15.40:0/2468817612 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c84031830 con 0x7f0c940b0790 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.711+0000 7f0c8bfff640 1 -- 172.21.15.40:0/2468817612 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c84031c00 con 0x7f0c940b0790 2024-04-14T09:58:53.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 -- 172.21.15.40:0/2468817612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c940b0790 msgr2=0x7f0c940b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c940b0790 0x7f0c940b49e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c840097a0 tx=0x7f0c8402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 -- 172.21.15.40:0/2468817612 shutdown_connections 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9406bcf0 0x7f0c9406e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/2468817612 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c940b0790 0x7f0c940b49e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 -- 172.21.15.40:0/2468817612 >> 172.21.15.40:0/2468817612 conn(0x7f0c940b6540 msgr2=0x7f0c940b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 -- 172.21.15.40:0/2468817612 shutdown_connections 2024-04-14T09:58:53.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.712+0000 7f0c9b55e640 1 -- 172.21.15.40:0/2468817612 wait complete. 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.713+0000 7f0c9b55e640 1 Processor -- start 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.713+0000 7f0c9b55e640 1 -- start start 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.713+0000 7f0c9b55e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.713+0000 7f0c9b55e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c940b0790 0x7f0c9415ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9415e590 0x7f0c9414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0c940adfc0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c94072a40 con 0x7f0c940b0790 2024-04-14T09:58:53.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0c9406eeb0 con 0x7f0c9415e590 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55290/0 (socket says 172.21.15.40:55290) 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 -- 172.21.15.40:0/3387780064 learned_addr learned my addr 172.21.15.40:0/3387780064 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c99afb640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9415e590 0x7f0c9414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c98af9640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c940b0790 0x7f0c9415ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 -- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9415e590 msgr2=0x7f0c9414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9415e590 0x7f0c9414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 -- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c940b0790 msgr2=0x7f0c9415ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c940b0790 0x7f0c9415ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 -- 172.21.15.40:0/3387780064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c9415f0f0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c992fa640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c390 tx=0x7f0c9000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c90017070 con 0x7f0c9406bcf0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c90005ce0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c9415f3d0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c900072f0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.714+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c9415f990 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.715+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c940756f0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.716+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c9001a070 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.716+0000 7f0c89ffb640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 0x7f0c7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.716+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c9008b230 con 0x7f0c9406bcf0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.716+0000 7f0c98af9640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 0x7f0c7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:53.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.717+0000 7f0c98af9640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 0x7f0c7806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c84036000 tx=0x7f0c84008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:53.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.721+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0c90058cc0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.905 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.905+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c94159080 con 0x7f0c9406bcf0 2024-04-14T09:58:53.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.906+0000 7f0c89ffb640 1 -- 172.21.15.40:0/3387780064 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f0c9005cfc0 con 0x7f0c9406bcf0 2024-04-14T09:58:53.906 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:53.906 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 msgr2=0x7f0c7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 0x7f0c7806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0c84036000 tx=0x7f0c84008030 comp rx=0 tx=0).stop 2024-04-14T09:58:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 msgr2=0x7f0c9415eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0c9000c390 tx=0x7f0c9000c850 comp rx=0 tx=0).stop 2024-04-14T09:58:53.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 shutdown_connections 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0c7806c8f0 0x7f0c7806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c9415e590 0x7f0c9414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c940b0790 0x7f0c9415ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 --2- 172.21.15.40:0/3387780064 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0c9406bcf0 0x7f0c9415eb10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 >> 172.21.15.40:0/3387780064 conn(0x7f0c940b6540 msgr2=0x7f0c940b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 shutdown_connections 2024-04-14T09:58:53.909 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:53.908+0000 7f0c9b55e640 1 -- 172.21.15.40:0/3387780064 wait complete. 2024-04-14T09:58:53.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:58:53.919 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:58:54.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.024+0000 7f233058c640 1 Processor -- start 2024-04-14T09:58:54.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.024+0000 7f233058c640 1 -- start start 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f233058c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f232815e3d0 0x7f23280d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f233058c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280d2f30 con 0x7f232815e7b0 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f233058c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23280cf000 con 0x7f23280c7e30 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f233058c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f23280cf2e0 con 0x7f232815e3d0 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232eb29640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f232815e7b0 0x7f23280cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:40996/0 (socket says 172.21.15.40:40996) 2024-04-14T09:58:54.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232eb29640 1 -- 172.21.15.40:0/1728257103 learned_addr learned my addr 172.21.15.40:0/1728257103 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232e328640 1 --2- 172.21.15.40:0/1728257103 >> v2:172.21.15.136:3300/0 conn(0x7f232815e3d0 0x7f23280d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645943120 0 0) 0x7f23280d2f30 con 0x7f232815e7b0 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2310003520 con 0x7f232815e7b0 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942855302 0 0) 0x7f23280cf000 con 0x7f23280c7e30 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23280d2f30 con 0x7f23280c7e30 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232e328640 1 -- 172.21.15.40:0/1728257103 >> v1:172.21.15.136:6789/0 conn(0x7f23280c7e30 legacy=0x7f23280d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232e328640 1 -- 172.21.15.40:0/1728257103 >> v1:172.21.15.40:6789/0 conn(0x7f232815e7b0 legacy=0x7f23280cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.025+0000 7f232e328640 1 -- 172.21.15.40:0/1728257103 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280cf5c0 con 0x7f232815e3d0 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.026+0000 7f232e328640 1 --2- 172.21.15.40:0/1728257103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f23280d4030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23200097a0 tx=0x7f232002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea21776dcdcd5072 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.026+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2320034070 con 0x7f232815e3d0 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.026+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2320030610 con 0x7f232815e3d0 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.026+0000 7f232d326640 1 -- 172.21.15.40:0/1728257103 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23200309e0 con 0x7f232815e3d0 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 -- 172.21.15.40:0/1728257103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 msgr2=0x7f23280d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 --2- 172.21.15.40:0/1728257103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f23280d4030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f23200097a0 tx=0x7f232002b960 comp rx=0 tx=0).stop 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 -- 172.21.15.40:0/1728257103 shutdown_connections 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 --2- 172.21.15.40:0/1728257103 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f23280d4030 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 -- 172.21.15.40:0/1728257103 >> 172.21.15.40:0/1728257103 conn(0x7f232808dc90 msgr2=0x7f232809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 -- 172.21.15.40:0/1728257103 shutdown_connections 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.027+0000 7f233058c640 1 -- 172.21.15.40:0/1728257103 wait complete. 2024-04-14T09:58:54.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.028+0000 7f233058c640 1 Processor -- start 2024-04-14T09:58:54.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.028+0000 7f233058c640 1 -- start start 2024-04-14T09:58:54.034 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23280c7e30 0x7f2328150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f232815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f23280d2a00 con 0x7f232815e7b0 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f23280d2880 con 0x7f232815e3d0 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f233058c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f23280d2b80 con 0x7f23280c7e30 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55296/0 (socket says 172.21.15.40:55296) 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 -- 172.21.15.40:0/1892692801 learned_addr learned my addr 172.21.15.40:0/1892692801 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232e328640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23280c7e30 0x7f2328150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232db27640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f232815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 -- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23280c7e30 msgr2=0x7f2328150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23280c7e30 0x7f2328150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 -- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 msgr2=0x7f232815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f232815ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.029+0000 7f232eb29640 1 -- 172.21.15.40:0/1892692801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2328150d60 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f232eb29640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f231800cad0 tx=0x7f231800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318017070 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f231800ac50 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232815f6a0 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2318012400 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.030+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232815fc60 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.031+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2328075760 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.032+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f231801a070 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.032+0000 7f2326ffd640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.032+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f231808bb40 con 0x7f232815e7b0 2024-04-14T09:58:54.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.032+0000 7f232e328640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.032+0000 7f232e328640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2320036000 tx=0x7f232003b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.037 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.036+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f23180595e0 con 0x7f232815e7b0 2024-04-14T09:58:54.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.220+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f23280d51d0 con 0x7f232815e7b0 2024-04-14T09:58:54.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.220+0000 7f2326ffd640 1 -- 172.21.15.40:0/1892692801 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f231805d8e0 con 0x7f232815e7b0 2024-04-14T09:58:54.220 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:58:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 msgr2=0x7f231406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 0x7f231406ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2320036000 tx=0x7f232003b040 comp rx=0 tx=0).stop 2024-04-14T09:58:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 msgr2=0x7f232815b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f231800cad0 tx=0x7f231800cf90 comp rx=0 tx=0).stop 2024-04-14T09:58:54.222 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 shutdown_connections 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f231406c920 0x7f231406ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f232815e7b0 0x7f232815b7e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f232815e3d0 0x7f232815ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 --2- 172.21.15.40:0/1892692801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f23280c7e30 0x7f2328150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 >> 172.21.15.40:0/1892692801 conn(0x7f232808dc90 msgr2=0x7f23280d4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 shutdown_connections 2024-04-14T09:58:54.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.222+0000 7f233058c640 1 -- 172.21.15.40:0/1892692801 wait complete. 2024-04-14T09:58:54.232 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:58:54.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.337+0000 7ff36f508640 1 Processor -- start 2024-04-14T09:58:54.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.337+0000 7ff36f508640 1 -- start start 2024-04-14T09:58:54.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36f508640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff368071020 0x7ff36809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36f508640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff36809af80 0x7ff3680cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36f508640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36806cc40 con 0x7ff3680cd9d0 2024-04-14T09:58:54.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36f508640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff36809b3c0 con 0x7ff36809af80 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36f508640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff36806c960 con 0x7ff368071020 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff36809af80 0x7ff3680cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff36809af80 0x7ff3680cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55302/0 (socket says 172.21.15.40:55302) 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 -- 172.21.15.40:0/208346946 learned_addr learned my addr 172.21.15.40:0/208346946 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36d2a4640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff368071020 0x7ff36809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 -- 172.21.15.40:0/208346946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff368071020 msgr2=0x7ff36809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff368071020 0x7ff36809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 -- 172.21.15.40:0/208346946 >> v1:172.21.15.136:6789/0 conn(0x7ff3680cd9d0 legacy=0x7ff3680cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.338+0000 7ff36caa3640 1 -- 172.21.15.40:0/208346946 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680cc6d0 con 0x7ff36809af80 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.339+0000 7ff36caa3640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36809af80 0x7ff3680cd490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009870 tx=0x7ff35c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a01eee581cea9edf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.339+0000 7ff367fff640 1 -- 172.21.15.40:0/208346946 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c02f840 con 0x7ff36809af80 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.339+0000 7ff367fff640 1 -- 172.21.15.40:0/208346946 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c02f9e0 con 0x7ff36809af80 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.339+0000 7ff367fff640 1 -- 172.21.15.40:0/208346946 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c02fdb0 con 0x7ff36809af80 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 -- 172.21.15.40:0/208346946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36809af80 msgr2=0x7ff3680cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36809af80 0x7ff3680cd490 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff35c009870 tx=0x7ff35c02ba20 comp rx=0 tx=0).stop 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 -- 172.21.15.40:0/208346946 shutdown_connections 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff36809af80 0x7ff3680cd490 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 --2- 172.21.15.40:0/208346946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff368071020 0x7ff36809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 -- 172.21.15.40:0/208346946 >> 172.21.15.40:0/208346946 conn(0x7ff3680b3ad0 msgr2=0x7ff3680b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 -- 172.21.15.40:0/208346946 shutdown_connections 2024-04-14T09:58:54.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.340+0000 7ff36f508640 1 -- 172.21.15.40:0/208346946 wait complete. 2024-04-14T09:58:54.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.341+0000 7ff36f508640 1 Processor -- start 2024-04-14T09:58:54.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.341+0000 7ff36f508640 1 -- start start 2024-04-14T09:58:54.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff368071020 0x7ff3680c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff36809af80 0x7ff3680caa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680ccf70 con 0x7ff3680cd9d0 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680ccc90 con 0x7ff368071020 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36f508640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff36806db50 con 0x7ff36809af80 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55316/0 (socket says 172.21.15.40:55316) 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 -- 172.21.15.40:0/3183976472 learned_addr learned my addr 172.21.15.40:0/3183976472 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36caa3640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff36809af80 0x7ff3680caa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36d2a4640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff368071020 0x7ff3680c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 -- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff36809af80 msgr2=0x7ff3680caa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff36809af80 0x7ff3680caa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 -- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff368071020 msgr2=0x7ff3680c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff368071020 0x7ff3680c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.342+0000 7ff36daa5640 1 -- 172.21.15.40:0/3183976472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680ca2a0 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff36daa5640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c710 tx=0x7ff35800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358016020 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff358006d50 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358003bb0 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3680b74d0 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.343+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff36815ed00 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.344+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff368075760 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.344+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff35800a850 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.345+0000 7ff365ffb640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 0x7ff35406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.345+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff35808b950 con 0x7ff3680cd9d0 2024-04-14T09:58:54.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.345+0000 7ff36d2a4640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 0x7ff35406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.345+0000 7ff36d2a4640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 0x7ff35406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cbdb0 tx=0x7ff360008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.349+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff358020020 con 0x7ff3680cd9d0 2024-04-14T09:58:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.536+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff3680b79f0 con 0x7ff3680cd9d0 2024-04-14T09:58:54.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.537+0000 7ff365ffb640 1 -- 172.21.15.40:0/3183976472 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7ff35800ce20 con 0x7ff3680cd9d0 2024-04-14T09:58:54.537 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 msgr2=0x7ff35406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 0x7ff35406edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff3680cbdb0 tx=0x7ff360008040 comp rx=0 tx=0).stop 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 msgr2=0x7ff3680cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff35800c710 tx=0x7ff35800cbd0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 shutdown_connections 2024-04-14T09:58:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff35406c8f0 0x7ff35406edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff3680cd9d0 0x7ff3680cafa0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff36809af80 0x7ff3680caa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 --2- 172.21.15.40:0/3183976472 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff368071020 0x7ff3680c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 >> 172.21.15.40:0/3183976472 conn(0x7ff3680b3ad0 msgr2=0x7ff3680b2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 shutdown_connections 2024-04-14T09:58:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.539+0000 7ff36f508640 1 -- 172.21.15.40:0/3183976472 wait complete. 2024-04-14T09:58:54.550 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:58:54.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.655+0000 7ff0014ad640 1 Processor -- start 2024-04-14T09:58:54.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.655+0000 7ff0014ad640 1 -- start start 2024-04-14T09:58:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7ff0014ad640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feffc09aa40 0x7feffc070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7ff0014ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7ff0014ad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feffc0d1e60 con 0x7feffc06f560 2024-04-14T09:58:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7ff0014ad640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7feffc0b19c0 con 0x7feffc09aa40 2024-04-14T09:58:54.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7ff0014ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feffc0d1670 con 0x7feffc0b4700 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7feffc06f560 0x7feffc06f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41006/0 (socket says 172.21.15.40:41006) 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffb7fe640 1 -- 172.21.15.40:0/2846687576 learned_addr learned my addr 172.21.15.40:0/2846687576 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffa7fc640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffaffd640 1 --2- 172.21.15.40:0/2846687576 >> v2:172.21.15.136:3300/0 conn(0x7feffc09aa40 0x7feffc070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feff9ffb640 1 -- 172.21.15.40:0/2846687576 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724877208 0 0) 0x7fefec001490 con 0x7feffc06f560 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feff9ffb640 1 -- 172.21.15.40:0/2846687576 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefe4003520 con 0x7feffc06f560 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffaffd640 1 -- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 msgr2=0x7feffc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffaffd640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffaffd640 1 -- 172.21.15.40:0/2846687576 >> v1:172.21.15.40:6789/0 conn(0x7feffc06f560 legacy=0x7feffc06f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffaffd640 1 -- 172.21.15.40:0/2846687576 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc09b360 con 0x7feffc09aa40 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.656+0000 7feffa7fc640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:54.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.657+0000 7feffaffd640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc070810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feff40097a0 tx=0x7feff402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44827a05922962f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.657+0000 7feff9ffb640 1 -- 172.21.15.40:0/2846687576 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4035020 con 0x7feffc09aa40 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.657+0000 7feff9ffb640 1 -- 172.21.15.40:0/2846687576 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff4031830 con 0x7feffc09aa40 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.657+0000 7feff9ffb640 1 -- 172.21.15.40:0/2846687576 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4031be0 con 0x7feffc09aa40 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 -- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 msgr2=0x7feffc070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc070810 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7feff40097a0 tx=0x7feff402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 -- 172.21.15.40:0/2846687576 shutdown_connections 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 --2- 172.21.15.40:0/2846687576 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc070810 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 -- 172.21.15.40:0/2846687576 >> 172.21.15.40:0/2846687576 conn(0x7feffc0b3be0 msgr2=0x7feffc0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 -- 172.21.15.40:0/2846687576 shutdown_connections 2024-04-14T09:58:54.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.658+0000 7ff0014ad640 1 -- 172.21.15.40:0/2846687576 wait complete. 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.659+0000 7ff0014ad640 1 Processor -- start 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.659+0000 7ff0014ad640 1 -- start start 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc0b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7feffc0710c0 con 0x7feffc06f560 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feffc070de0 con 0x7feffc09aa40 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feffc06c6d0 con 0x7feffc0b4700 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55330/0 (socket says 172.21.15.40:55330) 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 -- 172.21.15.40:0/1017056052 learned_addr learned my addr 172.21.15.40:0/1017056052 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffa7fc640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc0b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffb7fe640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 -- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 msgr2=0x7feffc0cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc0cb0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 -- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 msgr2=0x7feffc0b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc0b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 -- 172.21.15.40:0/1017056052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc0b5520 con 0x7feffc06f560 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7feffaffd640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feff40098c0 tx=0x7feff40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4035040 con 0x7feffc06f560 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feff403b900 con 0x7feffc06f560 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff403bcf0 con 0x7feffc06f560 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.660+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc0b5800 con 0x7feffc06f560 2024-04-14T09:58:54.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.661+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc0b5dc0 con 0x7feffc06f560 2024-04-14T09:58:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.662+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feffc075760 con 0x7feffc06f560 2024-04-14T09:58:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.662+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feff4038020 con 0x7feffc06f560 2024-04-14T09:58:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.662+0000 7fefe37fe640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 0x7fefe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.662+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feff40ade50 con 0x7feffc06f560 2024-04-14T09:58:54.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.662+0000 7feffa7fc640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 0x7fefe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.663+0000 7feffa7fc640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 0x7fefe806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feffc0b7190 tx=0x7feff0009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.666+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7feff407b8f0 con 0x7feffc06f560 2024-04-14T09:58:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.850+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7feffc06c9a0 con 0x7feffc06f560 2024-04-14T09:58:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.850+0000 7fefe37fe640 1 -- 172.21.15.40:0/1017056052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7feff407fbf0 con 0x7feffc06f560 2024-04-14T09:58:54.851 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 msgr2=0x7fefe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 0x7fefe806edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feffc0b7190 tx=0x7feff0009190 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 msgr2=0x7feffc1e6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feff40098c0 tx=0x7feff40046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 shutdown_connections 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fefe806c8f0 0x7fefe806edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feffc0b4700 0x7feffc0cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feffc09aa40 0x7feffc0b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 --2- 172.21.15.40:0/1017056052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7feffc06f560 0x7feffc1e6790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 >> 172.21.15.40:0/1017056052 conn(0x7feffc0b3be0 msgr2=0x7feffc0ce970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 shutdown_connections 2024-04-14T09:58:54.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.852+0000 7ff0014ad640 1 -- 172.21.15.40:0/1017056052 wait complete. 2024-04-14T09:58:54.862 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:58:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.968+0000 7f28a3808640 1 Processor -- start 2024-04-14T09:58:54.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.968+0000 7f28a3808640 1 -- start start 2024-04-14T09:58:54.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a3808640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f289c15e3d0 0x7f289c0d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a3808640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f289c0c7e30 0x7f289c0d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a3808640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f289c0d2f30 con 0x7f289c15e7b0 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a3808640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f289c0cf000 con 0x7f289c0c7e30 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a3808640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f289c0cf2e0 con 0x7f289c15e3d0 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f289c0c7e30 0x7f289c0d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a1da5640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f289c15e7b0 0x7f289c0d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41014/0 (socket says 172.21.15.40:41014) 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f289c0c7e30 0x7f289c0d4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55338/0 (socket says 172.21.15.40:55338) 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a1da5640 1 -- 172.21.15.40:0/1964079457 learned_addr learned my addr 172.21.15.40:0/1964079457 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a15a4640 1 --2- 172.21.15.40:0/1964079457 >> v2:172.21.15.136:3300/0 conn(0x7f289c15e3d0 0x7f289c0d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 -- 172.21.15.40:0/1964079457 >> v2:172.21.15.136:3300/0 conn(0x7f289c15e3d0 msgr2=0x7f289c0d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:54.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 --2- 172.21.15.40:0/1964079457 >> v2:172.21.15.136:3300/0 conn(0x7f289c15e3d0 0x7f289c0d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 -- 172.21.15.40:0/1964079457 >> v1:172.21.15.40:6789/0 conn(0x7f289c15e7b0 legacy=0x7f289c0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f28a0da3640 1 -- 172.21.15.40:0/1964079457 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c0cf5c0 con 0x7f289c0c7e30 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.969+0000 7f2893fff640 1 -- 172.21.15.40:0/1964079457 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367307263 0 0) 0x7f289c0d2f30 con 0x7f289c15e7b0 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f28a0da3640 1 --2- 172.21.15.40:0/1964079457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c0c7e30 0x7f289c0d4570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f289c0b6e70 tx=0x7f288c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21c96e9657d15f50 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f2893fff640 1 -- 172.21.15.40:0/1964079457 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c035020 con 0x7f289c0c7e30 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f2893fff640 1 -- 172.21.15.40:0/1964079457 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c031830 con 0x7f289c0c7e30 2024-04-14T09:58:54.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f2893fff640 1 -- 172.21.15.40:0/1964079457 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c031c00 con 0x7f289c0c7e30 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f28a3808640 1 -- 172.21.15.40:0/1964079457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c0c7e30 msgr2=0x7f289c0d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.970+0000 7f28a3808640 1 --2- 172.21.15.40:0/1964079457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c0c7e30 0x7f289c0d4570 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f289c0b6e70 tx=0x7f288c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 -- 172.21.15.40:0/1964079457 shutdown_connections 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 --2- 172.21.15.40:0/1964079457 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c0c7e30 0x7f289c0d4570 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 --2- 172.21.15.40:0/1964079457 >> v2:172.21.15.136:3300/0 conn(0x7f289c15e3d0 0x7f289c0d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 -- 172.21.15.40:0/1964079457 >> 172.21.15.40:0/1964079457 conn(0x7f289c08dc90 msgr2=0x7f289c09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:54.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 -- 172.21.15.40:0/1964079457 shutdown_connections 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.971+0000 7f28a3808640 1 -- 172.21.15.40:0/1964079457 wait complete. 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 Processor -- start 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 -- start start 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 0x7f289c15cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f289c15e7b0 0x7f289c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f289c0d2a00 con 0x7f289c15e3d0 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f289c0d2880 con 0x7f289c0c7e30 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.972+0000 7f28a3808640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f289c0d2b80 con 0x7f289c15e7b0 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55340/0 (socket says 172.21.15.40:55340) 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 -- 172.21.15.40:0/2887627640 learned_addr learned my addr 172.21.15.40:0/2887627640 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:54.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a15a4640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 0x7f289c15cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a1da5640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f289c15e7b0 0x7f289c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 -- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f289c15e7b0 msgr2=0x7f289c159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f289c15e7b0 0x7f289c159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 -- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 msgr2=0x7f289c15cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 0x7f289c15cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 -- 172.21.15.40:0/2887627640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c0cdd80 con 0x7f289c15e3d0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a15a4640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 0x7f289c15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a0da3640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f288c009890 tx=0x7f288c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c041070 con 0x7f289c15e3d0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c03b920 con 0x7f289c15e3d0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c0ce060 con 0x7f289c15e3d0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.973+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c035040 con 0x7f289c15e3d0 2024-04-14T09:58:54.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.974+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c15ef60 con 0x7f289c15e3d0 2024-04-14T09:58:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.974+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c075760 con 0x7f289c15e3d0 2024-04-14T09:58:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.975+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f288c038020 con 0x7f289c15e3d0 2024-04-14T09:58:54.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.975+0000 7f2891ffb640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 0x7f288006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.975+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f288c0ad700 con 0x7f289c15e3d0 2024-04-14T09:58:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.975+0000 7f28a15a4640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 0x7f288006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:54.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.976+0000 7f28a15a4640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 0x7f288006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2898009f30 tx=0x7f2898009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:54.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:54.980+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f288c031800 con 0x7f289c15e3d0 2024-04-14T09:58:55.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.164+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f289c0c7800 con 0x7f289c15e3d0 2024-04-14T09:58:55.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.164+0000 7f2891ffb640 1 -- 172.21.15.40:0/2887627640 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f288c07b1a0 con 0x7f289c15e3d0 2024-04-14T09:58:55.164 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 msgr2=0x7f288006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 0x7f288006ede0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2898009f30 tx=0x7f2898009190 comp rx=0 tx=0).stop 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 msgr2=0x7f289c0cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f288c009890 tx=0x7f288c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 shutdown_connections 2024-04-14T09:58:55.166 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f288006c920 0x7f288006ede0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f289c15e7b0 0x7f289c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f289c15e3d0 0x7f289c0cd2c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 --2- 172.21.15.40:0/2887627640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f289c0c7e30 0x7f289c15cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 >> 172.21.15.40:0/2887627640 conn(0x7f289c08dc90 msgr2=0x7f289c06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 shutdown_connections 2024-04-14T09:58:55.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.166+0000 7f28a3808640 1 -- 172.21.15.40:0/2887627640 wait complete. 2024-04-14T09:58:55.177 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:55.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.279+0000 7ffa1e6de640 1 Processor -- start 2024-04-14T09:58:55.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.279+0000 7ffa1e6de640 1 -- start start 2024-04-14T09:58:55.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1e6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa180b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1e6de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa180d2e80 0x7ffa180cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1e6de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa180b4c70 con 0x7ffa180b4760 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1e6de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ffa180b5880 con 0x7ffa180d2e80 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1e6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa180b4f50 con 0x7ffa1815e650 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1cc7b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa180d2e80 0x7ffa180cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa17fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa180b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa177fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ffa180b4760 0x7ffa180d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:56512/0 (socket says 172.21.15.40:56512) 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa1cc7b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa180d2e80 0x7ffa180cf0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:51676/0 (socket says 172.21.15.40:51676) 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.280+0000 7ffa177fe640 1 -- 172.21.15.40:0/3750267999 learned_addr learned my addr 172.21.15.40:0/3750267999 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa1cc7b640 1 -- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 msgr2=0x7ffa180b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa1cc7b640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa180b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa1cc7b640 1 -- 172.21.15.40:0/3750267999 >> v1:172.21.15.136:6789/0 conn(0x7ffa180b4760 legacy=0x7ffa180d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa1cc7b640 1 -- 172.21.15.40:0/3750267999 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa180b5230 con 0x7ffa180d2e80 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa16ffd640 1 -- 172.21.15.40:0/3750267999 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306593966 0 0) 0x7ffa180b4c70 con 0x7ffa180b4760 2024-04-14T09:58:55.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa17fff640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa180b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa1cc7b640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180cf0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009d90 tx=0x7ffa1002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1127216f7b6c0bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.281+0000 7ffa16ffd640 1 -- 172.21.15.40:0/3750267999 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10039070 con 0x7ffa180d2e80 2024-04-14T09:58:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa16ffd640 1 -- 172.21.15.40:0/3750267999 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa1002cc50 con 0x7ffa180d2e80 2024-04-14T09:58:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa16ffd640 1 -- 172.21.15.40:0/3750267999 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa10034440 con 0x7ffa180d2e80 2024-04-14T09:58:55.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 -- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 msgr2=0x7ffa180cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180cf0a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ffa10009d90 tx=0x7ffa1002bea0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 -- 172.21.15.40:0/3750267999 shutdown_connections 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180cf0a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/3750267999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa180b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 -- 172.21.15.40:0/3750267999 >> 172.21.15.40:0/3750267999 conn(0x7ffa1809d580 msgr2=0x7ffa180d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 -- 172.21.15.40:0/3750267999 shutdown_connections 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.282+0000 7ffa1e6de640 1 -- 172.21.15.40:0/3750267999 wait complete. 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.283+0000 7ffa1e6de640 1 Processor -- start 2024-04-14T09:58:55.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.283+0000 7ffa1e6de640 1 -- start start 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa18156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa1815ea30 con 0x7ffa180b4760 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa180d2270 con 0x7ffa180d2e80 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1e6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa1815ebb0 con 0x7ffa1815e650 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa17fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55356/0 (socket says 172.21.15.40:55356) 2024-04-14T09:58:55.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa17fff640 1 -- 172.21.15.40:0/2985987976 learned_addr learned my addr 172.21.15.40:0/2985987976 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa177fe640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180b85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa1cc7b640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa18156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa17fff640 1 -- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 msgr2=0x7ffa18156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.284+0000 7ffa17fff640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa18156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa17fff640 1 -- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 msgr2=0x7ffa180b85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa17fff640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180b85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa17fff640 1 -- 172.21.15.40:0/2985987976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa180b8b20 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa17fff640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ebe0 tx=0x7ffa0800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08017070 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa0800cc30 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa180b8dc0 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08013470 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.285+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa180b71f0 con 0x7ffa180b4760 2024-04-14T09:58:55.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.286+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa180b35f0 con 0x7ffa180b4760 2024-04-14T09:58:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.286+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa0801a070 con 0x7ffa180b4760 2024-04-14T09:58:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.287+0000 7ffa14ff9640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 0x7ffa0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.287+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffa0808bd00 con 0x7ffa180b4760 2024-04-14T09:58:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.287+0000 7ffa177fe640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 0x7ffa0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.287+0000 7ffa177fe640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 0x7ffa0406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b3ad0 tx=0x7ffa0c007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.291+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ffa180b35f0 con 0x7ffa180b4760 2024-04-14T09:58:55.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.517+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa180756f0 con 0x7ffa180b4760 2024-04-14T09:58:55.517 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.518+0000 7ffa14ff9640 1 -- 172.21.15.40:0/2985987976 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7ffa08059830 con 0x7ffa180b4760 2024-04-14T09:58:55.518 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:55.518 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:55.518 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 msgr2=0x7ffa0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 0x7ffa0406edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ffa180b3ad0 tx=0x7ffa0c007de0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 msgr2=0x7ffa181550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800ebe0 tx=0x7ffa0800c520 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 shutdown_connections 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa0406c8f0 0x7ffa0406edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa1815e650 0x7ffa18156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa180d2e80 0x7ffa180b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 --2- 172.21.15.40:0/2985987976 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa180b4760 0x7ffa181550c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 >> 172.21.15.40:0/2985987976 conn(0x7ffa1809d580 msgr2=0x7ffa180cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 shutdown_connections 2024-04-14T09:58:55.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.520+0000 7ffa1e6de640 1 -- 172.21.15.40:0/2985987976 wait complete. 2024-04-14T09:58:55.530 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:58:55.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.660+0000 7f2e9e91e640 1 Processor -- start 2024-04-14T09:58:55.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.660+0000 7f2e9e91e640 1 -- start start 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9e91e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2e98162f70 0x7f2e98162340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9e91e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e980d1650 0x7f2e98162880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9e91e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e980d0300 con 0x7f2e9815e570 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9e91e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2e980d11c0 con 0x7f2e980d1650 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9e91e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2e980d05b0 con 0x7f2e98162f70 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9cebb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e980d1650 0x7f2e98162880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9cebb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2e980d1650 0x7f2e98162880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55366/0 (socket says 172.21.15.40:55366) 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e9cebb640 1 -- 172.21.15.40:0/3948779444 learned_addr learned my addr 172.21.15.40:0/3948779444 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.661+0000 7f2e977fe640 1 --2- 172.21.15.40:0/3948779444 >> v2:172.21.15.136:3300/0 conn(0x7f2e98162f70 0x7f2e98162340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e9cebb640 1 -- 172.21.15.40:0/3948779444 >> v2:172.21.15.136:3300/0 conn(0x7f2e98162f70 msgr2=0x7f2e98162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e9cebb640 1 --2- 172.21.15.40:0/3948779444 >> v2:172.21.15.136:3300/0 conn(0x7f2e98162f70 0x7f2e98162340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e9cebb640 1 -- 172.21.15.40:0/3948779444 >> v1:172.21.15.136:6789/0 conn(0x7f2e9815e570 legacy=0x7f2e980cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e96ffd640 1 -- 172.21.15.40:0/3948779444 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339185751 0 0) 0x7f2e980d0300 con 0x7f2e9815e570 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e9cebb640 1 -- 172.21.15.40:0/3948779444 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e980d0890 con 0x7f2e980d1650 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e9cebb640 1 --2- 172.21.15.40:0/3948779444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e980d1650 0x7f2e98162880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2e980d1340 tx=0x7f2e9002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2887c81f32e4e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.662+0000 7f2e96ffd640 1 -- 172.21.15.40:0/3948779444 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9002cb00 con 0x7f2e980d1650 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e96ffd640 1 -- 172.21.15.40:0/3948779444 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9002cca0 con 0x7f2e980d1650 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e96ffd640 1 -- 172.21.15.40:0/3948779444 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90034610 con 0x7f2e980d1650 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 -- 172.21.15.40:0/3948779444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e980d1650 msgr2=0x7f2e98162880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/3948779444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e980d1650 0x7f2e98162880 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2e980d1340 tx=0x7f2e9002bf60 comp rx=0 tx=0).stop 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 -- 172.21.15.40:0/3948779444 shutdown_connections 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/3948779444 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e980d1650 0x7f2e98162880 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/3948779444 >> v2:172.21.15.136:3300/0 conn(0x7f2e98162f70 0x7f2e98162340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 -- 172.21.15.40:0/3948779444 >> 172.21.15.40:0/3948779444 conn(0x7f2e9809d5a0 msgr2=0x7f2e980d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 -- 172.21.15.40:0/3948779444 shutdown_connections 2024-04-14T09:58:55.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.663+0000 7f2e9e91e640 1 -- 172.21.15.40:0/3948779444 wait complete. 2024-04-14T09:58:55.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.664+0000 7f2e9e91e640 1 Processor -- start 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.664+0000 7f2e9e91e640 1 -- start start 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 0x7f2e980b5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 0x7f2e9809eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2e9815e950 con 0x7f2e98162f70 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2e980d0e50 con 0x7f2e9815e570 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9e91e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2e9815ead0 con 0x7f2e980d1650 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55374/0 (socket says 172.21.15.40:55374) 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 -- 172.21.15.40:0/1718998199 learned_addr learned my addr 172.21.15.40:0/1718998199 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:55.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e97fff640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 0x7f2e980b5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e977fe640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 0x7f2e9809eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 -- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 msgr2=0x7f2e980b5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 0x7f2e980b5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 -- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 msgr2=0x7f2e9809eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 0x7f2e9809eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e9cebb640 1 -- 172.21.15.40:0/1718998199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e980b6320 con 0x7f2e98162f70 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e97fff640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 0x7f2e980b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.665+0000 7f2e977fe640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 0x7f2e9809eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e9cebb640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009f10 tx=0x7f2e90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90043020 con 0x7f2e98162f70 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9002ce50 con 0x7f2e98162f70 2024-04-14T09:58:55.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90009510 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9809f620 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.666+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e980b8360 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.667+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e980756f0 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.667+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2e90046020 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.668+0000 7f2e94ff9640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 0x7f2e7806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.668+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2e900ae250 con 0x7f2e98162f70 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.668+0000 7f2e97fff640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 0x7f2e7806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.668+0000 7f2e97fff640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 0x7f2e7806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e88007fd0 tx=0x7f2e88009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.672+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2e9004d070 con 0x7f2e98162f70 2024-04-14T09:58:55.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.857+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2e980cfb00 con 0x7f2e98162f70 2024-04-14T09:58:55.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.858+0000 7f2e94ff9640 1 -- 172.21.15.40:0/1718998199 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18490 (secure 0 0 0) 0x7f2e9007c340 con 0x7f2e98162f70 2024-04-14T09:58:55.858 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:55.858 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":25,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:58:27.787053+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:58:55.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 msgr2=0x7f2e7806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 0x7f2e7806ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2e88007fd0 tx=0x7f2e88009040 comp rx=0 tx=0).stop 2024-04-14T09:58:55.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 msgr2=0x7f2e9809f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2e90009f10 tx=0x7f2e90004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:55.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 shutdown_connections 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2e7806c920 0x7f2e7806ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2e98162f70 0x7f2e9809f0e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2e9815e570 0x7f2e9809eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 --2- 172.21.15.40:0/1718998199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2e980d1650 0x7f2e980b5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 >> 172.21.15.40:0/1718998199 conn(0x7f2e9809d5a0 msgr2=0x7f2e98162280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 shutdown_connections 2024-04-14T09:58:55.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.860+0000 7f2e9e91e640 1 -- 172.21.15.40:0/1718998199 wait complete. 2024-04-14T09:58:55.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:58:55.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.973+0000 7fbeb21fe640 1 Processor -- start 2024-04-14T09:58:55.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.973+0000 7fbeb21fe640 1 -- start start 2024-04-14T09:58:55.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeb21fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbeac15e650 0x7fbeac0b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeb21fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeb21fe640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac0b4c70 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeb21fe640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbeac0b5880 con 0x7fbeac15e650 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeb21fe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac0b4f50 con 0x7fbeac0b4760 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeab7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbeac15e650 0x7fbeac0b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeabfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbeac0d2cb0 0x7fbeac1622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41016/0 (socket says 172.21.15.40:41016) 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeabfff640 1 -- 172.21.15.40:0/3975109391 learned_addr learned my addr 172.21.15.40:0/3975109391 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeaaffd640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeab7fe640 1 -- 172.21.15.40:0/3975109391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 msgr2=0x7fbeac0d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeab7fe640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0d2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeab7fe640 1 -- 172.21.15.40:0/3975109391 >> v1:172.21.15.40:6789/0 conn(0x7fbeac0d2cb0 legacy=0x7fbeac1622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeaa7fc640 1 -- 172.21.15.40:0/3975109391 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3430737886 0 0) 0x7fbeac0b4c70 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeab7fe640 1 -- 172.21.15.40:0/3975109391 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac0b5230 con 0x7fbeac15e650 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.974+0000 7fbeaaffd640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeab7fe640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac15e650 0x7fbeac0b4220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0097a0 tx=0x7fbe9c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a664013546207d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeaa7fc640 1 -- 172.21.15.40:0/3975109391 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c035020 con 0x7fbeac15e650 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeaa7fc640 1 -- 172.21.15.40:0/3975109391 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c031830 con 0x7fbeac15e650 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeaa7fc640 1 -- 172.21.15.40:0/3975109391 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c031c00 con 0x7fbeac15e650 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeb21fe640 1 -- 172.21.15.40:0/3975109391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac15e650 msgr2=0x7fbeac0b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.975+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac15e650 0x7fbeac0b4220 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c0097a0 tx=0x7fbe9c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 -- 172.21.15.40:0/3975109391 shutdown_connections 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0d2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/3975109391 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac15e650 0x7fbeac0b4220 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 -- 172.21.15.40:0/3975109391 >> 172.21.15.40:0/3975109391 conn(0x7fbeac09d580 msgr2=0x7fbeac0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:55.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 -- 172.21.15.40:0/3975109391 shutdown_connections 2024-04-14T09:58:55.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.976+0000 7fbeb21fe640 1 -- 172.21.15.40:0/3975109391 wait complete. 2024-04-14T09:58:55.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.977+0000 7fbeb21fe640 1 Processor -- start 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.977+0000 7fbeb21fe640 1 -- start start 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbeac15e650 0x7fbeac0c7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac15ea30 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac0d2270 con 0x7fbeac15e650 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac15ebb0 con 0x7fbeac0b4760 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55388/0 (socket says 172.21.15.40:55388) 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 -- 172.21.15.40:0/1745855859 learned_addr learned my addr 172.21.15.40:0/1745855859 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeab7fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeabfff640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbeac15e650 0x7fbeac0c7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.981 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 -- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 msgr2=0x7fbeac0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 -- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbeac15e650 msgr2=0x7fbeac0c7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbeac15e650 0x7fbeac0c7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 -- 172.21.15.40:0/1745855859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac0ca610 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeaaffd640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbea000e900 tx=0x7fbea000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0017070 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea000ca00 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea000cdf0 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac0ca8f0 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.978+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac0b8530 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.979+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac0d32c0 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.980+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbea001a070 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.980+0000 7fbe93fff640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.980+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbea008bc40 con 0x7fbeac0d2cb0 2024-04-14T09:58:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.981+0000 7fbeab7fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:55.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.981+0000 7fbeab7fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 0x7fbe9806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c036000 tx=0x7fbe9c03d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:55.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:55.985+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbeac0d32c0 con 0x7fbeac0d2cb0 2024-04-14T09:58:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.212+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeac0756f0 con 0x7fbeac0d2cb0 2024-04-14T09:58:56.212 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.213+0000 7fbe93fff640 1 -- 172.21.15.40:0/1745855859 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fbea0059770 con 0x7fbeac0d2cb0 2024-04-14T09:58:56.213 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:58:56.213 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:58:56.213 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:58:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 msgr2=0x7fbe9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 0x7fbe9806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c036000 tx=0x7fbe9c03d040 comp rx=0 tx=0).stop 2024-04-14T09:58:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 msgr2=0x7fbeac0c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fbea000e900 tx=0x7fbea000edc0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.215 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 shutdown_connections 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbeac15e650 0x7fbeac0c7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbeac0d2cb0 0x7fbeac0c7a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 --2- 172.21.15.40:0/1745855859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbeac0b4760 0x7fbeac0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 >> 172.21.15.40:0/1745855859 conn(0x7fbeac09d580 msgr2=0x7fbeac0d0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 shutdown_connections 2024-04-14T09:58:56.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.215+0000 7fbeb21fe640 1 -- 172.21.15.40:0/1745855859 wait complete. 2024-04-14T09:58:56.628 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T09:58:22.820415+0000', 'modified': '2024-04-14T09:58:44.815480+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4297}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4297': {'gid': 4297, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6835/994538529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 994538529}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 994538529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4297, 'qdb_cluster': [4297]} 2024-04-14T09:58:56.629 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T09:58:56.629 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-14T09:58:56.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.734+0000 7f02f982d640 1 Processor -- start 2024-04-14T09:58:56.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.734+0000 7f02f982d640 1 -- start start 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f982d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f40b31d0 0x7f02f40b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f982d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f02f41600a0 0x7f02f41604d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f982d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f40b1e60 con 0x7f02f4147860 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f982d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f02f40b3af0 con 0x7f02f40b31d0 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f982d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f02f40b2100 con 0x7f02f41600a0 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f40b31d0 0x7f02f40b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f02f40b31d0 0x7f02f40b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45542/0 (socket says 172.21.15.40:45542) 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1127848702 learned_addr learned my addr 172.21.15.40:0/1127848702 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f37fe640 1 --2- 172.21.15.40:0/1127848702 >> v2:172.21.15.136:3300/0 conn(0x7f02f41600a0 0x7f02f41604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1127848702 >> v2:172.21.15.136:3300/0 conn(0x7f02f41600a0 msgr2=0x7f02f41604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/1127848702 >> v2:172.21.15.136:3300/0 conn(0x7f02f41600a0 0x7f02f41604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1127848702 >> v1:172.21.15.136:6789/0 conn(0x7f02f4147860 legacy=0x7f02f415f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.735+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1127848702 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f40b23e0 con 0x7f02f40b31d0 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.736+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/1127848702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40b35b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02f40b2030 tx=0x7f02ec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eadbe6686a7bd6c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.736+0000 7f02f1ffb640 1 -- 172.21.15.40:0/1127848702 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec034070 con 0x7f02f40b31d0 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.736+0000 7f02f1ffb640 1 -- 172.21.15.40:0/1127848702 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec030860 con 0x7f02f40b31d0 2024-04-14T09:58:56.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.736+0000 7f02f1ffb640 1 -- 172.21.15.40:0/1127848702 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec030c30 con 0x7f02f40b31d0 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 -- 172.21.15.40:0/1127848702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 msgr2=0x7f02f40b35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 --2- 172.21.15.40:0/1127848702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40b35b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02f40b2030 tx=0x7f02ec02b9a0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 -- 172.21.15.40:0/1127848702 shutdown_connections 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 --2- 172.21.15.40:0/1127848702 >> v2:172.21.15.136:3300/0 conn(0x7f02f41600a0 0x7f02f41604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 --2- 172.21.15.40:0/1127848702 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40b35b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 -- 172.21.15.40:0/1127848702 >> 172.21.15.40:0/1127848702 conn(0x7f02f40b56f0 msgr2=0x7f02f40b5ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 -- 172.21.15.40:0/1127848702 shutdown_connections 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.737+0000 7f02f982d640 1 -- 172.21.15.40:0/1127848702 wait complete. 2024-04-14T09:58:56.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.738+0000 7f02f982d640 1 Processor -- start 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.738+0000 7f02f982d640 1 -- start start 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02f4147860 0x7f02f4159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02f41600a0 0x7f02f41f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02f40b2c80 con 0x7f02f40b31d0 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f02f40b29a0 con 0x7f02f41600a0 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f982d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f02f40d0fd0 con 0x7f02f4147860 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45554/0 (socket says 172.21.15.40:45554) 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 -- 172.21.15.40:0/3329247062 learned_addr learned my addr 172.21.15.40:0/3329247062 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f37fe640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02f41600a0 0x7f02f41f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f27fc640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02f4147860 0x7f02f4159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 -- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02f4147860 msgr2=0x7f02f4159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02f4147860 0x7f02f4159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 -- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02f41600a0 msgr2=0x7f02f41f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02f41600a0 0x7f02f41f43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 -- 172.21.15.40:0/3329247062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f4159690 con 0x7f02f40b31d0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.739+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02ec000c00 tx=0x7f02ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.740+0000 7f02ebfff640 1 -- 172.21.15.40:0/3329247062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec048070 con 0x7f02f40b31d0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.740+0000 7f02ebfff640 1 -- 172.21.15.40:0/3329247062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec030660 con 0x7f02f40b31d0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.740+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f4159950 con 0x7f02f40b31d0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.740+0000 7f02ebfff640 1 -- 172.21.15.40:0/3329247062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec034040 con 0x7f02f40b31d0 2024-04-14T09:58:56.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.740+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f4159f10 con 0x7f02f40b31d0 2024-04-14T09:58:56.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.741+0000 7f02ebfff640 1 -- 172.21.15.40:0/3329247062 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02ec04b070 con 0x7f02f40b31d0 2024-04-14T09:58:56.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.742+0000 7f02ebfff640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 0x7f02d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.742+0000 7f02ebfff640 1 -- 172.21.15.40:0/3329247062 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02ec0addc0 con 0x7f02f40b31d0 2024-04-14T09:58:56.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.742+0000 7f02f27fc640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 0x7f02d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.742+0000 7f02f27fc640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 0x7f02d406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f02f4158f40 tx=0x7f02dc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.742+0000 7f02fc617740 1 Processor -- start 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 -- start start 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x556612085b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x5566120b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x556611fef030 con 0x556612086040 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556611f97620 con 0x5566120b2b60 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x556611feafe0 con 0x5566120b2f40 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.743+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x556612085b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45556/0 (socket says 172.21.15.40:45556) 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 -- 172.21.15.40:0/2157476783 learned_addr learned my addr 172.21.15.40:0/2157476783 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.750 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f27fc640 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x5566120b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 -- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 msgr2=0x5566120b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x5566120b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 -- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 msgr2=0x556612085b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x556612085b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 -- 172.21.15.40:0/2157476783 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556611d032d0 con 0x556612086040 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x556612085b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02f37fe640 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f02e4011420 tx=0x7f02e4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63898bc3a8491f5b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02e97fa640 1 -- 172.21.15.40:0/2157476783 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4015840 con 0x556612086040 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02e97fa640 1 -- 172.21.15.40:0/2157476783 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e40159e0 con 0x556612086040 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.744+0000 7f02e97fa640 1 -- 172.21.15.40:0/2157476783 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4015d90 con 0x556612086040 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- 172.21.15.40:0/2157476783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 msgr2=0x5566120b5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f02e4011420 tx=0x7f02e4009750 comp rx=0 tx=0).stop 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- 172.21.15.40:0/2157476783 shutdown_connections 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x556612086040 0x5566120b5e30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x5566120b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 --2- 172.21.15.40:0/2157476783 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x556612085b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- 172.21.15.40:0/2157476783 >> 172.21.15.40:0/2157476783 conn(0x556612087d70 msgr2=0x5566120d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- 172.21.15.40:0/2157476783 shutdown_connections 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- 172.21.15.40:0/2157476783 wait complete. 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.745+0000 7f02fc617740 1 -- start start 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 Processor -- start 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2b60 0x5566120b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2f40 0x5566120d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x55661208a410 con 0x5566120afa90 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x556611faa9e0 con 0x5566120b2f40 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55661208cc50 con 0x5566120b2b60 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02fc617740 10 client.0 _ll_register_callbacks cb 0x556611fe7080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02f27fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2f40 0x5566120d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45562/0 (socket says 172.21.15.40:45562) 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02f37fe640 1 -- 172.21.15.40:0/983078364 learned_addr learned my addr 172.21.15.40:0/983078364 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.746+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2b60 0x5566120b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 -- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2b60 msgr2=0x5566120b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2b60 0x5566120b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 -- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2f40 msgr2=0x5566120d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2f40 0x5566120d0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 -- 172.21.15.40:0/983078364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556611dcd6b0 con 0x5566120afa90 2024-04-14T09:58:56.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02f37fe640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02e4019000 tx=0x7f02e4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8eb39d0b29828d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4003990 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02e4003b30 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e40159e0 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f02e4003d30 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 10 client.4818 fetch_fsmap learned FSMap version 9 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5566120b5260 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e40159e0 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f02e402f050 con 0x5566120afa90 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 10 client.4818 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:58:56.754 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 20 client.4818 populate_metadata read hostname 'smithi040' 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x5566120b89c0 0x5566120efa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 4 client.4818 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.747+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 --> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556611f96cc0 con 0x5566120b89c0 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.748+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x5566120b89c0 0x5566120efa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.748+0000 7f02d27fc640 10 client.4818 ms_handle_connect on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.748+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x5566120b89c0 0x5566120efa40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eac82345c7ea858d server_cookie=a4c9657d3129035a in_seq=0 out_seq=0 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02d27fc640 1 -- 172.21.15.40:0/983078364 <== mds.0 v2:172.21.15.136:6834/994538529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556611f96cc0 con 0x5566120b89c0 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02d27fc640 10 client.4818 handle_command_reply: tid=0 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 client.4818 shutdown 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 msgr2=0x5566120aff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02e4019000 tx=0x7f02e4004ab0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 shutdown_connections 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120aff10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x5566120b89c0 0x5566120efa40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2f40 0x5566120d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 --2- 172.21.15.40:0/983078364 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2b60 0x5566120b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 >> 172.21.15.40:0/983078364 conn(0x556612086040 msgr2=0x5566120d3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02d27fc640 0 client.4818 ms_handle_reset on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 shutdown_connections 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 1 -- 172.21.15.40:0/983078364 wait complete. 2024-04-14T09:58:56.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.749+0000 7f02fc617740 20 client.4818 trim_cache size 0 max 16384 2024-04-14T09:58:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.767+0000 7f02fc617740 1 Processor -- start 2024-04-14T09:58:56.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.767+0000 7f02fc617740 1 -- start start 2024-04-14T09:58:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120afa90 0x5566120b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120d3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.769 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4202040 con 0x5566120b2f40 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4201060 con 0x5566120b2b60 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f02f4200460 con 0x5566120afa90 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45564/0 (socket says 172.21.15.40:45564) 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 -- 172.21.15.40:0/847636805 learned_addr learned my addr 172.21.15.40:0/847636805 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f27fc640 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120d3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120afa90 0x5566120b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 -- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120afa90 msgr2=0x5566120b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120afa90 0x5566120b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 -- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 msgr2=0x5566120d3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120d3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.768+0000 7f02f37fe640 1 -- 172.21.15.40:0/847636805 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556611ff14d0 con 0x5566120b2f40 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02f37fe640 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009820 tx=0x7f02e4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0958f6ed3be4e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02e8ff9640 1 -- 172.21.15.40:0/847636805 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4015950 con 0x5566120b2f40 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02e8ff9640 1 -- 172.21.15.40:0/847636805 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e4036070 con 0x5566120b2f40 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02e8ff9640 1 -- 172.21.15.40:0/847636805 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4015af0 con 0x5566120b2f40 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 -- 172.21.15.40:0/847636805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 msgr2=0x5566120d4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009820 tx=0x7f02e4022000 comp rx=0 tx=0).stop 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 -- 172.21.15.40:0/847636805 shutdown_connections 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120b2f40 0x5566120d4000 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120d3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 --2- 172.21.15.40:0/847636805 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120afa90 0x5566120b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 -- 172.21.15.40:0/847636805 >> 172.21.15.40:0/847636805 conn(0x556612086040 msgr2=0x5566120bbe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.771 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 -- 172.21.15.40:0/847636805 shutdown_connections 2024-04-14T09:58:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.769+0000 7f02fc617740 1 -- 172.21.15.40:0/847636805 wait complete. 2024-04-14T09:58:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.770+0000 7f02fc617740 1 -- start start 2024-04-14T09:58:56.772 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.770+0000 7f02fc617740 1 Processor -- start 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120b3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x55661208a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5566120b04a0 con 0x5566120afa90 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4200a10 con 0x5566120b2b60 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x5566120bb7b0 con 0x5566120b2f40 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 10 client.0 _ll_register_callbacks cb 0x7f02dc007cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45568/0 (socket says 172.21.15.40:45568) 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1572224678 learned_addr learned my addr 172.21.15.40:0/1572224678 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f27fc640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f37fe640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x55661208a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 msgr2=0x55661208a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x55661208a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 msgr2=0x5566120b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 -- 172.21.15.40:0/1572224678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566120aa750 con 0x5566120afa90 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02f2ffd640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02ec07b880 tx=0x7f02ec082040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79458c5224ea8bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02d27fc640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec098030 con 0x5566120afa90 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f02ec0820b0 con 0x5566120afa90 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.771+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02e4036070 con 0x5566120afa90 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f02ec0a2050 con 0x5566120afa90 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 10 client.4824 fetch_fsmap learned FSMap version 9 2024-04-14T09:58:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x5566120cf050 con 0x5566120afa90 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e4036070 con 0x5566120afa90 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f02ec0a5020 con 0x5566120afa90 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 10 client.4824 fetch_fsmap finished waiting for FSMap version 9 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 10 client.4824 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 20 client.4824 populate_metadata read hostname 'smithi040' 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55661208aef0 0x5566120ae300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 4 client.4824 mds_command: new command op to 4297 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 --> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] -- command(tid 0: {"prefix": "status"}) -- 0x556611ffc570 con 0x55661208aef0 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02f27fc640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55661208aef0 0x5566120ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02d27fc640 10 client.4824 ms_handle_connect on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.772+0000 7f02f27fc640 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55661208aef0 0x5566120ae300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a59770a3dc6cf0ce server_cookie=2aa438ee5c9b2f7b in_seq=0 out_seq=0 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02d27fc640 1 -- 172.21.15.40:0/1572224678 <== mds.0 v2:172.21.15.136:6834/994538529 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x556611ffc570 con 0x55661208aef0 2024-04-14T09:58:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02d27fc640 10 client.4824 handle_command_reply: tid=0 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 client.4824 shutdown 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 msgr2=0x5566120b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f02ec07b880 tx=0x7f02ec082040 comp rx=0 tx=0).stop 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 shutdown_connections 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x5566120b2f40 0x55661208a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:6834/994538529,v1:172.21.15.136:6835/994538529] conn(0x55661208aef0 0x5566120ae300 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5566120b2b60 0x5566120b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 --2- 172.21.15.40:0/1572224678 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x5566120afa90 0x5566120b33e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02d27fc640 0 client.4824 ms_handle_reset on v2:172.21.15.136:6834/994538529 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 >> 172.21.15.40:0/1572224678 conn(0x556612086040 msgr2=0x5566120d3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 shutdown_connections 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 1 -- 172.21.15.40:0/1572224678 wait complete. 2024-04-14T09:58:56.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02fc617740 20 client.4824 trim_cache size 0 max 16384 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "131eb2ba-6185-454c-b8ac-0bdd05152d4d", 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 4297, 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 33.383236035000003, 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 9, 2024-04-14T09:58:56.780 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 25, 2024-04-14T09:58:56.781 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 25, 2024-04-14T09:58:56.781 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 40.410531153999997 2024-04-14T09:58:56.781 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:58:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 msgr2=0x7f02d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 0x7f02d406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f02f4158f40 tx=0x7f02dc009040 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 msgr2=0x7f02f40aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f02ec000c00 tx=0x7f02ec004730 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 shutdown_connections 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f02d406c8f0 0x7f02d406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f02f41600a0 0x7f02f41f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02f4147860 0x7f02f4159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 --2- 172.21.15.40:0/3329247062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f02f40b31d0 0x7f02f40aee80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.773+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 >> 172.21.15.40:0/3329247062 conn(0x7f02f40b56f0 msgr2=0x7f02f4161950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.774+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 shutdown_connections 2024-04-14T09:58:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:56.774+0000 7f02f982d640 1 -- 172.21.15.40:0/3329247062 wait complete. 2024-04-14T09:58:56.784 INFO:teuthology.run_tasks:Running task sequential... 2024-04-14T09:58:56.793 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-14T09:58:56.793 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-14T09:58:56.794 INFO:teuthology.task.print:Enabling mgr modules 2024-04-14T09:58:56.794 INFO:teuthology.run_tasks:Running task kclient... 2024-04-14T09:58:56.810 INFO:tasks.kclient:Mounting kernel clients... 2024-04-14T09:58:56.810 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-14T09:58:56.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:56.811 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:58:56.826 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-14T09:58:56.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:56.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-14T09:58:56.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:56.894 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-14T09:58:56.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:56.999 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:58:57.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-14T09:58:57.082 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-14T09:58:57.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:58:57.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.083 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:58:57.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-04-14T09:58:57.168 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-04-14T09:58:57.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:58:57.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.170 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:58:57.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-04-14T09:58:57.293 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-04-14T09:58:57.294 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:58:57.295 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-14T09:58:57.295 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T09:58:57.295 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T09:58:57.295 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:58:57.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.398+0000 7fa890a36640 1 Processor -- start 2024-04-14T09:58:57.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.398+0000 7fa890a36640 1 -- start start 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa890a36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa88c0b4c20 0x7fa88c142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa890a36640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa88c0b5400 con 0x7fa88c0b1bc0 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa890a36640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa88c0b5120 con 0x7fa88c0b3b40 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa890a36640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa88c0b3060 con 0x7fa88c0b4c20 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88ad9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa88c0b4c20 0x7fa88c142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:57.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa88c0b1bc0 0x7fa88c0b1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56344/0 (socket says 172.21.15.40:56344) 2024-04-14T09:58:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88a59c640 1 -- 172.21.15.40:0/2779837614 learned_addr learned my addr 172.21.15.40:0/2779837614 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88ad9d640 1 -- 172.21.15.40:0/2779837614 >> v1:172.21.15.136:6789/0 conn(0x7fa88c0b3b40 legacy=0x7fa88c0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88ad9d640 1 -- 172.21.15.40:0/2779837614 >> v1:172.21.15.40:6789/0 conn(0x7fa88c0b1bc0 legacy=0x7fa88c0b1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88959a640 1 -- 172.21.15.40:0/2779837614 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183753975 0 0) 0x7fa88c0b5400 con 0x7fa88c0b1bc0 2024-04-14T09:58:57.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.399+0000 7fa88ad9d640 1 -- 172.21.15.40:0/2779837614 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c0b3340 con 0x7fa88c0b4c20 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.400+0000 7fa88ad9d640 1 --2- 172.21.15.40:0/2779837614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c142fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2611ba40936f827e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.400+0000 7fa88959a640 1 -- 172.21.15.40:0/2779837614 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c039070 con 0x7fa88c0b4c20 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.400+0000 7fa88959a640 1 -- 172.21.15.40:0/2779837614 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87c02cc60 con 0x7fa88c0b4c20 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.400+0000 7fa88959a640 1 -- 172.21.15.40:0/2779837614 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c034660 con 0x7fa88c0b4c20 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 -- 172.21.15.40:0/2779837614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 msgr2=0x7fa88c142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 --2- 172.21.15.40:0/2779837614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c142fb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c02beb0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 -- 172.21.15.40:0/2779837614 shutdown_connections 2024-04-14T09:58:57.401 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 --2- 172.21.15.40:0/2779837614 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c142fb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 -- 172.21.15.40:0/2779837614 >> 172.21.15.40:0/2779837614 conn(0x7fa88c06ebf0 msgr2=0x7fa88c06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 -- 172.21.15.40:0/2779837614 shutdown_connections 2024-04-14T09:58:57.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.401+0000 7fa890a36640 1 -- 172.21.15.40:0/2779837614 wait complete. 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.402+0000 7fa890a36640 1 Processor -- start 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.402+0000 7fa890a36640 1 -- start start 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa88c0b1bc0 0x7fa88c13f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 0x7fa88c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c142c80 con 0x7fa88c0b4c20 2024-04-14T09:58:57.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa88c142b00 con 0x7fa88c0b3b40 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa890a36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa88c1434f0 con 0x7fa88c0b1bc0 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45582/0 (socket says 172.21.15.40:45582) 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 -- 172.21.15.40:0/3001898455 learned_addr learned my addr 172.21.15.40:0/3001898455 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88a59c640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa88c0b1bc0 0x7fa88c13f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa889d9b640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 0x7fa88c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 -- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa88c0b1bc0 msgr2=0x7fa88c13f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa88c0b1bc0 0x7fa88c13f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 -- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 msgr2=0x7fa88c15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 0x7fa88c15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa88ad9d640 1 -- 172.21.15.40:0/3001898455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa88c13e6d0 con 0x7fa88c0b4c20 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.403+0000 7fa889d9b640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 0x7fa88c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:58:57.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa88ad9d640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c039050 con 0x7fa88c0b4c20 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87c045070 con 0x7fa88c0b4c20 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa88c13e9b0 con 0x7fa88c0b4c20 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c03e830 con 0x7fa88c0b4c20 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.404+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa88c13ef70 con 0x7fa88c0b4c20 2024-04-14T09:58:57.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.405+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88c142100 con 0x7fa88c0b4c20 2024-04-14T09:58:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.405+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa87c03e9d0 con 0x7fa88c0b4c20 2024-04-14T09:58:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.406+0000 7fa882ffd640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 0x7fa86c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.406+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa87c0aeb50 con 0x7fa88c0b4c20 2024-04-14T09:58:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.406+0000 7fa88a59c640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 0x7fa86c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:57.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.406+0000 7fa88a59c640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 0x7fa86c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa884007f70 tx=0x7fa884007f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:57.409 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.410+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa88c142100 con 0x7fa88c0b4c20 2024-04-14T09:58:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.633+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa88c0756f0 con 0x7fa88c0b4c20 2024-04-14T09:58:57.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.633+0000 7fa882ffd640 1 -- 172.21.15.40:0/3001898455 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa87c07cdf0 con 0x7fa88c0b4c20 2024-04-14T09:58:57.633 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T09:58:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 msgr2=0x7fa86c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 0x7fa86c06edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa884007f70 tx=0x7fa884007f00 comp rx=0 tx=0).stop 2024-04-14T09:58:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 msgr2=0x7fa88c13d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:57.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa87c009d90 tx=0x7fa87c004a40 comp rx=0 tx=0).stop 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 shutdown_connections 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa86c06c8f0 0x7fa86c06edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa88c0b4c20 0x7fa88c13d580 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa88c0b3b40 0x7fa88c15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 --2- 172.21.15.40:0/3001898455 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa88c0b1bc0 0x7fa88c13f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.635+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 >> 172.21.15.40:0/3001898455 conn(0x7fa88c06ebf0 msgr2=0x7fa88c0cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.636+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 shutdown_connections 2024-04-14T09:58:57.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57.636+0000 7fa890a36640 1 -- 172.21.15.40:0/3001898455 wait complete. 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:58:57.646 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T09:58:57.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.647 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-14T09:58:57.661 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:58:57.661 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:58:57.661 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:58:57.661 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-14T09:58:57.662 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42653sec preferred_lft 42653sec 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:57.663 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-14T09:58:57.663 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T09:58:57.663 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:57.663 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:57.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add name ceph-brx type bridge 2024-04-14T09:58:57.663 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr flush dev ceph-brx 2024-04-14T09:58:57.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set ceph-brx up 2024-04-14T09:58:57.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T09:58:57.664 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:57.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:57.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.809 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:58:57.834 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-14T09:58:57.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:57.836 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-14T09:58:57.891 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-14T09:58:57.891 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:58:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T09:58:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T09:58:57.892 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:58:57.892 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:57.892 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:57.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T09:58:57.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T09:58:57.892 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T09:58:57.893 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:57.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:57 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:58.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:58.026 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:58:58.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:58.040 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-14T09:58:58.094 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:58.094 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:58.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T09:58:58.094 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-14T09:58:58.095 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:58.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:58.209 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.215 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-14T09:58:58.215 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-14T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:58.263 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:58.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.342 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:58.342 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:58.342 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-14T09:58:58.343 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T09:58:58.343 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:58.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:58.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.425 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:58:58.425 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T09:58:58.440 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T09:58:58.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:58:58.440 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T09:58:58.495 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-14T09:58:58.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:58.496 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:58:58.581 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:58:58.582 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@131eb2ba-6185-454c-b8ac-0bdd05152d4d.cephfs=/ 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-04-14T09:58:58.706 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T09:58:58.707 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-04-14T09:58:58.707 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T09:58:58.707 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T09:58:58.707 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T09:58:58.708 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T09:58:58.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:58.708 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T09:58:58.735 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:58:58.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:58:58.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.831 INFO:teuthology.orchestra.run.smithi040.stdout:client4655 2024-04-14T09:58:58.831 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:58:58.831 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:58:58.846 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:58:58.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:58:58.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:58.942 INFO:teuthology.orchestra.run.smithi040.stdout:client4655 2024-04-14T09:58:58.942 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:58:59.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:58:59.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:59.012 INFO:teuthology.orchestra.run.smithi040.stdout:client4655 2024-04-14T09:58:59.013 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/131eb2ba-6185-454c-b8ac-0bdd05152d4d.client4655/status') 2024-04-14T09:58:59.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:59.074 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4655 (3)172.21.15.40:0/1715817024 2024-04-14T09:58:59.074 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-04-14T09:58:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-04-14T09:58:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-04-14T09:58:59.074 INFO:teuthology.orchestra.run.smithi040.stderr:70 bytes copied, 2.2475e-05 s, 3.1 MB/s 2024-04-14T09:58:59.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:59.081 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-04-14T09:58:59.081 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T09:58:59.081 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-14T09:58:59.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:58:59.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.183+0000 7f34881e0640 1 Processor -- start 2024-04-14T09:58:59.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.183+0000 7f34881e0640 1 -- start start 2024-04-14T09:58:59.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f34881e0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 0x7f348009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f34881e0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 0x7f3480168350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f34881e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348006c760 con 0x7f348015e370 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f34881e0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f348009b3d0 con 0x7f348006d800 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f34881e0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f348006d370 con 0x7f348009af80 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f3485f7c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f348015e370 0x7f34800d0db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56346/0 (socket says 172.21.15.40:56346) 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f3485f7c640 1 -- 172.21.15.40:0/808192203 learned_addr learned my addr 172.21.15.40:0/808192203 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f348577b640 1 --2- 172.21.15.40:0/808192203 >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 0x7f348009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.184+0000 7f348677d640 1 --2- 172.21.15.40:0/808192203 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 0x7f3480168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f3484f7a640 1 -- 172.21.15.40:0/808192203 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692104467 0 0) 0x7f348006c760 con 0x7f348015e370 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f3484f7a640 1 -- 172.21.15.40:0/808192203 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f346c003520 con 0x7f348015e370 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f348677d640 1 -- 172.21.15.40:0/808192203 >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 msgr2=0x7f348009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:58:59.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f348677d640 1 --2- 172.21.15.40:0/808192203 >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 0x7f348009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f348677d640 1 -- 172.21.15.40:0/808192203 >> v1:172.21.15.40:6789/0 conn(0x7f348015e370 legacy=0x7f34800d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f348677d640 1 -- 172.21.15.40:0/808192203 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348006ca40 con 0x7f348009af80 2024-04-14T09:58:59.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.185+0000 7f348577b640 1 --2- 172.21.15.40:0/808192203 >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 0x7f348009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:58:59.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.186+0000 7f348677d640 1 --2- 172.21.15.40:0/808192203 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 0x7f3480168350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3478009d90 tx=0x7f347802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6818ea50d7579af server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.186+0000 7f3484f7a640 1 -- 172.21.15.40:0/808192203 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478039070 con 0x7f348009af80 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.186+0000 7f3484f7a640 1 -- 172.21.15.40:0/808192203 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347802cc50 con 0x7f348009af80 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.186+0000 7f3484f7a640 1 -- 172.21.15.40:0/808192203 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3478034440 con 0x7f348009af80 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 -- 172.21.15.40:0/808192203 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 msgr2=0x7f3480168350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 --2- 172.21.15.40:0/808192203 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 0x7f3480168350 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3478009d90 tx=0x7f347802bea0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 -- 172.21.15.40:0/808192203 shutdown_connections 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 --2- 172.21.15.40:0/808192203 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348009af80 0x7f3480168350 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 --2- 172.21.15.40:0/808192203 >> v2:172.21.15.136:3300/0 conn(0x7f348006d800 0x7f348009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 -- 172.21.15.40:0/808192203 >> 172.21.15.40:0/808192203 conn(0x7f34800b3ba0 msgr2=0x7f34800b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 -- 172.21.15.40:0/808192203 shutdown_connections 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.187+0000 7f34881e0640 1 -- 172.21.15.40:0/808192203 wait complete. 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.188+0000 7f34881e0640 1 Processor -- start 2024-04-14T09:58:59.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.188+0000 7f34881e0640 1 -- start start 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348006d800 0x7f34801534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348015e370 0x7f34800b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f34800d14c0 con 0x7f348009af80 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f348006d000 con 0x7f348015e370 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f34881e0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f34800d1640 con 0x7f348006d800 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45586/0 (socket says 172.21.15.40:45586) 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 -- 172.21.15.40:0/2979151413 learned_addr learned my addr 172.21.15.40:0/2979151413 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f3485f7c640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348006d800 0x7f34801534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348677d640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348015e370 0x7f34800b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 -- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348006d800 msgr2=0x7f34801534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348006d800 0x7f34801534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 -- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348015e370 msgr2=0x7f34800b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348015e370 0x7f34800b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 -- 172.21.15.40:0/2979151413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34800b6680 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.189+0000 7f348577b640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e960 tx=0x7f347c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.190+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c017070 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.190+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f347c00ca00 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.190+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34800b6960 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.190+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c00cdd0 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.190+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34800b6f20 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.191+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34800cfbd0 con 0x7f348009af80 2024-04-14T09:58:59.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.191+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f347c01a070 con 0x7f348009af80 2024-04-14T09:58:59.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.192+0000 7f34767fc640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 0x7f346406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:58:59.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.192+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f347c08c0f0 con 0x7f348009af80 2024-04-14T09:58:59.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.192+0000 7f3485f7c640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 0x7f346406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:58:59.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.192+0000 7f3485f7c640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 0x7f346406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3470005880 tx=0x7f3470009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:58:59.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.196+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f34800cfbd0 con 0x7f348009af80 2024-04-14T09:58:59.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.419+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f34800756f0 con 0x7f348009af80 2024-04-14T09:58:59.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.419+0000 7f34767fc640 1 -- 172.21.15.40:0/2979151413 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f347c059af0 con 0x7f348009af80 2024-04-14T09:58:59.419 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T09:58:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 msgr2=0x7f346406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 0x7f346406edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3470005880 tx=0x7f3470009040 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 msgr2=0x7f34800c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f347c00e960 tx=0x7f347c00ee20 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 shutdown_connections 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f346406c8f0 0x7f346406edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348015e370 0x7f34800b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f348009af80 0x7f34800c88d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 --2- 172.21.15.40:0/2979151413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348006d800 0x7f34801534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 >> 172.21.15.40:0/2979151413 conn(0x7f34800b3ba0 msgr2=0x7f348006f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 shutdown_connections 2024-04-14T09:58:59.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59.422+0000 7f34881e0640 1 -- 172.21.15.40:0/2979151413 wait complete. 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:58:59.433 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-14T09:58:59.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.434 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-14T09:58:59.448 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:58:59.448 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:58:59.448 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-14T09:58:59.449 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42651sec preferred_lft 42651sec 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0a:1e:c4:40:9a:89 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.450 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::b4b2:99ff:fea2:3b81/64 scope link 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0a:1e:c4:40:9a:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::81e:c4ff:fe40:9a89/64 scope link tentative 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.451 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:58:59.514 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-14T09:58:59.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.515 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-14T09:58:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-14T09:58:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:58:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T09:58:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T09:58:59.571 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:58:59.571 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:59.571 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:59.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T09:58:59.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T09:58:59.572 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T09:58:59.572 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:59.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:59.702 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:59.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.708 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:58:59.722 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T09:58:59.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.723 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list-id 2024-04-14T09:58:59.777 INFO:teuthology.orchestra.run.smithi040.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-14T09:58:59.777 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:59.777 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:59.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T09:58:59.777 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-14T09:58:59.778 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:58:59.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:58:59.892 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:58:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:58:59.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.898 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 7e:73:6b:3f:85:9d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T09:58:59.925 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T09:58:59.926 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.926 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::7c73:6bff:fe3f:859d/64 scope link tentative 2024-04-14T09:58:59.926 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:58:59.927 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 7e:73:6b:3f:85:9d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.994 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::7c73:6bff:fe3f:859d/64 scope link tentative 2024-04-14T09:58:59.995 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:58:59.996 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-14T09:58:59.996 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:59:00.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:00.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.159 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:00.159 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:59:00.159 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.1 up 2024-04-14T09:59:00.160 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set dev brx.1 master ceph-brx 2024-04-14T09:59:00.160 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:59:00.207 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:00.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:00.241 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-14T09:59:00.256 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-14T09:59:00.256 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:00.256 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-14T09:59:00.311 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-04-14T09:59:00.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:00.311 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:00.395 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:00.396 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 2@131eb2ba-6185-454c-b8ac-0bdd05152d4d.cephfs=/ 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.40:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-04-14T09:59:00.403 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-04-14T09:59:00.404 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T09:59:00.404 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T09:59:00.404 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T09:59:00.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T09:59:00.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:00.405 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-14T09:59:00.432 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:00.520 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:00.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.528 INFO:teuthology.orchestra.run.smithi040.stdout:client4664 2024-04-14T09:59:00.528 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:00.528 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:00.543 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:00.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:00.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.639 INFO:teuthology.orchestra.run.smithi040.stdout:client4664 2024-04-14T09:59:00.639 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:00.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:00.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.694 INFO:teuthology.orchestra.run.smithi040.stdout:client4664 2024-04-14T09:59:00.694 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/131eb2ba-6185-454c-b8ac-0bdd05152d4d.client4664/status') 2024-04-14T09:59:00.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:00.754 INFO:teuthology.orchestra.run.smithi040.stdout:instance: client.4664 (3)172.21.15.40:0/4111198199 2024-04-14T09:59:00.754 INFO:teuthology.orchestra.run.smithi040.stdout:blocklisted: false 2024-04-14T09:59:00.754 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records in 2024-04-14T09:59:00.754 INFO:teuthology.orchestra.run.smithi040.stderr:0+1 records out 2024-04-14T09:59:00.755 INFO:teuthology.orchestra.run.smithi040.stderr:70 bytes copied, 2.119e-05 s, 3.3 MB/s 2024-04-14T09:59:00.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:00.761 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-04-14T09:59:00.761 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T09:59:00.761 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-14T09:59:00.761 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:59:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.862+0000 7f04dbc0f640 1 Processor -- start 2024-04-14T09:59:00.863 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.862+0000 7f04dbc0f640 1 -- start start 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04dbc0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04dbc0f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04d40b4760 0x7f04d40d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04dbc0f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d40b4c70 con 0x7f04d40d2cb0 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04dbc0f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f04d40b5880 con 0x7f04d40b4760 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04dbc0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f04d40b4f50 con 0x7f04d415e650 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d91aa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f04d40b4760 0x7f04d40d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04da1ac640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f04d40d2cb0 0x7f04d41622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56350/0 (socket says 172.21.15.40:56350) 2024-04-14T09:59:00.865 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04da1ac640 1 -- 172.21.15.40:0/1473705297 learned_addr learned my addr 172.21.15.40:0/1473705297 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d99ab640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d89a9640 1 -- 172.21.15.40:0/1473705297 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615623283 0 0) 0x7f04d40b4c70 con 0x7f04d40d2cb0 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d89a9640 1 -- 172.21.15.40:0/1473705297 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04bc003520 con 0x7f04d40d2cb0 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d91aa640 1 -- 172.21.15.40:0/1473705297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 msgr2=0x7f04d40b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d91aa640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d91aa640 1 -- 172.21.15.40:0/1473705297 >> v1:172.21.15.40:6789/0 conn(0x7f04d40d2cb0 legacy=0x7f04d41622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.863+0000 7f04d91aa640 1 -- 172.21.15.40:0/1473705297 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d40b5230 con 0x7f04d40b4760 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.864+0000 7f04d91aa640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40b4760 0x7f04d40d2770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af518b2c67ccc163 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.864+0000 7f04d89a9640 1 -- 172.21.15.40:0/1473705297 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8035020 con 0x7f04d40b4760 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.864+0000 7f04d89a9640 1 -- 172.21.15.40:0/1473705297 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c8031830 con 0x7f04d40b4760 2024-04-14T09:59:00.866 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.864+0000 7f04d89a9640 1 -- 172.21.15.40:0/1473705297 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8031c00 con 0x7f04d40b4760 2024-04-14T09:59:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 -- 172.21.15.40:0/1473705297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40b4760 msgr2=0x7f04d40d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40b4760 0x7f04d40d2770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 -- 172.21.15.40:0/1473705297 shutdown_connections 2024-04-14T09:59:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40b4760 0x7f04d40d2770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/1473705297 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 -- 172.21.15.40:0/1473705297 >> 172.21.15.40:0/1473705297 conn(0x7f04d409d580 msgr2=0x7f04d40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 -- 172.21.15.40:0/1473705297 shutdown_connections 2024-04-14T09:59:00.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.865+0000 7f04dbc0f640 1 -- 172.21.15.40:0/1473705297 wait complete. 2024-04-14T09:59:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.866+0000 7f04dbc0f640 1 Processor -- start 2024-04-14T09:59:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.866+0000 7f04dbc0f640 1 -- start start 2024-04-14T09:59:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d40b4760 0x7f04d4157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f04d415ea30 con 0x7f04d40d2cb0 2024-04-14T09:59:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40d2270 con 0x7f04d40b4760 2024-04-14T09:59:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04dbc0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f04d415ebb0 con 0x7f04d415e650 2024-04-14T09:59:00.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45610/0 (socket says 172.21.15.40:45610) 2024-04-14T09:59:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 -- 172.21.15.40:0/2537762236 learned_addr learned my addr 172.21.15.40:0/2537762236 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d99ab640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d40b4760 0x7f04d4157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04da1ac640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 -- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 msgr2=0x7f04d40cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 -- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d40b4760 msgr2=0x7f04d4157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d40b4760 0x7f04d4157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 -- 172.21.15.40:0/2537762236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d40cac60 con 0x7f04d40d2cb0 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.867+0000 7f04d91aa640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.868+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c803a8f0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.868+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c803aa90 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.868+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d40b6ff0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.868+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c80443f0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.868+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d40b75b0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.869+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d40756f0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.869+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04c804b060 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.869+0000 7f04d27fc640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 0x7f04c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.869+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f04c80ad7e0 con 0x7f04d40d2cb0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.870+0000 7f04d99ab640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 0x7f04c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:00.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.870+0000 7f04d99ab640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 0x7f04c006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009b40 tx=0x7f04cc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:00.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:00.874+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f04c803f070 con 0x7f04d40d2cb0 2024-04-14T09:59:01.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.101+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f04d40c7520 con 0x7f04d40d2cb0 2024-04-14T09:59:01.101 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.101+0000 7f04d27fc640 1 -- 172.21.15.40:0/2537762236 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f04c807b280 con 0x7f04d40d2cb0 2024-04-14T09:59:01.102 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 msgr2=0x7f04c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 0x7f04c006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009b40 tx=0x7f04cc009190 comp rx=0 tx=0).stop 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 msgr2=0x7f04d40ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f04c80097a0 tx=0x7f04c80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 shutdown_connections 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f04c006c8f0 0x7f04c006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:01.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415e650 0x7f04d40cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:01.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f04d40d2cb0 0x7f04d40ca720 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:01.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 --2- 172.21.15.40:0/2537762236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d40b4760 0x7f04d4157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:01.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 >> 172.21.15.40:0/2537762236 conn(0x7f04d409d580 msgr2=0x7f04d40d0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:01.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 shutdown_connections 2024-04-14T09:59:01.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:01.103+0000 7f04dbc0f640 1 -- 172.21.15.40:0/2537762236 wait complete. 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:59:01.114 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-14T09:59:01.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:01.115 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:01.130 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42638sec preferred_lft 42638sec 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-04-14T09:59:01.131 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:01.131 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-14T09:59:01.131 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-14T09:59:01.132 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:01.218 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:01.324 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:01.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:01.331 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:59:01.356 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-04-14T09:59:01.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:01.358 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-04-14T09:59:01.431 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-04-14T09:59:01.431 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:59:01.432 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T09:59:01.432 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T09:59:01.432 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T09:59:01.432 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:01.519 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:01.715 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:01.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:01.721 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:59:01.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:01.736 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-04-14T09:59:01.791 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:01.791 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:01.791 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T09:59:01.791 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-14T09:59:01.791 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:01.882 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:01.913 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:01.922 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-14T09:59:01.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-14T09:59:01.923 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-14T09:59:01.923 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:01.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:02.065 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.071 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:02.071 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:02.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-04-14T09:59:02.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-04-14T09:59:02.071 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:02.120 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:02.151 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.157 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:02.157 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-14T09:59:02.171 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-14T09:59:02.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:02.172 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-14T09:59:02.226 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-04-14T09:59:02.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:02.226 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:02.314 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:02.315 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:02.429 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:02.429 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:02.429 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-04-14T09:59:02.430 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 1@131eb2ba-6185-454c-b8ac-0bdd05152d4d.cephfs=/ 2024-04-14T09:59:02.430 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.40:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-04-14T09:59:02.431 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-14T09:59:02.431 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-04-14T09:59:02.431 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T09:59:02.431 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T09:59:02.431 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T09:59:02.433 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T09:59:02.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:02.433 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-14T09:59:02.459 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:02.548 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:02.549 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.555 INFO:teuthology.orchestra.run.smithi136.stdout:client4673 2024-04-14T09:59:02.555 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:02.555 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:02.571 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:02.677 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:02.679 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.684 INFO:teuthology.orchestra.run.smithi136.stdout:client4673 2024-04-14T09:59:02.685 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:02.733 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:02.734 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.740 INFO:teuthology.orchestra.run.smithi136.stdout:client4673 2024-04-14T09:59:02.741 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/131eb2ba-6185-454c-b8ac-0bdd05152d4d.client4673/status') 2024-04-14T09:59:02.788 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:02.800 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4673 (3)192.168.0.1:0/4211076165 2024-04-14T09:59:02.801 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-04-14T09:59:02.801 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-04-14T09:59:02.801 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-04-14T09:59:02.801 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 2.1914e-05 s, 3.1 MB/s 2024-04-14T09:59:02.802 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:02.808 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-04-14T09:59:02.808 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-14T09:59:02.808 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-14T09:59:02.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:59:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.922+0000 7f90edd5e640 1 Processor -- start 2024-04-14T09:59:02.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.922+0000 7f90edd5e640 1 -- start start 2024-04-14T09:59:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90edd5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90e813deb0 0x7f90e80b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90edd5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 0x7f90e80ce890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90edd5e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e815faf0 con 0x7f90e80b2100 2024-04-14T09:59:02.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90edd5e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f90e815ed30 con 0x7f90e813deb0 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90edd5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90e815f010 con 0x7f90e815bfe0 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90e80b2100 0x7f90e815b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56362/0 (socket says 172.21.15.40:56362) 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e6ffd640 1 -- 172.21.15.40:0/1637329059 learned_addr learned my addr 172.21.15.40:0/1637329059 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e7fff640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 0x7f90e80ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1637329059 >> v2:172.21.15.136:3300/0 conn(0x7f90e813deb0 0x7f90e80b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862381894 0 0) 0x7f90e815faf0 con 0x7f90e80b2100 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.923+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d0003520 con 0x7f90e80b2100 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1254215276 0 0) 0x7f90d0003520 con 0x7f90e80b2100 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e77fe640 1 -- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 msgr2=0x7f90e80ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 0x7f90e80ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e77fe640 1 -- 172.21.15.40:0/1637329059 >> v1:172.21.15.40:6789/0 conn(0x7f90e80b2100 legacy=0x7f90e815b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e77fe640 1 -- 172.21.15.40:0/1637329059 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e815f2f0 con 0x7f90e813deb0 2024-04-14T09:59:02.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.924+0000 7f90e7fff640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 0x7f90e80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e813deb0 0x7f90e80b1bc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097a0 tx=0x7f90d802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=198ad3106c22d01f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8037070 con 0x7f90e813deb0 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d8030510 con 0x7f90e813deb0 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90e67fc640 1 -- 172.21.15.40:0/1637329059 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90dc001670 con 0x7f90e813deb0 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 -- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e813deb0 msgr2=0x7f90e80b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e813deb0 0x7f90e80b1bc0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097a0 tx=0x7f90d802b790 comp rx=0 tx=0).stop 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 -- 172.21.15.40:0/1637329059 shutdown_connections 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e815bfe0 0x7f90e80ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:02.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1637329059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e813deb0 0x7f90e80b1bc0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 -- 172.21.15.40:0/1637329059 >> 172.21.15.40:0/1637329059 conn(0x7f90e806ebf0 msgr2=0x7f90e806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 -- 172.21.15.40:0/1637329059 shutdown_connections 2024-04-14T09:59:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.925+0000 7f90edd5e640 1 -- 172.21.15.40:0/1637329059 wait complete. 2024-04-14T09:59:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.926+0000 7f90edd5e640 1 Processor -- start 2024-04-14T09:59:02.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 -- start start 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e80b2100 0x7f90e8139700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e813deb0 0x7f90e8152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90e813e410 con 0x7f90e815bfe0 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90e813e290 con 0x7f90e80b2100 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.927+0000 7f90edd5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90e80cedd0 con 0x7f90e813deb0 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45620/0 (socket says 172.21.15.40:45620) 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 -- 172.21.15.40:0/1784356490 learned_addr learned my addr 172.21.15.40:0/1784356490 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:02.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e6ffd640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e813deb0 0x7f90e8152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e80b2100 0x7f90e8139700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 -- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e813deb0 msgr2=0x7f90e8152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e813deb0 0x7f90e8152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 -- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e80b2100 msgr2=0x7f90e8139700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e80b2100 0x7f90e8139700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 -- 172.21.15.40:0/1784356490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e8139c40 con 0x7f90e815bfe0 2024-04-14T09:59:02.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90e7fff640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90e000efc0 tx=0x7f90e000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0018030 con 0x7f90e815bfe0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e000cdf0 con 0x7f90e815bfe0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e8153460 con 0x7f90e815bfe0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e0003bb0 con 0x7f90e815bfe0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.928+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e8153a20 con 0x7f90e815bfe0 2024-04-14T09:59:02.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.929+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e80756f0 con 0x7f90e815bfe0 2024-04-14T09:59:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.930+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90e0005d10 con 0x7f90e815bfe0 2024-04-14T09:59:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.930+0000 7f90cffff640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 0x7f90d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.930+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f90e008c700 con 0x7f90e815bfe0 2024-04-14T09:59:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.930+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 0x7f90d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:02.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.931+0000 7f90e77fe640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 0x7f90d406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d802f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:02.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:02.935+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f90e0022070 con 0x7f90e815bfe0 2024-04-14T09:59:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.158+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f90e8073560 con 0x7f90e815bfe0 2024-04-14T09:59:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.158+0000 7f90cffff640 1 -- 172.21.15.40:0/1784356490 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f90e8139c40 con 0x7f90e815bfe0 2024-04-14T09:59:03.159 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-14T09:59:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 msgr2=0x7f90d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 0x7f90d406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d802f000 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 msgr2=0x7f90e815d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90e000efc0 tx=0x7f90e000c490 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 shutdown_connections 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90d406c8f0 0x7f90d406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90e815bfe0 0x7f90e815d7c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90e813deb0 0x7f90e8152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 --2- 172.21.15.40:0/1784356490 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90e80b2100 0x7f90e8139700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 >> 172.21.15.40:0/1784356490 conn(0x7f90e806ebf0 msgr2=0x7f90e80b2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 shutdown_connections 2024-04-14T09:59:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:03.161+0000 7f90edd5e640 1 -- 172.21.15.40:0/1784356490 wait complete. 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-14T09:59:03.172 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:59:03.173 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-14T09:59:03.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.173 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-04-14T09:59:03.188 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42636sec preferred_lft 42636sec 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-04-14T09:59:03.189 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 4e:e3:09:7e:02:e5 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::fcfa:74ff:feb6:76e9/64 scope link tentative 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 4e:e3:09:7e:02:e5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::4ce3:9ff:fe7e:2e5/64 scope link tentative 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.191 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:59:03.254 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-04-14T09:59:03.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.257 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-04-14T09:59:03.313 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-04-14T09:59:03.314 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:59:03.314 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-14T09:59:03.314 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-14T09:59:03.314 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:59:03.314 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:03.314 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:03.314 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-14T09:59:03.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-14T09:59:03.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-14T09:59:03.315 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:03.403 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:03.446 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:03.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.452 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:59:03.467 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-14T09:59:03.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.468 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-04-14T09:59:03.523 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-14T09:59:03.524 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:03.524 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:03.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-14T09:59:03.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-14T09:59:03.524 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:03.612 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:03.640 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:03.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-14T09:59:03.676 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 9a:60:06:47:f1:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::9860:6ff:fe47:f1d2/64 scope link 2024-04-14T09:59:03.677 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:03.678 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-14T09:59:03.744 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 9a:60:06:47:f1:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::9860:6ff:fe47:f1d2/64 scope link 2024-04-14T09:59:03.745 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:03.746 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-14T09:59:03.747 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:03.834 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:03.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:03.911 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:03.911 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-04-14T09:59:03.911 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2024-04-14T09:59:03.911 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2024-04-14T09:59:03.911 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-04-14T09:59:03.960 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:03.987 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:03.994 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:03.995 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-14T09:59:04.008 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-14T09:59:04.008 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:04.009 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-14T09:59:04.062 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-04-14T09:59:04.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:04.063 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:04.146 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:04.147 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:04.154 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:04.154 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:04.154 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-04-14T09:59:04.154 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 3@131eb2ba-6185-454c-b8ac-0bdd05152d4d.cephfs=/ 2024-04-14T09:59:04.154 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.40:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-04-14T09:59:04.155 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-04-14T09:59:04.155 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-04-14T09:59:04.155 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T09:59:04.155 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T09:59:04.155 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T09:59:04.156 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T09:59:04.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:04.157 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-14T09:59:04.186 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:04.275 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:04.276 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:04.282 INFO:teuthology.orchestra.run.smithi136.stdout:client4852 2024-04-14T09:59:04.283 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:04.283 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:04.298 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:04.386 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:04.388 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:04.393 INFO:teuthology.orchestra.run.smithi136.stdout:client4852 2024-04-14T09:59:04.394 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:04.442 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:04.444 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:04.449 INFO:teuthology.orchestra.run.smithi136.stdout:client4852 2024-04-14T09:59:04.450 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/131eb2ba-6185-454c-b8ac-0bdd05152d4d.client4852/status') 2024-04-14T09:59:04.498 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:04.510 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4852 (3)192.168.0.2:0/4047657416 2024-04-14T09:59:04.510 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-04-14T09:59:04.511 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-04-14T09:59:04.511 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-04-14T09:59:04.511 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 1.9934e-05 s, 3.5 MB/s 2024-04-14T09:59:04.511 INFO:teuthology.orchestra.run.smithi136.stderr:2024-04-14T09:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:04.518 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-14T09:59:04.536 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:04.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 Processor -- start 2024-04-14T09:59:04.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 -- start start 2024-04-14T09:59:04.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcbc815e650 0x7fcbc80b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbc80b4760 0x7fcbc80d2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbc80b4c70 con 0x7fcbc80d2cb0 2024-04-14T09:59:04.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc80d3120 con 0x7fcbc80b4760 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.647+0000 7fcbce036640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fcbc80b5880 con 0x7fcbc815e650 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fcbc80b4760 0x7fcbc80d2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fcbc80d2cb0 0x7fcbc81622e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56370/0 (socket says 172.21.15.40:56370) 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc7fff640 1 -- 172.21.15.40:0/99384318 learned_addr learned my addr 172.21.15.40:0/99384318 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc77fe640 1 --2- 172.21.15.40:0/99384318 >> v2:172.21.15.136:3300/0 conn(0x7fcbc815e650 0x7fcbc80b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc6ffd640 1 -- 172.21.15.40:0/99384318 >> v2:172.21.15.136:3300/0 conn(0x7fcbc815e650 msgr2=0x7fcbc80b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc6ffd640 1 --2- 172.21.15.40:0/99384318 >> v2:172.21.15.136:3300/0 conn(0x7fcbc815e650 0x7fcbc80b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc6ffd640 1 -- 172.21.15.40:0/99384318 >> v1:172.21.15.40:6789/0 conn(0x7fcbc80d2cb0 legacy=0x7fcbc81622e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.648+0000 7fcbc6ffd640 1 -- 172.21.15.40:0/99384318 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc80b4f50 con 0x7fcbc80b4760 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbc6ffd640 1 --2- 172.21.15.40:0/99384318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc80d2770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b6e10 tx=0x7fcbbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e8cd3c3e51b5a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbc67fc640 1 -- 172.21.15.40:0/99384318 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc035020 con 0x7fcbc80b4760 2024-04-14T09:59:04.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbc67fc640 1 -- 172.21.15.40:0/99384318 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbbc031830 con 0x7fcbc80b4760 2024-04-14T09:59:04.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbc67fc640 1 -- 172.21.15.40:0/99384318 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc031c00 con 0x7fcbc80b4760 2024-04-14T09:59:04.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 -- 172.21.15.40:0/99384318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 msgr2=0x7fcbc80d2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 --2- 172.21.15.40:0/99384318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc80d2770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b6e10 tx=0x7fcbbc02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 -- 172.21.15.40:0/99384318 shutdown_connections 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 --2- 172.21.15.40:0/99384318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc80d2770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 --2- 172.21.15.40:0/99384318 >> v2:172.21.15.136:3300/0 conn(0x7fcbc815e650 0x7fcbc80b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.649+0000 7fcbce036640 1 -- 172.21.15.40:0/99384318 >> 172.21.15.40:0/99384318 conn(0x7fcbc809d580 msgr2=0x7fcbc80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.650+0000 7fcbce036640 1 -- 172.21.15.40:0/99384318 shutdown_connections 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.650+0000 7fcbce036640 1 -- 172.21.15.40:0/99384318 wait complete. 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.651+0000 7fcbce036640 1 Processor -- start 2024-04-14T09:59:04.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.651+0000 7fcbce036640 1 -- start start 2024-04-14T09:59:04.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.654 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbc80d2cb0 0x7fcbc81539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcbc815e650 0x7fcbc81f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc80d2270 con 0x7fcbc80b4760 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc80b5510 con 0x7fcbc80d2cb0 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcbc815ea30 con 0x7fcbc815e650 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45646/0 (socket says 172.21.15.40:45646) 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 -- 172.21.15.40:0/2244225922 learned_addr learned my addr 172.21.15.40:0/2244225922 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc6ffd640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbc80d2cb0 0x7fcbc81539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc7fff640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcbc815e650 0x7fcbc81f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 -- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcbc815e650 msgr2=0x7fcbc81f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcbc815e650 0x7fcbc81f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 -- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbc80d2cb0 msgr2=0x7fcbc81539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbc80d2cb0 0x7fcbc81539d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 -- 172.21.15.40:0/2244225922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc81f5410 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbc77fe640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800e9b0 tx=0x7fcbb800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8017070 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcbb800c9a0 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc81f8920 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.652+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800cd90 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.653+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc81f4e50 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.654+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc80756f0 con 0x7fcbc80b4760 2024-04-14T09:59:04.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.654+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcbb801a070 con 0x7fcbc80b4760 2024-04-14T09:59:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.654+0000 7fcbaffff640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.654+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fcbb808bec0 con 0x7fcbc80b4760 2024-04-14T09:59:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.654+0000 7fcbc6ffd640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.655+0000 7fcbc6ffd640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 0x7fcbb406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc036000 tx=0x7fcbbc03c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.659+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fcbc81f5410 con 0x7fcbc80b4760 2024-04-14T09:59:04.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.847+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbc8163160 con 0x7fcbc80b4760 2024-04-14T09:59:04.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.849+0000 7fcbaffff640 1 -- 172.21.15.40:0/2244225922 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fcbb8059930 con 0x7fcbc80b4760 2024-04-14T09:59:04.849 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:04.850 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:04.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.850+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 msgr2=0x7fcbb406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.850+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 0x7fcbb406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc036000 tx=0x7fcbbc03c040 comp rx=0 tx=0).stop 2024-04-14T09:59:04.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.850+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 msgr2=0x7fcbc81f83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.850+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800e9b0 tx=0x7fcbb800ee70 comp rx=0 tx=0).stop 2024-04-14T09:59:04.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.850+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 shutdown_connections 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fcbb406c8f0 0x7fcbb406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcbc815e650 0x7fcbc81f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcbc80d2cb0 0x7fcbc81539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 --2- 172.21.15.40:0/2244225922 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fcbc80b4760 0x7fcbc81f83e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 >> 172.21.15.40:0/2244225922 conn(0x7fcbc809d580 msgr2=0x7fcbc806c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 shutdown_connections 2024-04-14T09:59:04.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.851+0000 7fcbce036640 1 -- 172.21.15.40:0/2244225922 wait complete. 2024-04-14T09:59:04.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:04.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.967+0000 7fca5f115640 1 Processor -- start 2024-04-14T09:59:04.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.967+0000 7fca5f115640 1 -- start start 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5f115640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca58161ca0 0x7fca580d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5f115640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fca58162bb0 0x7fca580cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5f115640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca580d5000 con 0x7fca580d0c80 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5f115640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fca580cf0d0 con 0x7fca58162bb0 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5f115640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fca580cf3b0 con 0x7fca58161ca0 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fca58162bb0 0x7fca580cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.969 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fca58162bb0 0x7fca580cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:55202/0 (socket says 172.21.15.40:55202) 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 -- 172.21.15.40:0/2385158471 learned_addr learned my addr 172.21.15.40:0/2385158471 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca5ceb1640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca58161ca0 0x7fca580d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 -- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca58161ca0 msgr2=0x7fca580d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca58161ca0 0x7fca580d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 -- 172.21.15.40:0/2385158471 >> v1:172.21.15.136:6789/0 conn(0x7fca580d0c80 legacy=0x7fca580b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.968+0000 7fca57fff640 1 -- 172.21.15.40:0/2385158471 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca580cf690 con 0x7fca58162bb0 2024-04-14T09:59:04.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.969+0000 7fca57fff640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cfbb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca48009e50 tx=0x7fca4802bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63f90871554ff274 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.969+0000 7fca577fe640 1 -- 172.21.15.40:0/2385158471 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca4802ca70 con 0x7fca58162bb0 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.969+0000 7fca577fe640 1 -- 172.21.15.40:0/2385158471 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca4802cc10 con 0x7fca58162bb0 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.969+0000 7fca577fe640 1 -- 172.21.15.40:0/2385158471 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca480343f0 con 0x7fca58162bb0 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 -- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 msgr2=0x7fca580cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cfbb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fca48009e50 tx=0x7fca4802bed0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 -- 172.21.15.40:0/2385158471 shutdown_connections 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cfbb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 --2- 172.21.15.40:0/2385158471 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca58161ca0 0x7fca580d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 -- 172.21.15.40:0/2385158471 >> 172.21.15.40:0/2385158471 conn(0x7fca5809d5c0 msgr2=0x7fca580d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 -- 172.21.15.40:0/2385158471 shutdown_connections 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.970+0000 7fca5f115640 1 -- 172.21.15.40:0/2385158471 wait complete. 2024-04-14T09:59:04.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.971+0000 7fca5f115640 1 Processor -- start 2024-04-14T09:59:04.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.971+0000 7fca5f115640 1 -- start start 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca580d0c80 0x7fca58158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fca580ced80 con 0x7fca58161ca0 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fca580d00f0 con 0x7fca58162bb0 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5f115640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fca580b77d0 con 0x7fca580d0c80 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45662/0 (socket says 172.21.15.40:45662) 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 -- 172.21.15.40:0/4077865182 learned_addr learned my addr 172.21.15.40:0/4077865182 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5ceb1640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca580d0c80 0x7fca58158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca5d6b2640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 -- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca580d0c80 msgr2=0x7fca58158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca580d0c80 0x7fca58158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 -- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 msgr2=0x7fca580cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.972+0000 7fca57fff640 1 -- 172.21.15.40:0/4077865182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca580cc3c0 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca57fff640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca48036040 tx=0x7fca48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48044020 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca48040690 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca48009510 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca580cbe00 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.973+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca580c7ac0 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.974+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca58075760 con 0x7fca58161ca0 2024-04-14T09:59:04.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.974+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fca48047020 con 0x7fca58161ca0 2024-04-14T09:59:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.975+0000 7fca557fa640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 0x7fca3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.975+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fca480ae800 con 0x7fca58161ca0 2024-04-14T09:59:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.975+0000 7fca5ceb1640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 0x7fca3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:04.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.975+0000 7fca5ceb1640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 0x7fca3806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca580c7750 tx=0x7fca50009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:04.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:04.979+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fca4804e030 con 0x7fca58161ca0 2024-04-14T09:59:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.161+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fca580d0a60 con 0x7fca58161ca0 2024-04-14T09:59:05.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.162+0000 7fca557fa640 1 -- 172.21.15.40:0/4077865182 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fca4807c390 con 0x7fca58161ca0 2024-04-14T09:59:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.163+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 msgr2=0x7fca3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.163+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 0x7fca3806edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fca580c7750 tx=0x7fca50009190 comp rx=0 tx=0).stop 2024-04-14T09:59:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.163+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 msgr2=0x7fca581594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.163+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fca48036040 tx=0x7fca48004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 shutdown_connections 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fca3806c8f0 0x7fca3806edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fca58162bb0 0x7fca580cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fca58161ca0 0x7fca581594a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 --2- 172.21.15.40:0/4077865182 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fca580d0c80 0x7fca58158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 >> 172.21.15.40:0/4077865182 conn(0x7fca5809d5c0 msgr2=0x7fca580d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 shutdown_connections 2024-04-14T09:59:05.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.164+0000 7fca5f115640 1 -- 172.21.15.40:0/4077865182 wait complete. 2024-04-14T09:59:05.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:05.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.279+0000 7f65dc35e640 1 Processor -- start 2024-04-14T09:59:05.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.279+0000 7f65dc35e640 1 -- start start 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65dc35e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 0x7f65d40d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65dc35e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65d40b1e60 0x7f65d40b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65dc35e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d40ad250 con 0x7f65d415c2b0 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65dc35e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f65d40b27d0 con 0x7f65d40b1e60 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65dc35e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f65d40ad530 con 0x7f65d40af930 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65da8fb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f65d40b1e60 0x7f65d40b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65d98f9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 0x7f65d40d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65da0fa640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f65d415c2b0 0x7f65d40b4f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:37172/0 (socket says 172.21.15.40:37172) 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65da0fa640 1 -- 172.21.15.40:0/1501203406 learned_addr learned my addr 172.21.15.40:0/1501203406 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:05.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65d98f9640 1 -- 172.21.15.40:0/1501203406 >> v2:172.21.15.136:3300/0 conn(0x7f65d40b1e60 msgr2=0x7f65d40b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65d98f9640 1 --2- 172.21.15.40:0/1501203406 >> v2:172.21.15.136:3300/0 conn(0x7f65d40b1e60 0x7f65d40b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65d98f9640 1 -- 172.21.15.40:0/1501203406 >> v1:172.21.15.136:6789/0 conn(0x7f65d415c2b0 legacy=0x7f65d40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.280+0000 7f65d98f9640 1 -- 172.21.15.40:0/1501203406 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d40ad810 con 0x7f65d40af930 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.281+0000 7f65d98f9640 1 --2- 172.21.15.40:0/1501203406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 0x7f65d40d09e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65c80097a0 tx=0x7f65c802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf09b8b9b25964ea server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.281+0000 7f65d90f8640 1 -- 172.21.15.40:0/1501203406 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c80315a0 con 0x7f65d40af930 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.281+0000 7f65d90f8640 1 -- 172.21.15.40:0/1501203406 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8037070 con 0x7f65d40af930 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.281+0000 7f65d90f8640 1 -- 172.21.15.40:0/1501203406 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8031960 con 0x7f65d40af930 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 -- 172.21.15.40:0/1501203406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 msgr2=0x7f65d40d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1501203406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 0x7f65d40d09e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f65c80097a0 tx=0x7f65c802b840 comp rx=0 tx=0).stop 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 -- 172.21.15.40:0/1501203406 shutdown_connections 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1501203406 >> v2:172.21.15.136:3300/0 conn(0x7f65d40b1e60 0x7f65d40b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1501203406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d40af930 0x7f65d40d09e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 -- 172.21.15.40:0/1501203406 >> 172.21.15.40:0/1501203406 conn(0x7f65d40b56f0 msgr2=0x7f65d40b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 -- 172.21.15.40:0/1501203406 shutdown_connections 2024-04-14T09:59:05.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.282+0000 7f65dc35e640 1 -- 172.21.15.40:0/1501203406 wait complete. 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.283+0000 7f65dc35e640 1 Processor -- start 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.283+0000 7f65dc35e640 1 -- start start 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 0x7f65d414f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 0x7f65d4150420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d415c2b0 0x7f65d40cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40d0f20 con 0x7f65d40af930 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f65d40d04c0 con 0x7f65d40b1e60 2024-04-14T09:59:05.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65dc35e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f65d40d10a0 con 0x7f65d415c2b0 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65da0fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 0x7f65d414f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 0x7f65d4150420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65da0fa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 0x7f65d414f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45666/0 (socket says 172.21.15.40:45666) 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65da0fa640 1 -- 172.21.15.40:0/1631444695 learned_addr learned my addr 172.21.15.40:0/1631444695 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65da8fb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d415c2b0 0x7f65d40cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 -- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d415c2b0 msgr2=0x7f65d40cebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d415c2b0 0x7f65d40cebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 -- 172.21.15.40:0/1631444695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 msgr2=0x7f65d414f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 0x7f65d414f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 -- 172.21.15.40:0/1631444695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d4152830 con 0x7f65d40b1e60 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.284+0000 7f65d98f9640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 0x7f65d4150420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65c8033000 tx=0x7f65c80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.285+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8032630 con 0x7f65d40b1e60 2024-04-14T09:59:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.285+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c80327f0 con 0x7f65d40b1e60 2024-04-14T09:59:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.285+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d41566e0 con 0x7f65d40b1e60 2024-04-14T09:59:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.285+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c8032be0 con 0x7f65d40b1e60 2024-04-14T09:59:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.285+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d4156ca0 con 0x7f65d40b1e60 2024-04-14T09:59:05.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.286+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d4075760 con 0x7f65d40b1e60 2024-04-14T09:59:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.286+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f65c804e430 con 0x7f65d40b1e60 2024-04-14T09:59:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.286+0000 7f65d2ffd640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.287+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f65c802f030 con 0x7f65d40b1e60 2024-04-14T09:59:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.287+0000 7f65da0fa640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.287+0000 7f65da0fa640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 0x7f65c006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65cc001f30 tx=0x7f65cc001ac0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.291+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f65c8040070 con 0x7f65d40b1e60 2024-04-14T09:59:05.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.474+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f65d4074a10 con 0x7f65d40b1e60 2024-04-14T09:59:05.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.474+0000 7f65d2ffd640 1 -- 172.21.15.40:0/1631444695 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f65c807b710 con 0x7f65d40b1e60 2024-04-14T09:59:05.475 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:05.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 msgr2=0x7f65c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 0x7f65c006edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65cc001f30 tx=0x7f65cc001ac0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 msgr2=0x7f65d4150420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 0x7f65d4150420 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f65c8033000 tx=0x7f65c80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 shutdown_connections 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f65c006c8f0 0x7f65c006edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f65d415c2b0 0x7f65d40cebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f65d40b1e60 0x7f65d4150420 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 --2- 172.21.15.40:0/1631444695 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f65d40af930 0x7f65d414f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.476+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 >> 172.21.15.40:0/1631444695 conn(0x7f65d40b56f0 msgr2=0x7f65d40b02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.477+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 shutdown_connections 2024-04-14T09:59:05.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.477+0000 7f65dc35e640 1 -- 172.21.15.40:0/1631444695 wait complete. 2024-04-14T09:59:05.488 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:05.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.592+0000 7f90cc0de640 1 Processor -- start 2024-04-14T09:59:05.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 -- start start 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c40d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 0x7f90c40d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90c40d2f30 con 0x7f90c415e7b0 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f90c40cf000 con 0x7f90c40c7e30 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.593+0000 7f90cc0de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90c40cf2e0 con 0x7f90c415e3d0 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90ca67b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f90c415e7b0 0x7f90c40d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56386/0 (socket says 172.21.15.40:56386) 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90ca67b640 1 -- 172.21.15.40:0/2012751613 learned_addr learned my addr 172.21.15.40:0/2012751613 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/2012751613 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c40d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9679640 1 --2- 172.21.15.40:0/2012751613 >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 0x7f90c40d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c8e78640 1 -- 172.21.15.40:0/2012751613 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417413252 0 0) 0x7f90c40d2f30 con 0x7f90c415e7b0 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c8e78640 1 -- 172.21.15.40:0/2012751613 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b0003520 con 0x7f90c415e7b0 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9e7a640 1 -- 172.21.15.40:0/2012751613 >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 msgr2=0x7f90c40d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/2012751613 >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 0x7f90c40d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9e7a640 1 -- 172.21.15.40:0/2012751613 >> v1:172.21.15.40:6789/0 conn(0x7f90c415e7b0 legacy=0x7f90c40d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9e7a640 1 -- 172.21.15.40:0/2012751613 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c40cf5c0 con 0x7f90c415e3d0 2024-04-14T09:59:05.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.594+0000 7f90c9679640 1 --2- 172.21.15.40:0/2012751613 >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 0x7f90c40d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:05.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/2012751613 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c40d4030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0097a0 tx=0x7f90bc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58197a7d010cc019 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90c8e78640 1 -- 172.21.15.40:0/2012751613 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc035020 con 0x7f90c415e3d0 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90c8e78640 1 -- 172.21.15.40:0/2012751613 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90bc031830 con 0x7f90c415e3d0 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90c8e78640 1 -- 172.21.15.40:0/2012751613 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90bc031c00 con 0x7f90c415e3d0 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 -- 172.21.15.40:0/2012751613 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 msgr2=0x7f90c40d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 --2- 172.21.15.40:0/2012751613 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c40d4030 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90bc0097a0 tx=0x7f90bc02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 -- 172.21.15.40:0/2012751613 shutdown_connections 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 --2- 172.21.15.40:0/2012751613 >> v2:172.21.15.136:3300/0 conn(0x7f90c40c7e30 0x7f90c40d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 --2- 172.21.15.40:0/2012751613 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c40d4030 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.595+0000 7f90cc0de640 1 -- 172.21.15.40:0/2012751613 >> 172.21.15.40:0/2012751613 conn(0x7f90c408dc90 msgr2=0x7f90c409d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.596+0000 7f90cc0de640 1 -- 172.21.15.40:0/2012751613 shutdown_connections 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.596+0000 7f90cc0de640 1 -- 172.21.15.40:0/2012751613 wait complete. 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 Processor -- start 2024-04-14T09:59:05.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 -- start start 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90c40c7e30 0x7f90c40c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c4160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90c40d2a00 con 0x7f90c415e7b0 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90c40d2880 con 0x7f90c40c7e30 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.597+0000 7f90cc0de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90c40d2b80 con 0x7f90c415e3d0 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45670/0 (socket says 172.21.15.40:45670) 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 -- 172.21.15.40:0/3281842902 learned_addr learned my addr 172.21.15.40:0/3281842902 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90c40c7e30 0x7f90c40c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90c9679640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c4160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 -- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 msgr2=0x7f90c4160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c4160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 -- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90c40c7e30 msgr2=0x7f90c40c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90c40c7e30 0x7f90c40c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 -- 172.21.15.40:0/3281842902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c41472b0 con 0x7f90c415e7b0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ca67b640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90c000cad0 tx=0x7f90c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0017070 con 0x7f90c415e7b0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90c000ab70 con 0x7f90c415e7b0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c415f630 con 0x7f90c415e7b0 2024-04-14T09:59:05.602 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90c0012400 con 0x7f90c415e7b0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.598+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c4161540 con 0x7f90c415e7b0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.599+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c4075760 con 0x7f90c415e7b0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.600+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90c001a070 con 0x7f90c415e7b0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.600+0000 7f90ba7fc640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.600+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f90c008bbf0 con 0x7f90c415e7b0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.600+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.601+0000 7f90c9e7a640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 0x7f90a806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90bc036000 tx=0x7f90bc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.604+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f90c0059540 con 0x7f90c415e7b0 2024-04-14T09:59:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.788+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f90c4147480 con 0x7f90c415e7b0 2024-04-14T09:59:05.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.788+0000 7f90ba7fc640 1 -- 172.21.15.40:0/3281842902 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f90c005d840 con 0x7f90c415e7b0 2024-04-14T09:59:05.791 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:05.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 msgr2=0x7f90a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 0x7f90a806edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f90bc036000 tx=0x7f90bc008030 comp rx=0 tx=0).stop 2024-04-14T09:59:05.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 msgr2=0x7f90c415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f90c000cad0 tx=0x7f90c000cf90 comp rx=0 tx=0).stop 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 shutdown_connections 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a806c8f0 0x7f90a806edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90c415e7b0 0x7f90c415f0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90c415e3d0 0x7f90c4160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 --2- 172.21.15.40:0/3281842902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90c40c7e30 0x7f90c40c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 >> 172.21.15.40:0/3281842902 conn(0x7f90c408dc90 msgr2=0x7f90c40d2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 shutdown_connections 2024-04-14T09:59:05.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.790+0000 7f90cc0de640 1 -- 172.21.15.40:0/3281842902 wait complete. 2024-04-14T09:59:05.801 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 Processor -- start 2024-04-14T09:59:05.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 -- start start 2024-04-14T09:59:05.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3740161ca0 0x7f37400d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3740162bb0 0x7f37400cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37400d5000 con 0x7f37400d0c80 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f37400cf0d0 con 0x7f3740162bb0 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.906+0000 7f374711e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f37400cf3b0 con 0x7f3740161ca0 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3740162bb0 0x7f37400cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3740162bb0 0x7f37400cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45676/0 (socket says 172.21.15.40:45676) 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f3744eba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3740161ca0 0x7f37400d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 -- 172.21.15.40:0/2412050867 learned_addr learned my addr 172.21.15.40:0/2412050867 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 -- 172.21.15.40:0/2412050867 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3740161ca0 msgr2=0x7f37400d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 --2- 172.21.15.40:0/2412050867 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3740161ca0 0x7f37400d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 -- 172.21.15.40:0/2412050867 >> v1:172.21.15.136:6789/0 conn(0x7f37400d0c80 legacy=0x7f37400b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.908 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.907+0000 7f373ffff640 1 -- 172.21.15.40:0/2412050867 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37400cf690 con 0x7f3740162bb0 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f373ffff640 1 --2- 172.21.15.40:0/2412050867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cfbb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3730009e50 tx=0x7f373002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9674753715d2401 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f373f7fe640 1 -- 172.21.15.40:0/2412050867 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f373002ca70 con 0x7f3740162bb0 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f373f7fe640 1 -- 172.21.15.40:0/2412050867 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f373002cc10 con 0x7f3740162bb0 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f373f7fe640 1 -- 172.21.15.40:0/2412050867 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37300343f0 con 0x7f3740162bb0 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 -- 172.21.15.40:0/2412050867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 msgr2=0x7f37400cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 --2- 172.21.15.40:0/2412050867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cfbb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3730009e50 tx=0x7f373002bed0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 -- 172.21.15.40:0/2412050867 shutdown_connections 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 --2- 172.21.15.40:0/2412050867 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cfbb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.910 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 --2- 172.21.15.40:0/2412050867 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3740161ca0 0x7f37400d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 -- 172.21.15.40:0/2412050867 >> 172.21.15.40:0/2412050867 conn(0x7f374009d5c0 msgr2=0x7f37400d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 -- 172.21.15.40:0/2412050867 shutdown_connections 2024-04-14T09:59:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.908+0000 7f374711e640 1 -- 172.21.15.40:0/2412050867 wait complete. 2024-04-14T09:59:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.909+0000 7f374711e640 1 Processor -- start 2024-04-14T09:59:05.911 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 -- start start 2024-04-14T09:59:05.912 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37400d0c80 0x7f3740158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3740161ca0 0x7f37401594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f37400ced80 con 0x7f3740162bb0 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f37400d00f0 con 0x7f3740161ca0 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f374711e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f37400b77d0 con 0x7f37400d0c80 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f37456bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f37456bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45678/0 (socket says 172.21.15.40:45678) 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.910+0000 7f37456bb640 1 -- 172.21.15.40:0/951507868 learned_addr learned my addr 172.21.15.40:0/951507868 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f373ffff640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3740161ca0 0x7f37401594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f3744eba640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37400d0c80 0x7f3740158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 -- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37400d0c80 msgr2=0x7f3740158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37400d0c80 0x7f3740158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 -- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3740161ca0 msgr2=0x7f37401594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3740161ca0 0x7f37401594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 -- 172.21.15.40:0/951507868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37400cc3c0 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f37456bb640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3728001eb0 tx=0x7f372800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728017070 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37280052d0 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37400cbe00 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3728003810 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.911+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37400c7ac0 con 0x7f3740162bb0 2024-04-14T09:59:05.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.912+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3740075760 con 0x7f3740162bb0 2024-04-14T09:59:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.913+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f372801a070 con 0x7f3740162bb0 2024-04-14T09:59:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.913+0000 7f373d7fa640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 0x7f372006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.913+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f372808b270 con 0x7f3740162bb0 2024-04-14T09:59:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.913+0000 7f3744eba640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 0x7f372006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:05.915 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.914+0000 7f3744eba640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 0x7f372006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37400c7750 tx=0x7f3738008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:05.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:05.918+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3728059330 con 0x7f3740162bb0 2024-04-14T09:59:06.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.101+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f37400d0a60 con 0x7f3740162bb0 2024-04-14T09:59:06.102 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.101+0000 7f373d7fa640 1 -- 172.21.15.40:0/951507868 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f3728058c30 con 0x7f3740162bb0 2024-04-14T09:59:06.102 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 msgr2=0x7f372006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 0x7f372006edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f37400c7750 tx=0x7f3738008040 comp rx=0 tx=0).stop 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 msgr2=0x7f37400cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3728001eb0 tx=0x7f372800c890 comp rx=0 tx=0).stop 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 shutdown_connections 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f372006c8f0 0x7f372006edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.104 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3740162bb0 0x7f37400cb340 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3740161ca0 0x7f37401594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 --2- 172.21.15.40:0/951507868 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f37400d0c80 0x7f3740158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 >> 172.21.15.40:0/951507868 conn(0x7f374009d5c0 msgr2=0x7f37400d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 shutdown_connections 2024-04-14T09:59:06.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.103+0000 7f374711e640 1 -- 172.21.15.40:0/951507868 wait complete. 2024-04-14T09:59:06.115 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:06.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.216+0000 7fe648bbb640 1 Processor -- start 2024-04-14T09:59:06.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.216+0000 7fe648bbb640 1 -- start start 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe648bbb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 0x7fe6440cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe648bbb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6440b4680 0x7fe64409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe648bbb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6440ccce0 con 0x7fe64415c690 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe648bbb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe6440d01b0 con 0x7fe6440b4680 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe648bbb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe6440ccf80 con 0x7fe64415c2b0 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe642d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe6440b4680 0x7fe64409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe641d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe64415c690 0x7fe6440cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:56394/0 (socket says 172.21.15.40:56394) 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe641d9b640 1 -- 172.21.15.40:0/1350659097 learned_addr learned my addr 172.21.15.40:0/1350659097 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:06.219 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe64259c640 1 --2- 172.21.15.40:0/1350659097 >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 0x7fe6440cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe642d9d640 1 -- 172.21.15.40:0/1350659097 >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 msgr2=0x7fe6440cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe642d9d640 1 --2- 172.21.15.40:0/1350659097 >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 0x7fe6440cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.217+0000 7fe642d9d640 1 -- 172.21.15.40:0/1350659097 >> v1:172.21.15.40:6789/0 conn(0x7fe64415c690 legacy=0x7fe6440cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe64159a640 1 -- 172.21.15.40:0/1350659097 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3109315977 0 0) 0x7fe6440ccce0 con 0x7fe64415c690 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe642d9d640 1 -- 172.21.15.40:0/1350659097 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6440cd260 con 0x7fe6440b4680 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe64259c640 1 --2- 172.21.15.40:0/1350659097 >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 0x7fe6440cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe642d9d640 1 --2- 172.21.15.40:0/1350659097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440b4680 0x7fe64409aa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe6440727a0 tx=0x7fe63402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236105e6e037856 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe64159a640 1 -- 172.21.15.40:0/1350659097 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634039070 con 0x7fe6440b4680 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe64159a640 1 -- 172.21.15.40:0/1350659097 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63402cc80 con 0x7fe6440b4680 2024-04-14T09:59:06.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.218+0000 7fe64159a640 1 -- 172.21.15.40:0/1350659097 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634034660 con 0x7fe6440b4680 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 -- 172.21.15.40:0/1350659097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440b4680 msgr2=0x7fe64409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 --2- 172.21.15.40:0/1350659097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440b4680 0x7fe64409aa40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe6440727a0 tx=0x7fe63402bed0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 -- 172.21.15.40:0/1350659097 shutdown_connections 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 --2- 172.21.15.40:0/1350659097 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440b4680 0x7fe64409aa40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 --2- 172.21.15.40:0/1350659097 >> v2:172.21.15.136:3300/0 conn(0x7fe64415c2b0 0x7fe6440cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 -- 172.21.15.40:0/1350659097 >> 172.21.15.40:0/1350659097 conn(0x7fe6440b3b90 msgr2=0x7fe6440b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 -- 172.21.15.40:0/1350659097 shutdown_connections 2024-04-14T09:59:06.223 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.219+0000 7fe648bbb640 1 -- 172.21.15.40:0/1350659097 wait complete. 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.220+0000 7fe648bbb640 1 Processor -- start 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.220+0000 7fe648bbb640 1 -- start start 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6440b4680 0x7fe64415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe64415c2b0 0x7fe6440caca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe64409af80 con 0x7fe6440cbc10 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6440d03e0 con 0x7fe64415c2b0 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe648bbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe64409b100 con 0x7fe6440b4680 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:45698/0 (socket says 172.21.15.40:45698) 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 -- 172.21.15.40:0/3978598068 learned_addr learned my addr 172.21.15.40:0/3978598068 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe641d9b640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe64415c2b0 0x7fe6440caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.224 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe64259c640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6440b4680 0x7fe64415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 -- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6440b4680 msgr2=0x7fe64415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6440b4680 0x7fe64415b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 -- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe64415c2b0 msgr2=0x7fe6440caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe64415c2b0 0x7fe6440caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.221+0000 7fe642d9d640 1 -- 172.21.15.40:0/3978598068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6441e4c70 con 0x7fe6440cbc10 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe642d9d640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe634009e80 tx=0x7fe634004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634039050 con 0x7fe6440cbc10 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63403a040 con 0x7fe6440cbc10 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6440cc240 con 0x7fe6440cbc10 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe634009450 con 0x7fe6440cbc10 2024-04-14T09:59:06.225 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.222+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6440ca1c0 con 0x7fe6440cbc10 2024-04-14T09:59:06.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.223+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe64409ada0 con 0x7fe6440cbc10 2024-04-14T09:59:06.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.223+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe634047020 con 0x7fe6440cbc10 2024-04-14T09:59:06.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.224+0000 7fe63affd640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 0x7fe62406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.224+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe6340ae120 con 0x7fe6440cbc10 2024-04-14T09:59:06.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.224+0000 7fe64259c640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 0x7fe62406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.227 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.224+0000 7fe64259c640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 0x7fe62406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009560 tx=0x7fe63c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.228+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe64409ada0 con 0x7fe6440cbc10 2024-04-14T09:59:06.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.414+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe6440756f0 con 0x7fe6440cbc10 2024-04-14T09:59:06.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.415+0000 7fe63affd640 1 -- 172.21.15.40:0/3978598068 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fe63404e020 con 0x7fe6440cbc10 2024-04-14T09:59:06.416 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:06.416 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:06.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 msgr2=0x7fe62406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 0x7fe62406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe63c009560 tx=0x7fe63c009190 comp rx=0 tx=0).stop 2024-04-14T09:59:06.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 msgr2=0x7fe64415aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe634009e80 tx=0x7fe634004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 shutdown_connections 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe62406c8f0 0x7fe62406edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6440cbc10 0x7fe64415aaa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe64415c2b0 0x7fe6440caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 --2- 172.21.15.40:0/3978598068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6440b4680 0x7fe64415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 >> 172.21.15.40:0/3978598068 conn(0x7fe6440b3b90 msgr2=0x7fe6440b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 shutdown_connections 2024-04-14T09:59:06.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.417+0000 7fe648bbb640 1 -- 172.21.15.40:0/3978598068 wait complete. 2024-04-14T09:59:06.429 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:06.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.534+0000 7f506c2de640 1 Processor -- start 2024-04-14T09:59:06.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.534+0000 7f506c2de640 1 -- start start 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506c2de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f506415a630 0x7f5064071d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506c2de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 0x7f50640b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506c2de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50640b47a0 con 0x7f50640b3f10 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506c2de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f50640b5030 con 0x7f506415a630 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506c2de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f50640b5310 con 0x7f506415aa10 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a87b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f50640b3f10 0x7f506406d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37744/0 (socket says 172.21.15.40:37744) 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a87b640 1 -- 172.21.15.40:0/312851756 learned_addr learned my addr 172.21.15.40:0/312851756 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a07a640 1 --2- 172.21.15.40:0/312851756 >> v2:172.21.15.136:3300/0 conn(0x7f506415a630 0x7f5064071d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f5069879640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 0x7f50640b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f5069078640 1 -- 172.21.15.40:0/312851756 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235278442 0 0) 0x7f50640b47a0 con 0x7f50640b3f10 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f5069078640 1 -- 172.21.15.40:0/312851756 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050003520 con 0x7f50640b3f10 2024-04-14T09:59:06.537 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a07a640 1 -- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 msgr2=0x7f50640b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a07a640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 0x7f50640b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a07a640 1 -- 172.21.15.40:0/312851756 >> v1:172.21.15.40:6789/0 conn(0x7f50640b3f10 legacy=0x7f506406d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f506a07a640 1 -- 172.21.15.40:0/312851756 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50640b31d0 con 0x7f506415a630 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.535+0000 7f5069879640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 0x7f50640b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.536+0000 7f506a07a640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f506415a630 0x7f5064071d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50600097a0 tx=0x7f506002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=821f82603cd520c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.536+0000 7f5069078640 1 -- 172.21.15.40:0/312851756 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060038070 con 0x7f506415a630 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.536+0000 7f5069078640 1 -- 172.21.15.40:0/312851756 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5060031700 con 0x7f506415a630 2024-04-14T09:59:06.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.536+0000 7f5069078640 1 -- 172.21.15.40:0/312851756 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5060031ad0 con 0x7f506415a630 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 -- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f506415a630 msgr2=0x7f5064071d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f506415a630 0x7f5064071d70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50600097a0 tx=0x7f506002b7a0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 -- 172.21.15.40:0/312851756 shutdown_connections 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415aa10 0x7f50640b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 --2- 172.21.15.40:0/312851756 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f506415a630 0x7f5064071d70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 -- 172.21.15.40:0/312851756 >> 172.21.15.40:0/312851756 conn(0x7f506406eb90 msgr2=0x7f506406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 -- 172.21.15.40:0/312851756 shutdown_connections 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.537+0000 7f506c2de640 1 -- 172.21.15.40:0/312851756 wait complete. 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.538+0000 7f506c2de640 1 Processor -- start 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.538+0000 7f506c2de640 1 -- start start 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415a630 0x7f50641509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5064158070 0x7f5064158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50640b4c50 con 0x7f506415aa10 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f50640722b0 con 0x7f5064158070 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f50640b4dd0 con 0x7f506415a630 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43562/0 (socket says 172.21.15.40:43562) 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 -- 172.21.15.40:0/2868197851 learned_addr learned my addr 172.21.15.40:0/2868197851 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:06.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506a87b640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5064158070 0x7f5064158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506a07a640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415a630 0x7f50641509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 -- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415a630 msgr2=0x7f50641509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415a630 0x7f50641509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 -- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5064158070 msgr2=0x7f5064158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5064158070 0x7f5064158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 -- 172.21.15.40:0/2868197851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5064150f30 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f5069879640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f505400e990 tx=0x7f505400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5054017070 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f505400c980 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5064144590 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f505400cd50 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.539+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5064143570 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.541+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5064166550 con 0x7f506415aa10 2024-04-14T09:59:06.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.541+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f505401a070 con 0x7f506415aa10 2024-04-14T09:59:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.541+0000 7f505affd640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 0x7f504806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.541+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f505408bd30 con 0x7f506415aa10 2024-04-14T09:59:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.541+0000 7f506a07a640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 0x7f504806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.542+0000 7f506a07a640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 0x7f504806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5060035000 tx=0x7f5060008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.546 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.546+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5054059710 con 0x7f506415aa10 2024-04-14T09:59:06.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.730+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f506414b630 con 0x7f506415aa10 2024-04-14T09:59:06.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.731+0000 7f505affd640 1 -- 172.21.15.40:0/2868197851 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f505405da10 con 0x7f506415aa10 2024-04-14T09:59:06.732 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:06.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 msgr2=0x7f504806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 0x7f504806edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5060035000 tx=0x7f5060008030 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 msgr2=0x7f5064144050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f505400e990 tx=0x7f505400ee50 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 shutdown_connections 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f504806c8f0 0x7f504806edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5064158070 0x7f5064158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f506415aa10 0x7f5064144050 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 --2- 172.21.15.40:0/2868197851 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f506415a630 0x7f50641509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 >> 172.21.15.40:0/2868197851 conn(0x7f506406eb90 msgr2=0x7f50641592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 shutdown_connections 2024-04-14T09:59:06.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.733+0000 7f506c2de640 1 -- 172.21.15.40:0/2868197851 wait complete. 2024-04-14T09:59:06.744 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 Processor -- start 2024-04-14T09:59:06.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 -- start start 2024-04-14T09:59:06.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0ce110 con 0x7f6e3c15c340 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0d0710 con 0x7f6e3c15c720 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.849+0000 7f6e40b1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0cd030 con 0x7f6e3c06f630 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43568/0 (socket says 172.21.15.40:43568) 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 -- 172.21.15.40:0/654457492 learned_addr learned my addr 172.21.15.40:0/654457492 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e3a59c640 1 --1- 172.21.15.40:0/654457492 >> v1:172.21.15.136:6789/0 conn(0x7f6e3c15c340 0x7f6e3c0cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51694/0 (socket says 172.21.15.40:51694) 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/654457492 >> v2:172.21.15.136:3300/0 conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 -- 172.21.15.40:0/654457492 >> v2:172.21.15.136:3300/0 conn(0x7f6e3c06f630 msgr2=0x7f6e3c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 --2- 172.21.15.40:0/654457492 >> v2:172.21.15.136:3300/0 conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 -- 172.21.15.40:0/654457492 >> v1:172.21.15.136:6789/0 conn(0x7f6e3c15c340 legacy=0x7f6e3c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e39d9b640 1 -- 172.21.15.40:0/654457492 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977281211 0 0) 0x7f6e2c001110 con 0x7f6e3c15c340 2024-04-14T09:59:06.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.850+0000 7f6e33fff640 1 -- 172.21.15.40:0/654457492 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0d0960 con 0x7f6e3c15c720 2024-04-14T09:59:06.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e33fff640 1 --2- 172.21.15.40:0/654457492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c072ba0 tx=0x7f6e2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c913772095996fa3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e39d9b640 1 -- 172.21.15.40:0/654457492 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24034070 con 0x7f6e3c15c720 2024-04-14T09:59:06.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e39d9b640 1 -- 172.21.15.40:0/654457492 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e24030860 con 0x7f6e3c15c720 2024-04-14T09:59:06.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e39d9b640 1 -- 172.21.15.40:0/654457492 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e24030c30 con 0x7f6e3c15c720 2024-04-14T09:59:06.853 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 -- 172.21.15.40:0/654457492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 msgr2=0x7f6e3c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/654457492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c072ba0 tx=0x7f6e2402b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 -- 172.21.15.40:0/654457492 shutdown_connections 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/654457492 >> v2:172.21.15.136:3300/0 conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/654457492 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 -- 172.21.15.40:0/654457492 >> 172.21.15.40:0/654457492 conn(0x7f6e3c0b3c20 msgr2=0x7f6e3c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 -- 172.21.15.40:0/654457492 shutdown_connections 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.851+0000 7f6e40b1e640 1 -- 172.21.15.40:0/654457492 wait complete. 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 Processor -- start 2024-04-14T09:59:06.854 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 -- start start 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c340 0x7f6e3c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0d0f20 con 0x7f6e3c15c720 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c06fae0 con 0x7f6e3c15c340 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.853+0000 7f6e40b1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0ccc20 con 0x7f6e3c06f630 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43572/0 (socket says 172.21.15.40:43572) 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 -- 172.21.15.40:0/1228320811 learned_addr learned my addr 172.21.15.40:0/1228320811 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:06.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e33fff640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c340 0x7f6e3c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 -- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 msgr2=0x7f6e3c0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 -- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c340 msgr2=0x7f6e3c151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c340 0x7f6e3c151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 -- 172.21.15.40:0/1228320811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c151a90 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d30 tx=0x7f6e3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34018020 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34014480 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c0b43c0 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34014870 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.854+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c0b4980 con 0x7f6e3c15c720 2024-04-14T09:59:06.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.855+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c067720 con 0x7f6e3c15c720 2024-04-14T09:59:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.856+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e34005d10 con 0x7f6e3c15c720 2024-04-14T09:59:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.856+0000 7f6e32ffd640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.856+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e3408c840 con 0x7f6e3c15c720 2024-04-14T09:59:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.856+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:06.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.857+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:06.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:06.861+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6e3c067720 con 0x7f6e3c15c720 2024-04-14T09:59:07.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.045+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e3c0b80b0 con 0x7f6e3c15c720 2024-04-14T09:59:07.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.045+0000 7f6e32ffd640 1 -- 172.21.15.40:0/1228320811 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6e34022070 con 0x7f6e3c15c720 2024-04-14T09:59:07.046 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 msgr2=0x7f6e1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c007b50 comp rx=0 tx=0).stop 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 msgr2=0x7f6e3c0b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009d30 tx=0x7f6e3400c490 comp rx=0 tx=0).stop 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 shutdown_connections 2024-04-14T09:59:07.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c8f0 0x7f6e1c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b67f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c340 0x7f6e3c151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 --2- 172.21.15.40:0/1228320811 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 >> 172.21.15.40:0/1228320811 conn(0x7f6e3c0b3c20 msgr2=0x7f6e3c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 shutdown_connections 2024-04-14T09:59:07.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.047+0000 7f6e40b1e640 1 -- 172.21.15.40:0/1228320811 wait complete. 2024-04-14T09:59:07.059 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:07.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.163+0000 7fa4e491e640 1 Processor -- start 2024-04-14T09:59:07.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.163+0000 7fa4e491e640 1 -- start start 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4e491e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 0x7fa4e00d28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4e491e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4e00d2e10 0x7fa4e00b47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4e491e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4e015eae0 con 0x7fa4e015e700 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4e491e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa4e00b4310 con 0x7fa4e00d2e10 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4e491e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00cfe60 con 0x7fa4e00cf910 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4ddd9b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 0x7fa4e00d28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4ded9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa4e00d2e10 0x7fa4e00b47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4de59c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa4e015e700 0x7fa4e00d20d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51698/0 (socket says 172.21.15.40:51698) 2024-04-14T09:59:07.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.164+0000 7fa4de59c640 1 -- 172.21.15.40:0/922465152 learned_addr learned my addr 172.21.15.40:0/922465152 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4ddd9b640 1 -- 172.21.15.40:0/922465152 >> v2:172.21.15.136:3300/0 conn(0x7fa4e00d2e10 msgr2=0x7fa4e00b47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4ddd9b640 1 --2- 172.21.15.40:0/922465152 >> v2:172.21.15.136:3300/0 conn(0x7fa4e00d2e10 0x7fa4e00b47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4ddd9b640 1 -- 172.21.15.40:0/922465152 >> v1:172.21.15.136:6789/0 conn(0x7fa4e015e700 legacy=0x7fa4e00d20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4dd59a640 1 -- 172.21.15.40:0/922465152 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743336625 0 0) 0x7fa4e015eae0 con 0x7fa4e015e700 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4ddd9b640 1 -- 172.21.15.40:0/922465152 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e00d0140 con 0x7fa4e00cf910 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4ddd9b640 1 --2- 172.21.15.40:0/922465152 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 0x7fa4e00d28d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097a0 tx=0x7fa4c802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cf749642a3ceb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.165+0000 7fa4dd59a640 1 -- 172.21.15.40:0/922465152 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8035020 con 0x7fa4e00cf910 2024-04-14T09:59:07.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4dd59a640 1 -- 172.21.15.40:0/922465152 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c8031830 con 0x7fa4e00cf910 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4dd59a640 1 -- 172.21.15.40:0/922465152 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8031c00 con 0x7fa4e00cf910 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 -- 172.21.15.40:0/922465152 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 msgr2=0x7fa4e00d28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 --2- 172.21.15.40:0/922465152 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 0x7fa4e00d28d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80097a0 tx=0x7fa4c802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 -- 172.21.15.40:0/922465152 shutdown_connections 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 --2- 172.21.15.40:0/922465152 >> v2:172.21.15.136:3300/0 conn(0x7fa4e00d2e10 0x7fa4e00b47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 --2- 172.21.15.40:0/922465152 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00cf910 0x7fa4e00d28d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 -- 172.21.15.40:0/922465152 >> 172.21.15.40:0/922465152 conn(0x7fa4e009d5c0 msgr2=0x7fa4e00d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 -- 172.21.15.40:0/922465152 shutdown_connections 2024-04-14T09:59:07.168 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.166+0000 7fa4e491e640 1 -- 172.21.15.40:0/922465152 wait complete. 2024-04-14T09:59:07.170 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.167+0000 7fa4e491e640 1 Processor -- start 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 -- start start 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 0x7fa4e0161010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 0x7fa4e01535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4ce0 con 0x7fa4e015e700 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa4e00b3fa0 con 0x7fa4e00cf910 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4e491e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa4e00b4e60 con 0x7fa4e00d2e10 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4ded9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4ded9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43586/0 (socket says 172.21.15.40:43586) 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4ded9d640 1 -- 172.21.15.40:0/3891617887 learned_addr learned my addr 172.21.15.40:0/3891617887 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4de59c640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 0x7fa4e0161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.168+0000 7fa4ddd9b640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 0x7fa4e01535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.171 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 -- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 msgr2=0x7fa4e01535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 0x7fa4e01535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 -- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 msgr2=0x7fa4e0161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 0x7fa4e0161010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 -- 172.21.15.40:0/3891617887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4e01616a0 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ddd9b640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 0x7fa4e01535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4de59c640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 0x7fa4e0161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4ded9d640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000efc0 tx=0x7fa4d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0018020 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d0014480 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4e0161980 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0014870 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.169+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4e015f200 con 0x7fa4e015e700 2024-04-14T09:59:07.172 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.170+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4e0075760 con 0x7fa4e015e700 2024-04-14T09:59:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.171+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa4d0005d10 con 0x7fa4e015e700 2024-04-14T09:59:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.171+0000 7fa4d6ffd640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 0x7fa4c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.171+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa4d008c860 con 0x7fa4e015e700 2024-04-14T09:59:07.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.171+0000 7fa4de59c640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 0x7fa4c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.172+0000 7fa4de59c640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 0x7fa4c006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8007fd0 tx=0x7fa4d8007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.176+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa4d0022070 con 0x7fa4e015e700 2024-04-14T09:59:07.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.360+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4e0153d10 con 0x7fa4e015e700 2024-04-14T09:59:07.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.360+0000 7fa4d6ffd640 1 -- 172.21.15.40:0/3891617887 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa4d0010040 con 0x7fa4e015e700 2024-04-14T09:59:07.361 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:07.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 msgr2=0x7fa4c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 0x7fa4c006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8007fd0 tx=0x7fa4d8007de0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 msgr2=0x7fa4e00b85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa4d000efc0 tx=0x7fa4d000c490 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 shutdown_connections 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa4c006c8f0 0x7fa4c006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa4e015e700 0x7fa4e00b85d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa4e00d2e10 0x7fa4e01535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 --2- 172.21.15.40:0/3891617887 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa4e00cf910 0x7fa4e0161010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 >> 172.21.15.40:0/3891617887 conn(0x7fa4e009d5c0 msgr2=0x7fa4e00b5210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 shutdown_connections 2024-04-14T09:59:07.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.362+0000 7fa4e491e640 1 -- 172.21.15.40:0/3891617887 wait complete. 2024-04-14T09:59:07.373 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.478+0000 7fb2433b4640 1 Processor -- start 2024-04-14T09:59:07.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.478+0000 7fb2433b4640 1 -- start start 2024-04-14T09:59:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb2433b4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 0x7fb23c169360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb2433b4640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0cf7b0 con 0x7fb23c15e5d0 2024-04-14T09:59:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb2433b4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23c0cfa90 con 0x7fb23c0d4170 2024-04-14T09:59:07.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb2433b4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c15e9b0 con 0x7fb23c0d1860 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb241150640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb23c15e5d0 0x7fb23c0cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37760/0 (socket says 172.21.15.40:37760) 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb241150640 1 -- 172.21.15.40:0/3955618311 learned_addr learned my addr 172.21.15.40:0/3955618311 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.479+0000 7fb241951640 1 --2- 172.21.15.40:0/3955618311 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 0x7fb23c169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230631066 0 0) 0x7fb23c0cf7b0 con 0x7fb23c15e5d0 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb224003520 con 0x7fb23c15e5d0 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1332445410 0 0) 0x7fb23c0cfa90 con 0x7fb23c0d4170 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb23c0cf7b0 con 0x7fb23c0d4170 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb241951640 1 -- 172.21.15.40:0/3955618311 >> v1:172.21.15.136:6789/0 conn(0x7fb23c0d4170 legacy=0x7fb23c0d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb241951640 1 -- 172.21.15.40:0/3955618311 >> v1:172.21.15.40:6789/0 conn(0x7fb23c15e5d0 legacy=0x7fb23c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb241951640 1 -- 172.21.15.40:0/3955618311 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0cfd70 con 0x7fb23c0d1860 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.480+0000 7fb241951640 1 --2- 172.21.15.40:0/3955618311 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 0x7fb23c169360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009dc0 tx=0x7fb22c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d85896c05ec3838d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c039070 con 0x7fb23c0d1860 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb22c02ccd0 con 0x7fb23c0d1860 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb23bfff640 1 -- 172.21.15.40:0/3955618311 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22c034660 con 0x7fb23c0d1860 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 -- 172.21.15.40:0/3955618311 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 msgr2=0x7fb23c169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 --2- 172.21.15.40:0/3955618311 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 0x7fb23c169360 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009dc0 tx=0x7fb22c02bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 -- 172.21.15.40:0/3955618311 shutdown_connections 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 --2- 172.21.15.40:0/3955618311 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c0d1860 0x7fb23c169360 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 -- 172.21.15.40:0/3955618311 >> 172.21.15.40:0/3955618311 conn(0x7fb23c08dce0 msgr2=0x7fb23c09d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 -- 172.21.15.40:0/3955618311 shutdown_connections 2024-04-14T09:59:07.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.481+0000 7fb2433b4640 1 -- 172.21.15.40:0/3955618311 wait complete. 2024-04-14T09:59:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.482+0000 7fb2433b4640 1 Processor -- start 2024-04-14T09:59:07.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 -- start start 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb23c0d4170 0x7fb23c0b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c15e5d0 0x7fb23c0b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0cf3e0 con 0x7fb23c0d1860 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb23c0d03c0 con 0x7fb23c0d4170 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb2433b4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb23c0cf560 con 0x7fb23c15e5d0 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb241150640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb241150640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43600/0 (socket says 172.21.15.40:43600) 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb241150640 1 -- 172.21.15.40:0/2211152919 learned_addr learned my addr 172.21.15.40:0/2211152919 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb241951640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c15e5d0 0x7fb23c0b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.486 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.483+0000 7fb24094f640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb23c0d4170 0x7fb23c0b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 -- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c15e5d0 msgr2=0x7fb23c0b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c15e5d0 0x7fb23c0b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 -- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb23c0d4170 msgr2=0x7fb23c0b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb23c0d4170 0x7fb23c0b3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 -- 172.21.15.40:0/2211152919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb23c0b3bc0 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb241150640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c410 tx=0x7fb23400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234017070 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234005ce0 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb23c0b3ea0 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2340072d0 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.484+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb23c0b8180 con 0x7fb23c0d1860 2024-04-14T09:59:07.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.485+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb23c0b43c0 con 0x7fb23c0d1860 2024-04-14T09:59:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.486+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb23401a070 con 0x7fb23c0d1860 2024-04-14T09:59:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.486+0000 7fb239ffb640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 0x7fb22806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.486+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb23408b240 con 0x7fb23c0d1860 2024-04-14T09:59:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.486+0000 7fb24094f640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 0x7fb22806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.487+0000 7fb24094f640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 0x7fb22806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb230007fd0 tx=0x7fb230009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.491+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb23c0b43c0 con 0x7fb23c0d1860 2024-04-14T09:59:07.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.674+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb23c075760 con 0x7fb23c0d1860 2024-04-14T09:59:07.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.675+0000 7fb239ffb640 1 -- 172.21.15.40:0/2211152919 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb234058c20 con 0x7fb23c0d1860 2024-04-14T09:59:07.675 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 msgr2=0x7fb22806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 0x7fb22806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb230007fd0 tx=0x7fb230009040 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 msgr2=0x7fb23c14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb23400c410 tx=0x7fb23400c8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 shutdown_connections 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb22806c8f0 0x7fb22806edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb23c15e5d0 0x7fb23c0b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb23c0d4170 0x7fb23c0b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 --2- 172.21.15.40:0/2211152919 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb23c0d1860 0x7fb23c14dfd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 >> 172.21.15.40:0/2211152919 conn(0x7fb23c08dce0 msgr2=0x7fb23c15eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 shutdown_connections 2024-04-14T09:59:07.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.677+0000 7fb2433b4640 1 -- 172.21.15.40:0/2211152919 wait complete. 2024-04-14T09:59:07.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:07.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.789+0000 7f40cbd5e640 1 Processor -- start 2024-04-14T09:59:07.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.789+0000 7f40cbd5e640 1 -- start start 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40cbd5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40c40d2f10 0x7f40c40cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40cbd5e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c40ceda0 con 0x7f40c415e510 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40cbd5e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40c40cf040 con 0x7f40c40d0e90 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40cbd5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f40c40d19c0 con 0x7f40c40d2f10 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40c92f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f40c40d2f10 0x7f40c40cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40c9afa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f40c415e510 0x7f40c40d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37772/0 (socket says 172.21.15.40:37772) 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.790+0000 7f40c9afa640 1 -- 172.21.15.40:0/1277541195 learned_addr learned my addr 172.21.15.40:0/1277541195 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c92f9640 1 -- 172.21.15.40:0/1277541195 >> v1:172.21.15.136:6789/0 conn(0x7f40c40d0e90 legacy=0x7f40c40d12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c92f9640 1 -- 172.21.15.40:0/1277541195 >> v1:172.21.15.40:6789/0 conn(0x7f40c415e510 legacy=0x7f40c40d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c92f9640 1 -- 172.21.15.40:0/1277541195 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c40cf320 con 0x7f40c40d2f10 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c92f9640 1 --2- 172.21.15.40:0/1277541195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40cfe00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c66413388ec922b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c8af8640 1 -- 172.21.15.40:0/1277541195 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4035020 con 0x7f40c40d2f10 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c8af8640 1 -- 172.21.15.40:0/1277541195 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b4031830 con 0x7f40c40d2f10 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.791+0000 7f40c8af8640 1 -- 172.21.15.40:0/1277541195 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4031c00 con 0x7f40c40d2f10 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 -- 172.21.15.40:0/1277541195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 msgr2=0x7f40c40cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/1277541195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40cfe00 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097a0 tx=0x7f40b402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 -- 172.21.15.40:0/1277541195 shutdown_connections 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/1277541195 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40cfe00 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 -- 172.21.15.40:0/1277541195 >> 172.21.15.40:0/1277541195 conn(0x7f40c409d570 msgr2=0x7f40c40d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 -- 172.21.15.40:0/1277541195 shutdown_connections 2024-04-14T09:59:07.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.792+0000 7f40cbd5e640 1 -- 172.21.15.40:0/1277541195 wait complete. 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.793+0000 7f40cbd5e640 1 Processor -- start 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.793+0000 7f40cbd5e640 1 -- start start 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0e90 0x7f40c4153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40c415e510 0x7f40c40b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f40c40b3ad0 con 0x7f40c40d2f10 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40c415e8f0 con 0x7f40c40d0e90 2024-04-14T09:59:07.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40cbd5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f40c40b3c50 con 0x7f40c415e510 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43614/0 (socket says 172.21.15.40:43614) 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 -- 172.21.15.40:0/2144448846 learned_addr learned my addr 172.21.15.40:0/2144448846 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c9afa640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0e90 0x7f40c4153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40ca2fb640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40c415e510 0x7f40c40b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 -- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40c415e510 msgr2=0x7f40c40b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40c415e510 0x7f40c40b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 -- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0e90 msgr2=0x7f40c4153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0e90 0x7f40c4153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 -- 172.21.15.40:0/2144448846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40c4153ac0 con 0x7f40c40d2f10 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.794+0000 7f40c92f9640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f40b402bee0 tx=0x7f40b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.795+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4041070 con 0x7f40c40d2f10 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.795+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40b403a950 con 0x7f40c40d2f10 2024-04-14T09:59:07.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.795+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40c40cd7a0 con 0x7f40c40d2f10 2024-04-14T09:59:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.795+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40b4035040 con 0x7f40c40d2f10 2024-04-14T09:59:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.795+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40c40cdd60 con 0x7f40c40d2f10 2024-04-14T09:59:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.796+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40c4068e00 con 0x7f40c40d2f10 2024-04-14T09:59:07.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.796+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f40b4038020 con 0x7f40c40d2f10 2024-04-14T09:59:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.796+0000 7f40ba7fc640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.797+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f40b40ad8a0 con 0x7f40c40d2f10 2024-04-14T09:59:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.797+0000 7f40c9afa640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:07.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.797+0000 7f40c9afa640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000f60 tx=0x7f40c0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:07.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.801+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f40c4068e00 con 0x7f40c40d2f10 2024-04-14T09:59:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.988+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40c40b5130 con 0x7f40c40d2f10 2024-04-14T09:59:07.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.989+0000 7f40ba7fc640 1 -- 172.21.15.40:0/2144448846 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7f40b407b310 con 0x7f40c40d2f10 2024-04-14T09:59:07.990 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:07.990 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 msgr2=0x7f40a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 0x7f40a806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40c0000f60 tx=0x7f40c0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 msgr2=0x7f40c40ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f40b402bee0 tx=0x7f40b40046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 shutdown_connections 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f40a806c8f0 0x7f40a806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40c415e510 0x7f40c40b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40c40d2f10 0x7f40c40ccea0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 --2- 172.21.15.40:0/2144448846 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f40c40d0e90 0x7f40c4153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 >> 172.21.15.40:0/2144448846 conn(0x7f40c409d570 msgr2=0x7f40c406d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 shutdown_connections 2024-04-14T09:59:07.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:07.991+0000 7f40cbd5e640 1 -- 172.21.15.40:0/2144448846 wait complete. 2024-04-14T09:59:08.003 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:08.003 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:08.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 Processor -- start 2024-04-14T09:59:08.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 -- start start 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 0x7f0f780d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f780d2f30 con 0x7f0f7815e7b0 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0f780cf000 con 0x7f0f780c7e30 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.107+0000 7f0f7efaa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780cf2e0 con 0x7f0f7815e3d0 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7d547640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f0f7815e7b0 0x7f0f780d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37782/0 (socket says 172.21.15.40:37782) 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7d547640 1 -- 172.21.15.40:0/1476045531 learned_addr learned my addr 172.21.15.40:0/1476045531 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f77fff640 1 --2- 172.21.15.40:0/1476045531 >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 0x7f0f780d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/1476045531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906535551 0 0) 0x7f0f780d2f30 con 0x7f0f7815e7b0 2024-04-14T09:59:08.109 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f68003520 con 0x7f0f7815e7b0 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1380250422 0 0) 0x7f0f68003520 con 0x7f0f7815e7b0 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7cd46640 1 -- 172.21.15.40:0/1476045531 >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 msgr2=0x7f0f780d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/1476045531 >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 0x7f0f780d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7cd46640 1 -- 172.21.15.40:0/1476045531 >> v1:172.21.15.40:6789/0 conn(0x7f0f7815e7b0 legacy=0x7f0f780d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f7cd46640 1 -- 172.21.15.40:0/1476045531 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f780cf5c0 con 0x7f0f7815e3d0 2024-04-14T09:59:08.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.108+0000 7f0f77fff640 1 --2- 172.21.15.40:0/1476045531 >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 0x7f0f780d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.109+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/1476045531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780d4030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0097a0 tx=0x7f0f6c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0014ccf0ab1e928 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.109+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c037070 con 0x7f0f7815e3d0 2024-04-14T09:59:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.109+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f6c030510 con 0x7f0f7815e3d0 2024-04-14T09:59:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.109+0000 7f0f777fe640 1 -- 172.21.15.40:0/1476045531 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700019f0 con 0x7f0f7815e3d0 2024-04-14T09:59:08.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 -- 172.21.15.40:0/1476045531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 msgr2=0x7f0f780d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/1476045531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780d4030 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0097a0 tx=0x7f0f6c02b790 comp rx=0 tx=0).stop 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 -- 172.21.15.40:0/1476045531 shutdown_connections 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/1476045531 >> v2:172.21.15.136:3300/0 conn(0x7f0f780c7e30 0x7f0f780d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/1476045531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780d4030 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 -- 172.21.15.40:0/1476045531 >> 172.21.15.40:0/1476045531 conn(0x7f0f7808dc90 msgr2=0x7f0f7809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 -- 172.21.15.40:0/1476045531 shutdown_connections 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.110+0000 7f0f7efaa640 1 -- 172.21.15.40:0/1476045531 wait complete. 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.111+0000 7f0f7efaa640 1 Processor -- start 2024-04-14T09:59:08.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.111+0000 7f0f7efaa640 1 -- start start 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f780c7e30 0x7f0f78160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d2a00 con 0x7f0f7815e7b0 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0f780d2880 con 0x7f0f780c7e30 2024-04-14T09:59:08.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7efaa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0f780d2b80 con 0x7f0f7815e3d0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43620/0 (socket says 172.21.15.40:43620) 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 -- 172.21.15.40:0/3777376374 learned_addr learned my addr 172.21.15.40:0/3777376374 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f77fff640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f780c7e30 0x7f0f78160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 -- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 msgr2=0x7f0f780c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 -- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f780c7e30 msgr2=0x7f0f78160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f780c7e30 0x7f0f78160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 -- 172.21.15.40:0/3777376374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f781e9b30 con 0x7f0f7815e7b0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f77fff640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f7d547640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000cc00 tx=0x7f0f7000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.112+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f7000ce10 con 0x7f0f7815e7b0 2024-04-14T09:59:08.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.113+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f70012400 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.113+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f700127f0 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.113+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f780cbbe0 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.113+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f780cc160 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.113+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f78075760 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.114+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f70012990 con 0x7f0f7815e7b0 2024-04-14T09:59:08.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.114+0000 7f0f757fa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 0x7f0f5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.114+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0f7008c4d0 con 0x7f0f7815e7b0 2024-04-14T09:59:08.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.114+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 0x7f0f5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.115+0000 7f0f7cd46640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 0x7f0f5c06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c034000 tx=0x7f0f6c02f000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.119 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.119+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0f70059f40 con 0x7f0f7815e7b0 2024-04-14T09:59:08.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.300+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0f780cb170 con 0x7f0f7815e7b0 2024-04-14T09:59:08.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.300+0000 7f0f757fa640 1 -- 172.21.15.40:0/3777376374 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f0f7005e240 con 0x7f0f7815e7b0 2024-04-14T09:59:08.301 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 msgr2=0x7f0f5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 0x7f0f5c06edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c034000 tx=0x7f0f6c02f000 comp rx=0 tx=0).stop 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 msgr2=0x7f0f780c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000cc00 tx=0x7f0f7000a430 comp rx=0 tx=0).stop 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 shutdown_connections 2024-04-14T09:59:08.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0f5c06c8f0 0x7f0f5c06edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0f7815e7b0 0x7f0f780c6f60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0f7815e3d0 0x7f0f780c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 --2- 172.21.15.40:0/3777376374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0f780c7e30 0x7f0f78160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 >> 172.21.15.40:0/3777376374 conn(0x7f0f7808dc90 msgr2=0x7f0f7806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 shutdown_connections 2024-04-14T09:59:08.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.302+0000 7f0f7efaa640 1 -- 172.21.15.40:0/3777376374 wait complete. 2024-04-14T09:59:08.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:08.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 Processor -- start 2024-04-14T09:59:08.419 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 -- start start 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f51d009b150 0x7f51d00d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51d00d0970 0x7f51d00d0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51d006cc40 con 0x7f51d0071020 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f51d00ce4a0 con 0x7f51d00d0970 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.418+0000 7f51d551e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f51d006c960 con 0x7f51d009b150 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51cf7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f51d00d0970 0x7f51d00d0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51ceffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f51d0071020 0x7f51d009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37798/0 (socket says 172.21.15.40:37798) 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51ceffd640 1 -- 172.21.15.40:0/2466455356 learned_addr learned my addr 172.21.15.40:0/2466455356 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51ce7fc640 1 --2- 172.21.15.40:0/2466455356 >> v2:172.21.15.136:3300/0 conn(0x7f51d009b150 0x7f51d00d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51cf7fe640 1 -- 172.21.15.40:0/2466455356 >> v2:172.21.15.136:3300/0 conn(0x7f51d009b150 msgr2=0x7f51d00d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51cf7fe640 1 --2- 172.21.15.40:0/2466455356 >> v2:172.21.15.136:3300/0 conn(0x7f51d009b150 0x7f51d00d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51cf7fe640 1 -- 172.21.15.40:0/2466455356 >> v1:172.21.15.40:6789/0 conn(0x7f51d0071020 legacy=0x7f51d009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.419+0000 7f51cf7fe640 1 -- 172.21.15.40:0/2466455356 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d00cc6d0 con 0x7f51d00d0970 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51cf7fe640 1 --2- 172.21.15.40:0/2466455356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00d0e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51d0068300 tx=0x7f51c802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0527c6b2d9145d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51cdffb640 1 -- 172.21.15.40:0/2466455356 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8039070 con 0x7f51d00d0970 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51cdffb640 1 -- 172.21.15.40:0/2466455356 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c802cd00 con 0x7f51d00d0970 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51cdffb640 1 -- 172.21.15.40:0/2466455356 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8034660 con 0x7f51d00d0970 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 -- 172.21.15.40:0/2466455356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 msgr2=0x7f51d00d0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 --2- 172.21.15.40:0/2466455356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00d0e20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f51d0068300 tx=0x7f51c802bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 -- 172.21.15.40:0/2466455356 shutdown_connections 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 --2- 172.21.15.40:0/2466455356 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00d0e20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 --2- 172.21.15.40:0/2466455356 >> v2:172.21.15.136:3300/0 conn(0x7f51d009b150 0x7f51d00d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 -- 172.21.15.40:0/2466455356 >> 172.21.15.40:0/2466455356 conn(0x7f51d00b3ad0 msgr2=0x7f51d00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.422 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 -- 172.21.15.40:0/2466455356 shutdown_connections 2024-04-14T09:59:08.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.420+0000 7f51d551e640 1 -- 172.21.15.40:0/2466455356 wait complete. 2024-04-14T09:59:08.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 Processor -- start 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 -- start start 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51d0071020 0x7f51d01e1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51d009b150 0x7f51d01e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f51d00ccf70 con 0x7f51d00d0970 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f51d00ccc90 con 0x7f51d009b150 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.422+0000 7f51d551e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f51d006db50 con 0x7f51d0071020 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43644/0 (socket says 172.21.15.40:43644) 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 -- 172.21.15.40:0/1467224003 learned_addr learned my addr 172.21.15.40:0/1467224003 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51ce7fc640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51d009b150 0x7f51d01e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51ceffd640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51d0071020 0x7f51d01e1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 -- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51d0071020 msgr2=0x7f51d01e1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51d0071020 0x7f51d01e1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 -- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51d009b150 msgr2=0x7f51d01e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51d009b150 0x7f51d01e6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 -- 172.21.15.40:0/1467224003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d01e6890 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51cf7fe640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e80 tx=0x7f51c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8039050 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c8045070 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d01e6b70 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8009450 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.423+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d00c9300 con 0x7f51d00d0970 2024-04-14T09:59:08.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.424+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d0075760 con 0x7f51d00d0970 2024-04-14T09:59:08.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.425+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f51c803e850 con 0x7f51d00d0970 2024-04-14T09:59:08.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.425+0000 7f51b77fe640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 0x7f51bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.425+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f51c80aebe0 con 0x7f51d00d0970 2024-04-14T09:59:08.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.425+0000 7f51ceffd640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 0x7f51bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.426+0000 7f51ceffd640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 0x7f51bc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f51c0007fd0 tx=0x7f51c0007e80 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.430+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f51c807c6d0 con 0x7f51d00d0970 2024-04-14T09:59:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.613+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f51d00cf6a0 con 0x7f51d00d0970 2024-04-14T09:59:08.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.614+0000 7f51b77fe640 1 -- 172.21.15.40:0/1467224003 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f51c80809d0 con 0x7f51d00d0970 2024-04-14T09:59:08.614 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 msgr2=0x7f51bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 0x7f51bc06edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f51c0007fd0 tx=0x7f51c0007e80 comp rx=0 tx=0).stop 2024-04-14T09:59:08.616 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 msgr2=0x7f51d00b6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51c8009e80 tx=0x7f51c8004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 shutdown_connections 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f51bc06c8f0 0x7f51bc06edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f51d00d0970 0x7f51d00b6d20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51d009b150 0x7f51d01e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.615+0000 7f51d551e640 1 --2- 172.21.15.40:0/1467224003 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51d0071020 0x7f51d01e1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.616+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 >> 172.21.15.40:0/1467224003 conn(0x7f51d00b3ad0 msgr2=0x7f51d006de90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.616+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 shutdown_connections 2024-04-14T09:59:08.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.616+0000 7f51d551e640 1 -- 172.21.15.40:0/1467224003 wait complete. 2024-04-14T09:59:08.627 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:08.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.731+0000 7ffa356d1640 1 Processor -- start 2024-04-14T09:59:08.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.731+0000 7ffa356d1640 1 -- start start 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa356d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa356d1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3009b150 0x7ffa3006f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa356d1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa300cd810 con 0x7ffa3015fb20 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa356d1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffa3009b9d0 con 0x7ffa3009b150 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa356d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3015ff00 con 0x7ffa300ce660 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3009b150 0x7ffa3006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa3009b150 0x7ffa3006f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43652/0 (socket says 172.21.15.40:43652) 2024-04-14T09:59:08.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2effd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ffa3015fb20 0x7ffa3009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51740/0 (socket says 172.21.15.40:51740) 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/3265552103 learned_addr learned my addr 172.21.15.40:0/3265552103 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2e7fc640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/3265552103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 msgr2=0x7ffa30070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/3265552103 >> v1:172.21.15.136:6789/0 conn(0x7ffa3015fb20 legacy=0x7ffa3009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2dffb640 1 -- 172.21.15.40:0/3265552103 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985122252 0 0) 0x7ffa300cd810 con 0x7ffa3015fb20 2024-04-14T09:59:08.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.732+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/3265552103 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3009b6f0 con 0x7ffa3009b150 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.733+0000 7ffa2f7fe640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3009b150 0x7ffa3006f710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009e50 tx=0x7ffa2002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc13d2f702d5d3b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.733+0000 7ffa2dffb640 1 -- 172.21.15.40:0/3265552103 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa2002cb00 con 0x7ffa3009b150 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.733+0000 7ffa2dffb640 1 -- 172.21.15.40:0/3265552103 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2002cca0 con 0x7ffa3009b150 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.733+0000 7ffa2dffb640 1 -- 172.21.15.40:0/3265552103 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20034610 con 0x7ffa3009b150 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 -- 172.21.15.40:0/3265552103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3009b150 msgr2=0x7ffa3006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3009b150 0x7ffa3006f710 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ffa20009e50 tx=0x7ffa2002bf60 comp rx=0 tx=0).stop 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 -- 172.21.15.40:0/3265552103 shutdown_connections 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3009b150 0x7ffa3006f710 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 --2- 172.21.15.40:0/3265552103 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 -- 172.21.15.40:0/3265552103 >> 172.21.15.40:0/3265552103 conn(0x7ffa300b3be0 msgr2=0x7ffa300b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 -- 172.21.15.40:0/3265552103 shutdown_connections 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.734+0000 7ffa356d1640 1 -- 172.21.15.40:0/3265552103 wait complete. 2024-04-14T09:59:08.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.735+0000 7ffa356d1640 1 Processor -- start 2024-04-14T09:59:08.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.735+0000 7ffa356d1640 1 -- start start 2024-04-14T09:59:08.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 0x7ffa301f40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30154260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa300cdd90 con 0x7ffa3015fb20 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa300d1000 con 0x7ffa3009b150 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa356d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa3006fc50 con 0x7ffa300ce660 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2effd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 0x7ffa301f40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43658/0 (socket says 172.21.15.40:43658) 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/2906638060 learned_addr learned my addr 172.21.15.40:0/2906638060 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2e7fc640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30154260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 msgr2=0x7ffa30154260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30154260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 msgr2=0x7ffa301f40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 0x7ffa301f40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 -- 172.21.15.40:0/2906638060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa301f4850 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2effd640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 0x7ffa301f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.736+0000 7ffa2f7fe640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa20036040 tx=0x7ffa20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.737+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20043020 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.737+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa2002ce50 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.737+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa301f4b30 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.737+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa20009510 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.737+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa301547a0 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.738+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa300cc5b0 con 0x7ffa3015fb20 2024-04-14T09:59:08.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.738+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa20005d10 con 0x7ffa3015fb20 2024-04-14T09:59:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.739+0000 7ffa177fe640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.739+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ffa200ae6f0 con 0x7ffa3015fb20 2024-04-14T09:59:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.739+0000 7ffa2effd640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:08.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.739+0000 7ffa2effd640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:08.743 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.743+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ffa2007c0d0 con 0x7ffa3015fb20 2024-04-14T09:59:08.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.928+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffa30075740 con 0x7ffa3015fb20 2024-04-14T09:59:08.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.929+0000 7ffa177fe640 1 -- 172.21.15.40:0/2906638060 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7ffa200803d0 con 0x7ffa3015fb20 2024-04-14T09:59:08.930 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 msgr2=0x7ffa1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28007de0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 msgr2=0x7ffa30152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7ffa20036040 tx=0x7ffa20004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 shutdown_connections 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa1c06c8f0 0x7ffa1c06edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa3015fb20 0x7ffa30152dd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa300ce660 0x7ffa30154260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 --2- 172.21.15.40:0/2906638060 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa3009b150 0x7ffa301f40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 >> 172.21.15.40:0/2906638060 conn(0x7ffa300b3be0 msgr2=0x7ffa300cf780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 shutdown_connections 2024-04-14T09:59:08.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:08.931+0000 7ffa356d1640 1 -- 172.21.15.40:0/2906638060 wait complete. 2024-04-14T09:59:08.942 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.048+0000 7f075b2ad640 1 Processor -- start 2024-04-14T09:59:09.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.048+0000 7f075b2ad640 1 -- start start 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075b2ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07540b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075b2ad640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 0x7f07540b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075b2ad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07540b54b0 con 0x7f07540af930 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075b2ad640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f07540d10f0 con 0x7f07540b1e60 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075b2ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f07540b27d0 con 0x7f075415c2b0 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0758848640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f07540af930 0x7f07540d09e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37802/0 (socket says 172.21.15.40:37802) 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0758848640 1 -- 172.21.15.40:0/1658895540 learned_addr learned my addr 172.21.15.40:0/1658895540 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0759049640 1 --2- 172.21.15.40:0/1658895540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07540b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075984a640 1 --2- 172.21.15.40:0/1658895540 >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 0x7f07540b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f074bfff640 1 -- 172.21.15.40:0/1658895540 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645674565 0 0) 0x7f07540b54b0 con 0x7f07540af930 2024-04-14T09:59:09.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f074bfff640 1 -- 172.21.15.40:0/1658895540 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0740003520 con 0x7f07540af930 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0759049640 1 -- 172.21.15.40:0/1658895540 >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 msgr2=0x7f07540b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0759049640 1 --2- 172.21.15.40:0/1658895540 >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 0x7f07540b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0759049640 1 -- 172.21.15.40:0/1658895540 >> v1:172.21.15.40:6789/0 conn(0x7f07540af930 legacy=0x7f07540d09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f0759049640 1 -- 172.21.15.40:0/1658895540 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07540ad250 con 0x7f075415c2b0 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.049+0000 7f075984a640 1 --2- 172.21.15.40:0/1658895540 >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 0x7f07540b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.050+0000 7f0759049640 1 --2- 172.21.15.40:0/1658895540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07540b4f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07500097a0 tx=0x7f075002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40001f60101879ff server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.050+0000 7f074bfff640 1 -- 172.21.15.40:0/1658895540 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07500315a0 con 0x7f075415c2b0 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.050+0000 7f074bfff640 1 -- 172.21.15.40:0/1658895540 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0750037070 con 0x7f075415c2b0 2024-04-14T09:59:09.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.050+0000 7f074bfff640 1 -- 172.21.15.40:0/1658895540 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0750031940 con 0x7f075415c2b0 2024-04-14T09:59:09.056 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 -- 172.21.15.40:0/1658895540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 msgr2=0x7f07540b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 --2- 172.21.15.40:0/1658895540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07540b4f70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07500097a0 tx=0x7f075002b840 comp rx=0 tx=0).stop 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 -- 172.21.15.40:0/1658895540 shutdown_connections 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 --2- 172.21.15.40:0/1658895540 >> v2:172.21.15.136:3300/0 conn(0x7f07540b1e60 0x7f07540b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 --2- 172.21.15.40:0/1658895540 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07540b4f70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 -- 172.21.15.40:0/1658895540 >> 172.21.15.40:0/1658895540 conn(0x7f07540b56f0 msgr2=0x7f07540b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 -- 172.21.15.40:0/1658895540 shutdown_connections 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.051+0000 7f075b2ad640 1 -- 172.21.15.40:0/1658895540 wait complete. 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.052+0000 7f075b2ad640 1 Processor -- start 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.052+0000 7f075b2ad640 1 -- start start 2024-04-14T09:59:09.057 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07540af930 0x7f075415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07541f2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f07540d01e0 con 0x7f07540b1e60 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f07540ad810 con 0x7f07540af930 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f07540d04c0 con 0x7f075415c2b0 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43670/0 (socket says 172.21.15.40:43670) 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 -- 172.21.15.40:0/3126675414 learned_addr learned my addr 172.21.15.40:0/3126675414 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075984a640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07541f2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0759049640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07540af930 0x7f075415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.058 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 -- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 msgr2=0x7f07541f2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07541f2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 -- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07540af930 msgr2=0x7f075415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07540af930 0x7f075415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 -- 172.21.15.40:0/3126675414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07541f33a0 con 0x7f07540b1e60 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0758848640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f074400c390 tx=0x7f074400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0744017070 con 0x7f07540b1e60 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0744005ce0 con 0x7f07540b1e60 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f075415a500 con 0x7f07540b1e60 2024-04-14T09:59:09.059 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.053+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07440072f0 con 0x7f07540b1e60 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.054+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f075415ada0 con 0x7f07540b1e60 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.055+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f075415a8f0 con 0x7f07540b1e60 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.055+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f074401a070 con 0x7f07540b1e60 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.055+0000 7f0749ffb640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 0x7f073806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.055+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f074408b250 con 0x7f07540b1e60 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.055+0000 7f0759049640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 0x7f073806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.056+0000 7f0759049640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 0x7f073806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0750036000 tx=0x7f075003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.061 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.060+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f07541f33a0 con 0x7f07540b1e60 2024-04-14T09:59:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.243+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0754075760 con 0x7f07540b1e60 2024-04-14T09:59:09.243 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.243+0000 7f0749ffb640 1 -- 172.21.15.40:0/3126675414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f0744058bb0 con 0x7f07540b1e60 2024-04-14T09:59:09.244 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 msgr2=0x7f073806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 0x7f073806edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0750036000 tx=0x7f075003d040 comp rx=0 tx=0).stop 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 msgr2=0x7f07540cf300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f074400c390 tx=0x7f074400c790 comp rx=0 tx=0).stop 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 shutdown_connections 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f073806c8f0 0x7f073806edb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f075415c2b0 0x7f07541f2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f07540b1e60 0x7f07540cf300 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 --2- 172.21.15.40:0/3126675414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f07540af930 0x7f075415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 >> 172.21.15.40:0/3126675414 conn(0x7f07540b56f0 msgr2=0x7f075415cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 shutdown_connections 2024-04-14T09:59:09.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.245+0000 7f075b2ad640 1 -- 172.21.15.40:0/3126675414 wait complete. 2024-04-14T09:59:09.257 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:09.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 Processor -- start 2024-04-14T09:59:09.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 -- start start 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e00b3760 0x7fd7e00b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7e006bec0 0x7fd7e006c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7e015f510 con 0x7fd7e01414e0 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd7e015f7f0 con 0x7fd7e006bec0 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.358+0000 7fd7e5220640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e006b6c0 con 0x7fd7e00b3760 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7e006bec0 0x7fd7e006c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd7e006bec0 0x7fd7e006c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43678/0 (socket says 172.21.15.40:43678) 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 -- 172.21.15.40:0/1224052245 learned_addr learned my addr 172.21.15.40:0/1224052245 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7ded9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd7e01414e0 0x7fd7e015eb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37806/0 (socket says 172.21.15.40:37806) 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7de59c640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e00b3760 0x7fd7e00b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 -- 172.21.15.40:0/1224052245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e00b3760 msgr2=0x7fd7e00b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e00b3760 0x7fd7e00b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 -- 172.21.15.40:0/1224052245 >> v1:172.21.15.40:6789/0 conn(0x7fd7e01414e0 legacy=0x7fd7e015eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7df59e640 1 -- 172.21.15.40:0/1224052245 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e015f210 con 0x7fd7e006bec0 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.359+0000 7fd7ddd9b640 1 -- 172.21.15.40:0/1224052245 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2212264420 0 0) 0x7fd7e015f510 con 0x7fd7e01414e0 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7df59e640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e006bec0 0x7fd7e006c350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e50 tx=0x7fd7d802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f093ba80232731e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7ddd9b640 1 -- 172.21.15.40:0/1224052245 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d802cb00 con 0x7fd7e006bec0 2024-04-14T09:59:09.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7ddd9b640 1 -- 172.21.15.40:0/1224052245 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d802cca0 con 0x7fd7e006bec0 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7ddd9b640 1 -- 172.21.15.40:0/1224052245 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d8034610 con 0x7fd7e006bec0 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 -- 172.21.15.40:0/1224052245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e006bec0 msgr2=0x7fd7e006c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e006bec0 0x7fd7e006c350 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009e50 tx=0x7fd7d802bf60 comp rx=0 tx=0).stop 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 -- 172.21.15.40:0/1224052245 shutdown_connections 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e006bec0 0x7fd7e006c350 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 --2- 172.21.15.40:0/1224052245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e00b3760 0x7fd7e00b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 -- 172.21.15.40:0/1224052245 >> 172.21.15.40:0/1224052245 conn(0x7fd7e00d0790 msgr2=0x7fd7e00d0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 -- 172.21.15.40:0/1224052245 shutdown_connections 2024-04-14T09:59:09.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.360+0000 7fd7e5220640 1 -- 172.21.15.40:0/1224052245 wait complete. 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 Processor -- start 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 -- start start 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e006bec0 0x7fd7e01566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7e01414e0 0x7fd7e00b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e006da40 con 0x7fd7e00b3760 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd7e006d8c0 con 0x7fd7e01414e0 2024-04-14T09:59:09.366 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.362+0000 7fd7e5220640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd7e00b43e0 con 0x7fd7e006bec0 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43692/0 (socket says 172.21.15.40:43692) 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 -- 172.21.15.40:0/3554343591 learned_addr learned my addr 172.21.15.40:0/3554343591 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7ded9d640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e006bec0 0x7fd7e01566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7df59e640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7e01414e0 0x7fd7e00b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 -- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e006bec0 msgr2=0x7fd7e01566b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e006bec0 0x7fd7e01566b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 -- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7e01414e0 msgr2=0x7fd7e00b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7e01414e0 0x7fd7e00b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 -- 172.21.15.40:0/3554343591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7e0143c20 con 0x7fd7e00b3760 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7de59c640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e9e0 tx=0x7fd7d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d4017070 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd7d400c9d0 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7e0143f00 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7d400cdc0 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.363+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7e01444c0 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.364+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7e00756f0 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.365+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd7d401a070 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.365+0000 7fd7c77fe640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 0x7fd7cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.365+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd7d408c240 con 0x7fd7e00b3760 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.365+0000 7fd7ded9d640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 0x7fd7cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.368 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.366+0000 7fd7ded9d640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 0x7fd7cc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0007fd0 tx=0x7fd7d0007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.370+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd7d4059c20 con 0x7fd7e00b3760 2024-04-14T09:59:09.558 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.557+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd7e00b5c00 con 0x7fd7e00b3760 2024-04-14T09:59:09.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.558+0000 7fd7c77fe640 1 -- 172.21.15.40:0/3554343591 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fd7d405df20 con 0x7fd7e00b3760 2024-04-14T09:59:09.560 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:09.560 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 msgr2=0x7fd7cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 0x7fd7cc06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0007fd0 tx=0x7fd7d0007de0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 msgr2=0x7fd7e00af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd7d400e9e0 tx=0x7fd7d400eea0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 shutdown_connections 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd7cc06c8f0 0x7fd7cc06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd7e01414e0 0x7fd7e00b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd7e00b3760 0x7fd7e00af310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 --2- 172.21.15.40:0/3554343591 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd7e006bec0 0x7fd7e01566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 >> 172.21.15.40:0/3554343591 conn(0x7fd7e00d0790 msgr2=0x7fd7e00cc950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 shutdown_connections 2024-04-14T09:59:09.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.561+0000 7fd7e5220640 1 -- 172.21.15.40:0/3554343591 wait complete. 2024-04-14T09:59:09.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:09.574 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.680+0000 7f5292e1c640 1 Processor -- start 2024-04-14T09:59:09.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 -- start start 2024-04-14T09:59:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f528c161c80 0x7f528c0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 0x7f528c0b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f528c0b10e0 con 0x7f528c0d2e50 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f528c0b1380 con 0x7f528c161c80 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f5292e1c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0b1660 con 0x7f528c0d13d0 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f528bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f528c0d2e50 0x7f528c0d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37816/0 (socket says 172.21.15.40:37816) 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.681+0000 7f528bfff640 1 -- 172.21.15.40:0/1308190439 learned_addr learned my addr 172.21.15.40:0/1308190439 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f52913b9640 1 --2- 172.21.15.40:0/1308190439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 0x7f528c0b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f5290bb8640 1 --2- 172.21.15.40:0/1308190439 >> v2:172.21.15.136:3300/0 conn(0x7f528c161c80 0x7f528c0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f528b7fe640 1 -- 172.21.15.40:0/1308190439 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97741036 0 0) 0x7f528c0b10e0 con 0x7f528c0d2e50 2024-04-14T09:59:09.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f528b7fe640 1 -- 172.21.15.40:0/1308190439 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c003520 con 0x7f528c0d2e50 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f52913b9640 1 -- 172.21.15.40:0/1308190439 >> v2:172.21.15.136:3300/0 conn(0x7f528c161c80 msgr2=0x7f528c0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f52913b9640 1 --2- 172.21.15.40:0/1308190439 >> v2:172.21.15.136:3300/0 conn(0x7f528c161c80 0x7f528c0d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f52913b9640 1 -- 172.21.15.40:0/1308190439 >> v1:172.21.15.40:6789/0 conn(0x7f528c0d2e50 legacy=0x7f528c0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.682+0000 7f52913b9640 1 -- 172.21.15.40:0/1308190439 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c0d3340 con 0x7f528c0d13d0 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f52913b9640 1 --2- 172.21.15.40:0/1308190439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 0x7f528c0b1e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=323fc07e25eed543 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f528b7fe640 1 -- 172.21.15.40:0/1308190439 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284039070 con 0x7f528c0d13d0 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f528b7fe640 1 -- 172.21.15.40:0/1308190439 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f528402cbc0 con 0x7f528c0d13d0 2024-04-14T09:59:09.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f528b7fe640 1 -- 172.21.15.40:0/1308190439 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5284034440 con 0x7f528c0d13d0 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 -- 172.21.15.40:0/1308190439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 msgr2=0x7f528c0b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 --2- 172.21.15.40:0/1308190439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 0x7f528c0b1e60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5284009d90 tx=0x7f528402be10 comp rx=0 tx=0).stop 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 -- 172.21.15.40:0/1308190439 shutdown_connections 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 --2- 172.21.15.40:0/1308190439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c0d13d0 0x7f528c0b1e60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 --2- 172.21.15.40:0/1308190439 >> v2:172.21.15.136:3300/0 conn(0x7f528c161c80 0x7f528c0d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 -- 172.21.15.40:0/1308190439 >> 172.21.15.40:0/1308190439 conn(0x7f528c09d5e0 msgr2=0x7f528c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 -- 172.21.15.40:0/1308190439 shutdown_connections 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.683+0000 7f5292e1c640 1 -- 172.21.15.40:0/1308190439 wait complete. 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.684+0000 7f5292e1c640 1 Processor -- start 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 -- start start 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f528c0d13d0 0x7f528c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c161c80 0x7f528c0ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f528c0b23a0 con 0x7f528c0d2e50 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f528c0d0390 con 0x7f528c0d13d0 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.685+0000 7f5292e1c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f528c0b2520 con 0x7f528c161c80 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f5290bb8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f528c0d13d0 0x7f528c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43704/0 (socket says 172.21.15.40:43704) 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 -- 172.21.15.40:0/3288241329 learned_addr learned my addr 172.21.15.40:0/3288241329 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f52913b9640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c161c80 0x7f528c0ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 -- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c161c80 msgr2=0x7f528c0ca990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c161c80 0x7f528c0ca990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 -- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f528c0d13d0 msgr2=0x7f528c0cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f528c0d13d0 0x7f528c0cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 -- 172.21.15.40:0/3288241329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c0cce20 con 0x7f528c0d2e50 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f528bfff640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f527800c400 tx=0x7f527800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278017070 con 0x7f528c0d2e50 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5278005d00 con 0x7f528c0d2e50 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c0cd100 con 0x7f528c0d2e50 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278007310 con 0x7f528c0d2e50 2024-04-14T09:59:09.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.686+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c0cd6c0 con 0x7f528c0d2e50 2024-04-14T09:59:09.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.687+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c075760 con 0x7f528c0d2e50 2024-04-14T09:59:09.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.688+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f527801a070 con 0x7f528c0d2e50 2024-04-14T09:59:09.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.688+0000 7f52897fa640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 0x7f527006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.688+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f527808b270 con 0x7f528c0d2e50 2024-04-14T09:59:09.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.688+0000 7f5290bb8640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 0x7f527006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.692 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.689+0000 7f5290bb8640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 0x7f527006ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5280009aa0 tx=0x7f5280009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.693+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5278058ce0 con 0x7f528c0d2e50 2024-04-14T09:59:09.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.875+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f528c160550 con 0x7f528c0d2e50 2024-04-14T09:59:09.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.875+0000 7f52897fa640 1 -- 172.21.15.40:0/3288241329 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f527805cfe0 con 0x7f528c0d2e50 2024-04-14T09:59:09.876 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 msgr2=0x7f527006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 0x7f527006ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5280009aa0 tx=0x7f5280009190 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 msgr2=0x7f528c14e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f527800c400 tx=0x7f527800c8c0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 shutdown_connections 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f527006c920 0x7f527006ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f528c161c80 0x7f528c0ca990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f528c0d2e50 0x7f528c14e690 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 --2- 172.21.15.40:0/3288241329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f528c0d13d0 0x7f528c0cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 >> 172.21.15.40:0/3288241329 conn(0x7f528c09d5e0 msgr2=0x7f528c0d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 shutdown_connections 2024-04-14T09:59:09.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.877+0000 7f5292e1c640 1 -- 172.21.15.40:0/3288241329 wait complete. 2024-04-14T09:59:09.889 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.992+0000 7efecf5ed640 1 Processor -- start 2024-04-14T09:59:09.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 -- start start 2024-04-14T09:59:09.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 0x7efec80d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efec80d2e50 0x7efec80d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efec80d1200 0x7efec80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7efec80b10e0 con 0x7efec80d1200 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efec80b1380 con 0x7efec80d2e50 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.993+0000 7efecf5ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efec80b1660 con 0x7efec8161c80 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efec80d1200 0x7efec80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efec80d1200 0x7efec80cef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43706/0 (socket says 172.21.15.40:43706) 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 -- 172.21.15.40:0/3549099914 learned_addr learned my addr 172.21.15.40:0/3549099914 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecd389640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 0x7efec80d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efeccb88640 1 --2- 172.21.15.40:0/3549099914 >> v2:172.21.15.136:3300/0 conn(0x7efec80d2e50 0x7efec80d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 -- 172.21.15.40:0/3549099914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 msgr2=0x7efec80d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 0x7efec80d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 -- 172.21.15.40:0/3549099914 >> v2:172.21.15.136:3300/0 conn(0x7efec80d2e50 msgr2=0x7efec80d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 --2- 172.21.15.40:0/3549099914 >> v2:172.21.15.136:3300/0 conn(0x7efec80d2e50 0x7efec80d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecdb8a640 1 -- 172.21.15.40:0/3549099914 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80d3340 con 0x7efec80d1200 2024-04-14T09:59:09.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.994+0000 7efecd389640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 0x7efec80d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecdb8a640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d1200 0x7efec80cef20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efec0009e50 tx=0x7efec002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d53c64418ae261a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efebffff640 1 -- 172.21.15.40:0/3549099914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec002c9e0 con 0x7efec80d1200 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efebffff640 1 -- 172.21.15.40:0/3549099914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efec002cb80 con 0x7efec80d1200 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efebffff640 1 -- 172.21.15.40:0/3549099914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efec00343f0 con 0x7efec80d1200 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 -- 172.21.15.40:0/3549099914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d1200 msgr2=0x7efec80cef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:09.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d1200 0x7efec80cef20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7efec0009e50 tx=0x7efec002be40 comp rx=0 tx=0).stop 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 -- 172.21.15.40:0/3549099914 shutdown_connections 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d1200 0x7efec80cef20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 --2- 172.21.15.40:0/3549099914 >> v2:172.21.15.136:3300/0 conn(0x7efec80d2e50 0x7efec80d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 --2- 172.21.15.40:0/3549099914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec8161c80 0x7efec80d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 -- 172.21.15.40:0/3549099914 >> 172.21.15.40:0/3549099914 conn(0x7efec809d5e0 msgr2=0x7efec80d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 -- 172.21.15.40:0/3549099914 shutdown_connections 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.995+0000 7efecf5ed640 1 -- 172.21.15.40:0/3549099914 wait complete. 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.996+0000 7efecf5ed640 1 Processor -- start 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 -- start start 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 0x7efec8154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec8161c80 0x7efec80c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efec80cf460 con 0x7efec80d2e50 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efec80d0390 con 0x7efec8161c80 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecf5ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efec80cf5e0 con 0x7efec80d1200 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efeccb88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efeccb88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43708/0 (socket says 172.21.15.40:43708) 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efeccb88640 1 -- 172.21.15.40:0/1998554732 learned_addr learned my addr 172.21.15.40:0/1998554732 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecd389640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 0x7efec8154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.997+0000 7efecdb8a640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec8161c80 0x7efec80c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 -- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 msgr2=0x7efec8154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 0x7efec8154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 -- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec8161c80 msgr2=0x7efec80c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec8161c80 0x7efec80c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 -- 172.21.15.40:0/1998554732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec80cb220 con 0x7efec80d2e50 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efecd389640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 0x7efec8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:10.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efeccb88640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e890 tx=0x7efeb800ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb8017070 con 0x7efec80d2e50 2024-04-14T09:59:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeb800c940 con 0x7efec80d2e50 2024-04-14T09:59:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeb800cd10 con 0x7efec80d2e50 2024-04-14T09:59:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efec80ca610 con 0x7efec80d2e50 2024-04-14T09:59:10.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.998+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efec80cabd0 con 0x7efec80d2e50 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:09.999+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efec8075760 con 0x7efec80d2e50 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.000+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efeb801a070 con 0x7efec80d2e50 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.000+0000 7efebdffb640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 0x7efeac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.000+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efeb808c1c0 con 0x7efec80d2e50 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.000+0000 7efecd389640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 0x7efeac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.001+0000 7efecd389640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 0x7efeac06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efec4009560 tx=0x7efec4009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.004+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efeb8059ba0 con 0x7efec80d2e50 2024-04-14T09:59:10.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.188+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efec80b9710 con 0x7efec80d2e50 2024-04-14T09:59:10.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.188+0000 7efebdffb640 1 -- 172.21.15.40:0/1998554732 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7efeb805dea0 con 0x7efec80d2e50 2024-04-14T09:59:10.189 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 msgr2=0x7efeac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 0x7efeac06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efec4009560 tx=0x7efec4009190 comp rx=0 tx=0).stop 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 msgr2=0x7efec80cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7efeb800e890 tx=0x7efeb800ed50 comp rx=0 tx=0).stop 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 shutdown_connections 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efeac06c8f0 0x7efeac06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efec8161c80 0x7efec80c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efec80d2e50 0x7efec80cdc10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 --2- 172.21.15.40:0/1998554732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efec80d1200 0x7efec8154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 >> 172.21.15.40:0/1998554732 conn(0x7efec809d5e0 msgr2=0x7efec80b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 shutdown_connections 2024-04-14T09:59:10.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.190+0000 7efecf5ed640 1 -- 172.21.15.40:0/1998554732 wait complete. 2024-04-14T09:59:10.202 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.305+0000 7f7a8b515640 1 Processor -- start 2024-04-14T09:59:10.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.305+0000 7f7a8b515640 1 -- start start 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.305+0000 7f7a8b515640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f7a840d0830 0x7f7a840cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a8b515640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a84070d30 0x7f7a8409b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a8b515640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a8415c900 con 0x7f7a840b1590 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a8b515640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7a8406f890 con 0x7f7a84070d30 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a8b515640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7a840cd6e0 con 0x7f7a840d0830 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a84070d30 0x7f7a8409b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7a84070d30 0x7f7a8409b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43716/0 (socket says 172.21.15.40:43716) 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 -- 172.21.15.40:0/2386020338 learned_addr learned my addr 172.21.15.40:0/2386020338 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a892b1640 1 --2- 172.21.15.40:0/2386020338 >> v2:172.21.15.136:3300/0 conn(0x7f7a840d0830 0x7f7a840cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 -- 172.21.15.40:0/2386020338 >> v2:172.21.15.136:3300/0 conn(0x7f7a840d0830 msgr2=0x7f7a840cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 --2- 172.21.15.40:0/2386020338 >> v2:172.21.15.136:3300/0 conn(0x7f7a840d0830 0x7f7a840cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 -- 172.21.15.40:0/2386020338 >> v1:172.21.15.136:6789/0 conn(0x7f7a840b1590 legacy=0x7f7a8409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.306+0000 7f7a89ab2640 1 -- 172.21.15.40:0/2386020338 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a840cd9c0 con 0x7f7a84070d30 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a89ab2640 1 --2- 172.21.15.40:0/2386020338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a84070d30 0x7f7a8409b150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a84074c20 tx=0x7f7a7402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5a5aed02a6f6e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a83fff640 1 -- 172.21.15.40:0/2386020338 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7402cb20 con 0x7f7a84070d30 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a83fff640 1 -- 172.21.15.40:0/2386020338 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7402ccc0 con 0x7f7a84070d30 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a83fff640 1 -- 172.21.15.40:0/2386020338 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a74034610 con 0x7f7a84070d30 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 -- 172.21.15.40:0/2386020338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a84070d30 msgr2=0x7f7a8409b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 --2- 172.21.15.40:0/2386020338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a84070d30 0x7f7a8409b150 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7a84074c20 tx=0x7f7a7402bf80 comp rx=0 tx=0).stop 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 -- 172.21.15.40:0/2386020338 shutdown_connections 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 --2- 172.21.15.40:0/2386020338 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a84070d30 0x7f7a8409b150 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 --2- 172.21.15.40:0/2386020338 >> v2:172.21.15.136:3300/0 conn(0x7f7a840d0830 0x7f7a840cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.307+0000 7f7a8b515640 1 -- 172.21.15.40:0/2386020338 >> 172.21.15.40:0/2386020338 conn(0x7f7a840b3ad0 msgr2=0x7f7a840b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.308+0000 7f7a8b515640 1 -- 172.21.15.40:0/2386020338 shutdown_connections 2024-04-14T09:59:10.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.308+0000 7f7a8b515640 1 -- 172.21.15.40:0/2386020338 wait complete. 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 Processor -- start 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 -- start start 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7a84070d30 0x7f7a841571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a840d0830 0x7f7a84158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8406f520 con 0x7f7a840b1590 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7a840cdf80 con 0x7f7a840d0830 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.309+0000 7f7a8b515640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8409b690 con 0x7f7a84070d30 2024-04-14T09:59:10.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43728/0 (socket says 172.21.15.40:43728) 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 -- 172.21.15.40:0/3458999821 learned_addr learned my addr 172.21.15.40:0/3458999821 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a892b1640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7a84070d30 0x7f7a841571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a89ab2640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a840d0830 0x7f7a84158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 -- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7a84070d30 msgr2=0x7f7a841571c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7a84070d30 0x7f7a841571c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 -- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a840d0830 msgr2=0x7f7a84158a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a840d0830 0x7f7a84158a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 -- 172.21.15.40:0/3458999821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a841f27f0 con 0x7f7a840b1590 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a88ab0640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c400 tx=0x7f7a7800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a780052d0 con 0x7f7a840b1590 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a78005490 con 0x7f7a840b1590 2024-04-14T09:59:10.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a841f2b10 con 0x7f7a840b1590 2024-04-14T09:59:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a78007260 con 0x7f7a840b1590 2024-04-14T09:59:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.310+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a841f3350 con 0x7f7a840b1590 2024-04-14T09:59:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.311+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a84075760 con 0x7f7a840b1590 2024-04-14T09:59:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.312+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7a78007400 con 0x7f7a840b1590 2024-04-14T09:59:10.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.312+0000 7f7a81ffb640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 0x7f7a7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.312+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f7a7808b320 con 0x7f7a840b1590 2024-04-14T09:59:10.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.312+0000 7f7a892b1640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 0x7f7a7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.313+0000 7f7a892b1640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 0x7f7a7006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009aa0 tx=0x7f7a7c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.317+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f7a841f2b10 con 0x7f7a840b1590 2024-04-14T09:59:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.501+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a840d03a0 con 0x7f7a840b1590 2024-04-14T09:59:10.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.501+0000 7f7a81ffb640 1 -- 172.21.15.40:0/3458999821 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f7a78058d90 con 0x7f7a840b1590 2024-04-14T09:59:10.502 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 msgr2=0x7f7a7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 0x7f7a7006edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009aa0 tx=0x7f7a7c009190 comp rx=0 tx=0).stop 2024-04-14T09:59:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 msgr2=0x7f7a840cf0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7a7800c400 tx=0x7f7a7800c8c0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 shutdown_connections 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f7a7006c8f0 0x7f7a7006edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7a840d0830 0x7f7a84158a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7a840b1590 0x7f7a840cf0e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 --2- 172.21.15.40:0/3458999821 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7a84070d30 0x7f7a841571c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.503+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 >> 172.21.15.40:0/3458999821 conn(0x7f7a840b3ad0 msgr2=0x7f7a840b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.504+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 shutdown_connections 2024-04-14T09:59:10.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.504+0000 7f7a8b515640 1 -- 172.21.15.40:0/3458999821 wait complete. 2024-04-14T09:59:10.517 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:10.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.622+0000 7f639f6de640 1 Processor -- start 2024-04-14T09:59:10.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.622+0000 7f639f6de640 1 -- start start 2024-04-14T09:59:10.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639f6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d4980 0x7f6398162bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639f6de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63980d0c80 0x7f63980d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639f6de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63980d5000 con 0x7f6398161ca0 2024-04-14T09:59:10.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639f6de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f63980d4de0 con 0x7f63980d0c80 2024-04-14T09:59:10.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639f6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63981630f0 con 0x7f63980d4980 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63980d0c80 0x7f63980d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f63980d0c80 0x7f63980d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43734/0 (socket says 172.21.15.40:43734) 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 -- 172.21.15.40:0/1703672849 learned_addr learned my addr 172.21.15.40:0/1703672849 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639cc79640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d4980 0x7f6398162bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 -- 172.21.15.40:0/1703672849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d4980 msgr2=0x7f6398162bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d4980 0x7f6398162bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 -- 172.21.15.40:0/1703672849 >> v1:172.21.15.136:6789/0 conn(0x7f6398161ca0 legacy=0x7f63980cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.623+0000 7f639dc7b640 1 -- 172.21.15.40:0/1703672849 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63980cf0d0 con 0x7f63980d0c80 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.624+0000 7f639dc7b640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d0c80 0x7f63980d10d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e50 tx=0x7f638802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc85f4720ad2d41d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.624+0000 7f6397fff640 1 -- 172.21.15.40:0/1703672849 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638802c9e0 con 0x7f63980d0c80 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.624+0000 7f6397fff640 1 -- 172.21.15.40:0/1703672849 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638802cb80 con 0x7f63980d0c80 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.624+0000 7f6397fff640 1 -- 172.21.15.40:0/1703672849 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880343f0 con 0x7f63980d0c80 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 -- 172.21.15.40:0/1703672849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d0c80 msgr2=0x7f63980d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d0c80 0x7f63980d10d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e50 tx=0x7f638802be40 comp rx=0 tx=0).stop 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 -- 172.21.15.40:0/1703672849 shutdown_connections 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d0c80 0x7f63980d10d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 --2- 172.21.15.40:0/1703672849 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d4980 0x7f6398162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 -- 172.21.15.40:0/1703672849 >> 172.21.15.40:0/1703672849 conn(0x7f639809d5c0 msgr2=0x7f63980d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 -- 172.21.15.40:0/1703672849 shutdown_connections 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.625+0000 7f639f6de640 1 -- 172.21.15.40:0/1703672849 wait complete. 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.626+0000 7f639f6de640 1 Processor -- start 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.626+0000 7f639f6de640 1 -- start start 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d0c80 0x7f63980cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.631 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6398161ca0 0x7f63981586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f63980cf690 con 0x7f63980d4980 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f63980d1610 con 0x7f6398161ca0 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639f6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63980ced80 con 0x7f63980d0c80 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43738/0 (socket says 172.21.15.40:43738) 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 -- 172.21.15.40:0/3590413674 learned_addr learned my addr 172.21.15.40:0/3590413674 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639dc7b640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6398161ca0 0x7f63981586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639d47a640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d0c80 0x7f63980cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 -- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d0c80 msgr2=0x7f63980cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d0c80 0x7f63980cdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 -- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6398161ca0 msgr2=0x7f63981586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6398161ca0 0x7f63981586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.627+0000 7f639cc79640 1 -- 172.21.15.40:0/3590413674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63980ce1e0 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f639cc79640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f638c00e870 tx=0x7f638c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c017070 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c00c940 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c00cd30 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63980b7b80 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.628+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63980b8140 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.629+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6398075760 con 0x7f63980d4980 2024-04-14T09:59:10.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.629+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f638c01a070 con 0x7f63980d4980 2024-04-14T09:59:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.630+0000 7f6395ffb640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.630+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f638c08bd70 con 0x7f63980d4980 2024-04-14T09:59:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.630+0000 7f639d47a640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.630+0000 7f639d47a640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 0x7f638406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63900016e0 tx=0x7f6390009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.634+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f638c059750 con 0x7f63980d4980 2024-04-14T09:59:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.818+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f63980d0a60 con 0x7f63980d4980 2024-04-14T09:59:10.819 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.819+0000 7f6395ffb640 1 -- 172.21.15.40:0/3590413674 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f638c05da50 con 0x7f63980d4980 2024-04-14T09:59:10.819 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 msgr2=0x7f638406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 0x7f638406ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f63900016e0 tx=0x7f6390009040 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 msgr2=0x7f63981f7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f638c00e870 tx=0x7f638c00ed30 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 shutdown_connections 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f638406c920 0x7f638406ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6398161ca0 0x7f63981586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f63980d4980 0x7f63981f7550 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 --2- 172.21.15.40:0/3590413674 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63980d0c80 0x7f63980cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 >> 172.21.15.40:0/3590413674 conn(0x7f639809d5c0 msgr2=0x7f639815d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 shutdown_connections 2024-04-14T09:59:10.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.821+0000 7f639f6de640 1 -- 172.21.15.40:0/3590413674 wait complete. 2024-04-14T09:59:10.863 INFO:tasks.cephfs_test_runner:Starting test: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-04-14T09:59:10.863 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.964+0000 7fe1d16d1640 1 Processor -- start 2024-04-14T09:59:10.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.964+0000 7fe1d16d1640 1 -- start start 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1d16d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1d16d1640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1cc0b4c70 con 0x7fe1cc15e650 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1d16d1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1cc0b4f50 con 0x7fe1cc0d2770 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1d16d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0b5880 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1caffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe1cc15e650 0x7fe1cc0b4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37820/0 (socket says 172.21.15.40:37820) 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1caffd640 1 -- 172.21.15.40:0/3964847428 learned_addr learned my addr 172.21.15.40:0/3964847428 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1cb7fe640 1 --2- 172.21.15.40:0/3964847428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168689584 0 0) 0x7fe1cc0b4c70 con 0x7fe1cc15e650 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1b8003520 con 0x7fe1cc15e650 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296910471 0 0) 0x7fe1cc0b4f50 con 0x7fe1cc0d2770 2024-04-14T09:59:10.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1cc0b4c70 con 0x7fe1cc0d2770 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/3964847428 >> v1:172.21.15.136:6789/0 conn(0x7fe1cc0d2770 legacy=0x7fe1cc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/3964847428 >> v1:172.21.15.40:6789/0 conn(0x7fe1cc15e650 legacy=0x7fe1cc0b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.965+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/3964847428 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc0b5230 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.966+0000 7fe1cb7fe640 1 --2- 172.21.15.40:0/3964847428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0cf7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009dc0 tx=0x7fe1bc02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce805d936100eb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.966+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc039070 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.966+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc02ccd0 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.966+0000 7fe1c9ffb640 1 -- 172.21.15.40:0/3964847428 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc034660 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 -- 172.21.15.40:0/3964847428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 msgr2=0x7fe1cc0cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/3964847428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0cf7b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009dc0 tx=0x7fe1bc02bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 -- 172.21.15.40:0/3964847428 shutdown_connections 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/3964847428 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0cf7b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 -- 172.21.15.40:0/3964847428 >> 172.21.15.40:0/3964847428 conn(0x7fe1cc09d580 msgr2=0x7fe1cc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 -- 172.21.15.40:0/3964847428 shutdown_connections 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.967+0000 7fe1d16d1640 1 -- 172.21.15.40:0/3964847428 wait complete. 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.968+0000 7fe1d16d1640 1 Processor -- start 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.968+0000 7fe1d16d1640 1 -- start start 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2770 0x7fe1cc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0b4930 con 0x7fe1cc15e650 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe1cc0d3060 con 0x7fe1cc0d2bd0 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1d16d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe1cc0d2270 con 0x7fe1cc0d2770 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1caffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2770 0x7fe1cc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43754/0 (socket says 172.21.15.40:43754) 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/2573552255 learned_addr learned my addr 172.21.15.40:0/2573552255 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1ca7fc640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2770 msgr2=0x7fe1cc159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2770 0x7fe1cc159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0d2bd0 msgr2=0x7fe1cc0ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.969+0000 7fe1cb7fe640 1 -- 172.21.15.40:0/2573552255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc0cd030 con 0x7fe1cc15e650 2024-04-14T09:59:10.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1cb7fe640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ee0 tx=0x7fe1bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc039050 con 0x7fe1cc15e650 2024-04-14T09:59:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1bc045070 con 0x7fe1cc15e650 2024-04-14T09:59:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1cc0cd310 con 0x7fe1cc15e650 2024-04-14T09:59:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc009450 con 0x7fe1cc15e650 2024-04-14T09:59:10.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.970+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1cc0cd8d0 con 0x7fe1cc15e650 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.971+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1cc0756f0 con 0x7fe1cc15e650 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.971+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe1bc03e850 con 0x7fe1cc15e650 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.972+0000 7fe1c37fe640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.972+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe1bc0aebc0 con 0x7fe1cc15e650 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.972+0000 7fe1caffd640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:10.974 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.972+0000 7fe1caffd640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4000f60 tx=0x7fe1c4007d70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:10.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:10.976+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe1bc07c6c0 con 0x7fe1cc15e650 2024-04-14T09:59:11.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.160+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1cc0d1aa0 con 0x7fe1cc15e650 2024-04-14T09:59:11.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.161+0000 7fe1c37fe640 1 -- 172.21.15.40:0/2573552255 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fe1bc0809c0 con 0x7fe1cc15e650 2024-04-14T09:59:11.162 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:11.162 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:11.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 msgr2=0x7fe1ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4000f60 tx=0x7fe1c4007d70 comp rx=0 tx=0).stop 2024-04-14T09:59:11.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 msgr2=0x7fe1cc0b8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc009ee0 tx=0x7fe1bc004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 shutdown_connections 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe1ac06c8f0 0x7fe1ac06edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe1cc15e650 0x7fe1cc0b8d70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe1cc0d2bd0 0x7fe1cc0ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 --2- 172.21.15.40:0/2573552255 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe1cc0d2770 0x7fe1cc159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 >> 172.21.15.40:0/2573552255 conn(0x7fe1cc09d580 msgr2=0x7fe1cc06c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 shutdown_connections 2024-04-14T09:59:11.165 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.163+0000 7fe1d16d1640 1 -- 172.21.15.40:0/2573552255 wait complete. 2024-04-14T09:59:11.175 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:11.176 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:11.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.280+0000 7fec6f988640 1 Processor -- start 2024-04-14T09:59:11.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.280+0000 7fec6f988640 1 -- start start 2024-04-14T09:59:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6f988640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 0x7fec6815e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6f988640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680af6c0 con 0x7fec680adfc0 2024-04-14T09:59:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6f988640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec680af940 con 0x7fec680af240 2024-04-14T09:59:11.282 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6f988640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fec680ae730 con 0x7fec680d00f0 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6df25640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fec680adfc0 0x7fec6806dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37824/0 (socket says 172.21.15.40:37824) 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6df25640 1 -- 172.21.15.40:0/664883093 learned_addr learned my addr 172.21.15.40:0/664883093 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6d724640 1 --2- 172.21.15.40:0/664883093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 0x7fec6815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6cf23640 1 --1- 172.21.15.40:0/664883093 >> v1:172.21.15.136:6789/0 conn(0x7fec680af240 0x7fec680ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51774/0 (socket says 172.21.15.40:51774) 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec67fff640 1 -- 172.21.15.40:0/664883093 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902370933 0 0) 0x7fec58001490 con 0x7fec680adfc0 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6d724640 1 -- 172.21.15.40:0/664883093 >> v1:172.21.15.136:6789/0 conn(0x7fec680af240 legacy=0x7fec680ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6d724640 1 -- 172.21.15.40:0/664883093 >> v1:172.21.15.40:6789/0 conn(0x7fec680adfc0 legacy=0x7fec6806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.283 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.281+0000 7fec6d724640 1 -- 172.21.15.40:0/664883093 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec680afc20 con 0x7fec680d00f0 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.282+0000 7fec6d724640 1 --2- 172.21.15.40:0/664883093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 0x7fec6815e920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec60009750 tx=0x7fec6002b730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29bfd4a7bb45dd0a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.282+0000 7fec67fff640 1 -- 172.21.15.40:0/664883093 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60037070 con 0x7fec680d00f0 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.282+0000 7fec67fff640 1 -- 172.21.15.40:0/664883093 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec60030710 con 0x7fec680d00f0 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.282+0000 7fec67fff640 1 -- 172.21.15.40:0/664883093 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60030ae0 con 0x7fec680d00f0 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 -- 172.21.15.40:0/664883093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 msgr2=0x7fec6815e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 --2- 172.21.15.40:0/664883093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 0x7fec6815e920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec60009750 tx=0x7fec6002b730 comp rx=0 tx=0).stop 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 -- 172.21.15.40:0/664883093 shutdown_connections 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 --2- 172.21.15.40:0/664883093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680d00f0 0x7fec6815e920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 -- 172.21.15.40:0/664883093 >> 172.21.15.40:0/664883093 conn(0x7fec68072c10 msgr2=0x7fec6806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 -- 172.21.15.40:0/664883093 shutdown_connections 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.283+0000 7fec6f988640 1 -- 172.21.15.40:0/664883093 wait complete. 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.284+0000 7fec6f988640 1 Processor -- start 2024-04-14T09:59:11.285 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.284+0000 7fec6f988640 1 -- start start 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680af240 0x7fec6813ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec680d00f0 0x7fec68160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fec680b01e0 con 0x7fec680adfc0 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec680d04d0 con 0x7fec680d00f0 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6f988640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fec680d0650 con 0x7fec680af240 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.288 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43766/0 (socket says 172.21.15.40:43766) 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 -- 172.21.15.40:0/4048921628 learned_addr learned my addr 172.21.15.40:0/4048921628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6cf23640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680af240 0x7fec6813ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6df25640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec680d00f0 0x7fec68160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 -- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680af240 msgr2=0x7fec6813ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680af240 0x7fec6813ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 -- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec680d00f0 msgr2=0x7fec68160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec680d00f0 0x7fec68160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 -- 172.21.15.40:0/4048921628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec6813c100 con 0x7fec680adfc0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec6d724640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec6002b770 tx=0x7fec600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60042070 con 0x7fec680adfc0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.285+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec600329c0 con 0x7fec680adfc0 2024-04-14T09:59:11.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.286+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6813f3b0 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.286+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60037040 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.286+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec68150920 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.287+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec68075760 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.287+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fec60045070 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.288+0000 7fec65ffb640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 0x7fec5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.288+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fec600adbb0 con 0x7fec680adfc0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.288+0000 7fec6cf23640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 0x7fec5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.290 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.288+0000 7fec6cf23640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 0x7fec5406ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec5c007fd0 tx=0x7fec5c007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.292+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fec6007b510 con 0x7fec680adfc0 2024-04-14T09:59:11.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.481+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fec6806bf50 con 0x7fec680adfc0 2024-04-14T09:59:11.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.481+0000 7fec65ffb640 1 -- 172.21.15.40:0/4048921628 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fec6007f810 con 0x7fec680adfc0 2024-04-14T09:59:11.482 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 msgr2=0x7fec5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 0x7fec5406ede0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fec5c007fd0 tx=0x7fec5c007de0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 msgr2=0x7fec6813bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec6002b770 tx=0x7fec600046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 shutdown_connections 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fec5406c920 0x7fec5406ede0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec680d00f0 0x7fec68160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec680af240 0x7fec6813ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 --2- 172.21.15.40:0/4048921628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fec680adfc0 0x7fec6813bbc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 >> 172.21.15.40:0/4048921628 conn(0x7fec68072c10 msgr2=0x7fec680b4e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 shutdown_connections 2024-04-14T09:59:11.485 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.483+0000 7fec6f988640 1 -- 172.21.15.40:0/4048921628 wait complete. 2024-04-14T09:59:11.495 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:11.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.600+0000 7f76c6bed640 1 Processor -- start 2024-04-14T09:59:11.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.600+0000 7f76c6bed640 1 -- start start 2024-04-14T09:59:11.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f76c0161ca0 0x7f76c00d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76c0162bb0 0x7f76c00cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.604 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 0x7f76c00d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f76c00d15f0 con 0x7f76c0162bb0 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f76c0163040 con 0x7f76c0161ca0 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c6bed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f76c00d5000 con 0x7f76c00d0c80 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76c0162bb0 0x7f76c00cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f76c0162bb0 0x7f76c00cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43774/0 (socket says 172.21.15.40:43774) 2024-04-14T09:59:11.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 -- 172.21.15.40:0/2083839972 learned_addr learned my addr 172.21.15.40:0/2083839972 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:11.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c4989640 1 --2- 172.21.15.40:0/2083839972 >> v2:172.21.15.136:3300/0 conn(0x7f76c0161ca0 0x7f76c00d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76c518a640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 0x7f76c00d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 -- 172.21.15.40:0/2083839972 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 msgr2=0x7f76c00d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:11.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 0x7f76c00d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.601+0000 7f76bffff640 1 -- 172.21.15.40:0/2083839972 >> v2:172.21.15.136:3300/0 conn(0x7f76c0161ca0 msgr2=0x7f76c00d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bffff640 1 --2- 172.21.15.40:0/2083839972 >> v2:172.21.15.136:3300/0 conn(0x7f76c0161ca0 0x7f76c00d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bffff640 1 -- 172.21.15.40:0/2083839972 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00cf0d0 con 0x7f76c0162bb0 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76c518a640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 0x7f76c00d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bffff640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c0162bb0 0x7f76c00cfbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76c008cd70 tx=0x7f76b402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b24f403218d658b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bf7fe640 1 -- 172.21.15.40:0/2083839972 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b40317d0 con 0x7f76c0162bb0 2024-04-14T09:59:11.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bf7fe640 1 -- 172.21.15.40:0/2083839972 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b4037070 con 0x7f76c0162bb0 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.602+0000 7f76bf7fe640 1 -- 172.21.15.40:0/2083839972 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b4031b90 con 0x7f76c0162bb0 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 -- 172.21.15.40:0/2083839972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c0162bb0 msgr2=0x7f76c00cfbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c0162bb0 0x7f76c00cfbb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f76c008cd70 tx=0x7f76b402b870 comp rx=0 tx=0).stop 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 -- 172.21.15.40:0/2083839972 shutdown_connections 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c00d0c80 0x7f76c00d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 --2- 172.21.15.40:0/2083839972 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c0162bb0 0x7f76c00cfbb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 --2- 172.21.15.40:0/2083839972 >> v2:172.21.15.136:3300/0 conn(0x7f76c0161ca0 0x7f76c00d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 -- 172.21.15.40:0/2083839972 >> 172.21.15.40:0/2083839972 conn(0x7f76c009d5c0 msgr2=0x7f76c00d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 -- 172.21.15.40:0/2083839972 shutdown_connections 2024-04-14T09:59:11.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.603+0000 7f76c6bed640 1 -- 172.21.15.40:0/2083839972 wait complete. 2024-04-14T09:59:11.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.604+0000 7f76c6bed640 1 Processor -- start 2024-04-14T09:59:11.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.604+0000 7f76c6bed640 1 -- start start 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76c0161ca0 0x7f76c00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c0162bb0 0x7f76c00b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00d00f0 con 0x7f76c00d0c80 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f76c00cf690 con 0x7f76c0161ca0 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c6bed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f76c00ced80 con 0x7f76c0162bb0 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43776/0 (socket says 172.21.15.40:43776) 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 -- 172.21.15.40:0/4106669684 learned_addr learned my addr 172.21.15.40:0/4106669684 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76bffff640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76c0161ca0 0x7f76c00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c518a640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c0162bb0 0x7f76c00b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 -- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c0162bb0 msgr2=0x7f76c00b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.612 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c0162bb0 0x7f76c00b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 -- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76c0161ca0 msgr2=0x7f76c00c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76c0161ca0 0x7f76c00c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.605+0000 7f76c4989640 1 -- 172.21.15.40:0/4106669684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c014a2c0 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76c4989640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f76b800efc0 tx=0x7f76b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8018020 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8014480 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8014850 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c014aa00 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.606+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c014b2a0 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.607+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c0075760 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.607+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76b8005d10 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.608+0000 7f76bd7fa640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 0x7f76ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.608+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f76b808c8e0 con 0x7f76c00d0c80 2024-04-14T09:59:11.613 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.608+0000 7f76bffff640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 0x7f76ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.608+0000 7f76bffff640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 0x7f76ac06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76b4036000 tx=0x7f76b403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.612+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f76b8022070 con 0x7f76c00d0c80 2024-04-14T09:59:11.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.795+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f76c00ba130 con 0x7f76c00d0c80 2024-04-14T09:59:11.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.795+0000 7f76bd7fa640 1 -- 172.21.15.40:0/4106669684 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f76b8010040 con 0x7f76c00d0c80 2024-04-14T09:59:11.796 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 msgr2=0x7f76ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 0x7f76ac06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f76b4036000 tx=0x7f76b403d040 comp rx=0 tx=0).stop 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 msgr2=0x7f76c0149d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f76b800efc0 tx=0x7f76b800c490 comp rx=0 tx=0).stop 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 shutdown_connections 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f76ac06c8f0 0x7f76ac06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76c0162bb0 0x7f76c00b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f76c0161ca0 0x7f76c00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 --2- 172.21.15.40:0/4106669684 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76c00d0c80 0x7f76c0149d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 >> 172.21.15.40:0/4106669684 conn(0x7f76c009d5c0 msgr2=0x7f76c015df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 shutdown_connections 2024-04-14T09:59:11.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.797+0000 7f76c6bed640 1 -- 172.21.15.40:0/4106669684 wait complete. 2024-04-14T09:59:11.809 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:11.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.913+0000 7effff0de640 1 Processor -- start 2024-04-14T09:59:11.914 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.913+0000 7effff0de640 1 -- start start 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7effff0de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efff815e3d0 0x7efff80d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7effff0de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 0x7efff80d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7effff0de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff80d2f30 con 0x7efff815e7b0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7effff0de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efff80cf000 con 0x7efff815e3d0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7effff0de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efff80cf2e0 con 0x7efff80c7e30 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffd67b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efff815e7b0 0x7efff80d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37832/0 (socket says 172.21.15.40:37832) 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffd67b640 1 -- 172.21.15.40:0/2251217134 learned_addr learned my addr 172.21.15.40:0/2251217134 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffce7a640 1 --2- 172.21.15.40:0/2251217134 >> v2:172.21.15.136:3300/0 conn(0x7efff815e3d0 0x7efff80d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efff7fff640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 0x7efff80d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efff77fe640 1 -- 172.21.15.40:0/2251217134 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646581701 0 0) 0x7efff80d2f30 con 0x7efff815e7b0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efff77fe640 1 -- 172.21.15.40:0/2251217134 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe8003520 con 0x7efff815e7b0 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffce7a640 1 -- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 msgr2=0x7efff80d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:11.916 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffce7a640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 0x7efff80d4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffce7a640 1 -- 172.21.15.40:0/2251217134 >> v1:172.21.15.40:6789/0 conn(0x7efff815e7b0 legacy=0x7efff80d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efffce7a640 1 -- 172.21.15.40:0/2251217134 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff80cf5c0 con 0x7efff815e3d0 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.914+0000 7efff7fff640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 0x7efff80d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.915+0000 7efffce7a640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff815e3d0 0x7efff80d4030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7effec0097a0 tx=0x7effec02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e64c77c1b4e373 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.915+0000 7efff77fe640 1 -- 172.21.15.40:0/2251217134 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec035020 con 0x7efff815e3d0 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.915+0000 7efff77fe640 1 -- 172.21.15.40:0/2251217134 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effec031830 con 0x7efff815e3d0 2024-04-14T09:59:11.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.915+0000 7efff77fe640 1 -- 172.21.15.40:0/2251217134 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effec031be0 con 0x7efff815e3d0 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 -- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff815e3d0 msgr2=0x7efff80d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff815e3d0 0x7efff80d4030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7effec0097a0 tx=0x7effec02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 -- 172.21.15.40:0/2251217134 shutdown_connections 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff80c7e30 0x7efff80d4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 --2- 172.21.15.40:0/2251217134 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff815e3d0 0x7efff80d4030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 -- 172.21.15.40:0/2251217134 >> 172.21.15.40:0/2251217134 conn(0x7efff808dc90 msgr2=0x7efff809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 -- 172.21.15.40:0/2251217134 shutdown_connections 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.916+0000 7effff0de640 1 -- 172.21.15.40:0/2251217134 wait complete. 2024-04-14T09:59:11.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.917+0000 7effff0de640 1 Processor -- start 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.917+0000 7effff0de640 1 -- start start 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 0x7efff81576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 0x7efff8153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efff80d2a00 con 0x7efff815e7b0 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efff80d2880 con 0x7efff80c7e30 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7effff0de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efff80d2b80 con 0x7efff815e3d0 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffce7a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 0x7efff8153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffce7a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:52622/0 (socket says 172.21.15.40:52622) 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffce7a640 1 -- 172.21.15.40:0/2815342626 learned_addr learned my addr 172.21.15.40:0/2815342626 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efff7fff640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 0x7efff81576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 -- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 msgr2=0x7efff81576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 0x7efff81576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 -- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 msgr2=0x7efff81590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 -- 172.21.15.40:0/2815342626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff8157c00 con 0x7efff815e7b0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffce7a640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efff7fff640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 0x7efff81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.918+0000 7efffd67b640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 0x7efff8153990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efff80b5ae0 tx=0x7efff000ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.919+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0017070 con 0x7efff815e7b0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.919+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff000ab10 con 0x7efff815e7b0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.919+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff8157ea0 con 0x7efff815e7b0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.919+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff0012400 con 0x7efff815e7b0 2024-04-14T09:59:11.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.919+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff8158460 con 0x7efff815e7b0 2024-04-14T09:59:11.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.920+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff8075760 con 0x7efff815e7b0 2024-04-14T09:59:11.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.920+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efff001a070 con 0x7efff815e7b0 2024-04-14T09:59:11.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.920+0000 7efff57fa640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:11.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.920+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7efff008b9c0 con 0x7efff815e7b0 2024-04-14T09:59:11.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.921+0000 7efffce7a640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:11.924 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.921+0000 7efffce7a640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 0x7effdc06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effec009560 tx=0x7effec008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:11.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:11.925+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efff008de20 con 0x7efff815e7b0 2024-04-14T09:59:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.106+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7efff80cb170 con 0x7efff815e7b0 2024-04-14T09:59:12.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.107+0000 7efff57fa640 1 -- 172.21.15.40:0/2815342626 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7efff0059430 con 0x7efff815e7b0 2024-04-14T09:59:12.107 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 msgr2=0x7effdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 0x7effdc06edb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effec009560 tx=0x7effec008030 comp rx=0 tx=0).stop 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 msgr2=0x7efff8153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 0x7efff8153990 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7efff80b5ae0 tx=0x7efff000ce40 comp rx=0 tx=0).stop 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 shutdown_connections 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efff815e7b0 0x7efff8153990 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efff815e3d0 0x7efff81576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 --2- 172.21.15.40:0/2815342626 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efff80c7e30 0x7efff81590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 >> 172.21.15.40:0/2815342626 conn(0x7efff808dc90 msgr2=0x7efff815c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:12.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 shutdown_connections 2024-04-14T09:59:12.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.109+0000 7effff0de640 1 -- 172.21.15.40:0/2815342626 wait complete. 2024-04-14T09:59:12.121 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:12.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.225+0000 7fb8e4c36640 1 Processor -- start 2024-04-14T09:59:12.226 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.225+0000 7fb8e4c36640 1 -- start start 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8e4c36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb8e00d0b40 0x7fb8e00d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8e4c36640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e006cc40 con 0x7fb8e0071020 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8e4c36640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8e006c960 con 0x7fb8e009b150 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8e4c36640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb8e00ce4a0 con 0x7fb8e00d0b40 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8de59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb8e0071020 0x7fb8e009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37842/0 (socket says 172.21.15.40:37842) 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8de59c640 1 -- 172.21.15.40:0/2281097322 learned_addr learned my addr 172.21.15.40:0/2281097322 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8d7fff640 1 --1- 172.21.15.40:0/2281097322 >> v1:172.21.15.136:6789/0 conn(0x7fb8e009b150 0x7fb8e00d0430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51784/0 (socket says 172.21.15.40:51784) 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.226+0000 7fb8ded9d640 1 --2- 172.21.15.40:0/2281097322 >> v2:172.21.15.136:3300/0 conn(0x7fb8e00d0b40 0x7fb8e00d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273636069 0 0) 0x7fb8e006c960 con 0x7fb8e009b150 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8cc003520 con 0x7fb8e009b150 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2386114440 0 0) 0x7fb8e006cc40 con 0x7fb8e0071020 2024-04-14T09:59:12.228 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e006c960 con 0x7fb8e0071020 2024-04-14T09:59:12.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ded9d640 1 -- 172.21.15.40:0/2281097322 >> v1:172.21.15.136:6789/0 conn(0x7fb8e009b150 legacy=0x7fb8e00d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ded9d640 1 -- 172.21.15.40:0/2281097322 >> v1:172.21.15.40:6789/0 conn(0x7fb8e0071020 legacy=0x7fb8e009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.227+0000 7fb8ded9d640 1 -- 172.21.15.40:0/2281097322 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00cc6d0 con 0x7fb8e00d0b40 2024-04-14T09:59:12.229 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8ded9d640 1 --2- 172.21.15.40:0/2281097322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00d0ff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009d90 tx=0x7fb8d802bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80246022a7b7c075 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8039070 con 0x7fb8e00d0b40 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d802cd80 con 0x7fb8e00d0b40 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8ddd9b640 1 -- 172.21.15.40:0/2281097322 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8034660 con 0x7fb8e00d0b40 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 -- 172.21.15.40:0/2281097322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 msgr2=0x7fb8e00d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/2281097322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00d0ff0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009d90 tx=0x7fb8d802bfd0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.230 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 -- 172.21.15.40:0/2281097322 shutdown_connections 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/2281097322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00d0ff0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 -- 172.21.15.40:0/2281097322 >> 172.21.15.40:0/2281097322 conn(0x7fb8e00b3ad0 msgr2=0x7fb8e00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 -- 172.21.15.40:0/2281097322 shutdown_connections 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.228+0000 7fb8e4c36640 1 -- 172.21.15.40:0/2281097322 wait complete. 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 Processor -- start 2024-04-14T09:59:12.231 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 -- start start 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8e0071020 0x7fb8e00c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00ccf70 con 0x7fb8e009b150 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e00ccc90 con 0x7fb8e00d0b40 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8e4c36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb8e006db50 con 0x7fb8e0071020 2024-04-14T09:59:12.233 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8d7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43798/0 (socket says 172.21.15.40:43798) 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8d7fff640 1 -- 172.21.15.40:0/3085562084 learned_addr learned my addr 172.21.15.40:0/3085562084 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.230+0000 7fb8ded9d640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8de59c640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8e0071020 0x7fb8e00c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 -- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8e0071020 msgr2=0x7fb8e00c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8e0071020 0x7fb8e00c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 -- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 msgr2=0x7fb8e00c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 -- 172.21.15.40:0/3085562084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e00c7340 con 0x7fb8e009b150 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d7fff640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c450 tx=0x7fb8c800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8018070 con 0x7fb8e009b150 2024-04-14T09:59:12.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8c8007540 con 0x7fb8e009b150 2024-04-14T09:59:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8004a20 con 0x7fb8e009b150 2024-04-14T09:59:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e00c69b0 con 0x7fb8e009b150 2024-04-14T09:59:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.231+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e00c9870 con 0x7fb8e009b150 2024-04-14T09:59:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.232+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e0075760 con 0x7fb8e009b150 2024-04-14T09:59:12.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.233+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8c801b070 con 0x7fb8e009b150 2024-04-14T09:59:12.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.233+0000 7fb8d6ffd640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 0x7fb8c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.233+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb8c808b080 con 0x7fb8e009b150 2024-04-14T09:59:12.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.233+0000 7fb8de59c640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 0x7fb8c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.236 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.234+0000 7fb8de59c640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 0x7fb8c006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000f60 tx=0x7fb8d0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.238 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.238+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb8c8058af0 con 0x7fb8e009b150 2024-04-14T09:59:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.422+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb8e00c6be0 con 0x7fb8e009b150 2024-04-14T09:59:12.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.423+0000 7fb8d6ffd640 1 -- 172.21.15.40:0/3085562084 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb8c805cdf0 con 0x7fb8e009b150 2024-04-14T09:59:12.423 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:12.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 msgr2=0x7fb8c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 0x7fb8c006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0000f60 tx=0x7fb8d0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 msgr2=0x7fb8e00c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb8c800c450 tx=0x7fb8c800c910 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 shutdown_connections 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8c006c8f0 0x7fb8c006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8e00d0b40 0x7fb8e00c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8e009b150 0x7fb8e00c6470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 --2- 172.21.15.40:0/3085562084 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8e0071020 0x7fb8e00c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.424+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 >> 172.21.15.40:0/3085562084 conn(0x7fb8e00b3ad0 msgr2=0x7fb8e01e55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.425+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 shutdown_connections 2024-04-14T09:59:12.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.425+0000 7fb8e4c36640 1 -- 172.21.15.40:0/3085562084 wait complete. 2024-04-14T09:59:12.436 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_acls.TestACLs.test_acls' 2024-04-14T09:59:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.538+0000 7f8ba0cde640 1 Processor -- start 2024-04-14T09:59:12.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.538+0000 7f8ba0cde640 1 -- start start 2024-04-14T09:59:12.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8ba0cde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 0x7f8b9c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8ba0cde640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8b9c0b4680 0x7f8b9c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8ba0cde640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b9c0ccce0 con 0x7f8b9c15c2b0 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8ba0cde640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8b9c0d01b0 con 0x7f8b9c0b4680 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8ba0cde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c0ccf80 con 0x7f8b9c15c690 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8b9c15c2b0 0x7f8b9c0cda60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37854/0 (socket says 172.21.15.40:37854) 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9a59c640 1 -- 172.21.15.40:0/2116778235 learned_addr learned my addr 172.21.15.40:0/2116778235 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b93fff640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 0x7f8b9c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9ad9d640 1 --2- 172.21.15.40:0/2116778235 >> v2:172.21.15.136:3300/0 conn(0x7f8b9c0b4680 0x7f8b9c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b99d9b640 1 -- 172.21.15.40:0/2116778235 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2000432031 0 0) 0x7f8b9c0ccce0 con 0x7f8b9c15c2b0 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b99d9b640 1 -- 172.21.15.40:0/2116778235 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b88003520 con 0x7f8b9c15c2b0 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9ad9d640 1 -- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 msgr2=0x7f8b9c0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9ad9d640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 0x7f8b9c0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9ad9d640 1 -- 172.21.15.40:0/2116778235 >> v1:172.21.15.40:6789/0 conn(0x7f8b9c15c2b0 legacy=0x7f8b9c0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b9ad9d640 1 -- 172.21.15.40:0/2116778235 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c0cd260 con 0x7f8b9c0b4680 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.539+0000 7f8b93fff640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 0x7f8b9c0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.540+0000 7f8b9ad9d640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c09aa40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009d90 tx=0x7f8b9402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970a1c56556edafa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.540+0000 7f8b99d9b640 1 -- 172.21.15.40:0/2116778235 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94039070 con 0x7f8b9c0b4680 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.540+0000 7f8b99d9b640 1 -- 172.21.15.40:0/2116778235 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9402cc50 con 0x7f8b9c0b4680 2024-04-14T09:59:12.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.540+0000 7f8b99d9b640 1 -- 172.21.15.40:0/2116778235 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94034440 con 0x7f8b9c0b4680 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 -- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c0b4680 msgr2=0x7f8b9c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c09aa40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8b94009d90 tx=0x7f8b9402bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 -- 172.21.15.40:0/2116778235 shutdown_connections 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c690 0x7f8b9c0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/2116778235 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c09aa40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 -- 172.21.15.40:0/2116778235 >> 172.21.15.40:0/2116778235 conn(0x7f8b9c0b3b90 msgr2=0x7f8b9c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 -- 172.21.15.40:0/2116778235 shutdown_connections 2024-04-14T09:59:12.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.541+0000 7f8ba0cde640 1 -- 172.21.15.40:0/2116778235 wait complete. 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.542+0000 7f8ba0cde640 1 Processor -- start 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.542+0000 7f8ba0cde640 1 -- start start 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c2b0 0x7f8b9c155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 0x7f8b9c15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c09af80 con 0x7f8b9c0b4680 2024-04-14T09:59:12.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9c0d03e0 con 0x7f8b9c15ef70 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8ba0cde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8b9c09b100 con 0x7f8b9c15c2b0 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43814/0 (socket says 172.21.15.40:43814) 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 -- 172.21.15.40:0/1635090009 learned_addr learned my addr 172.21.15.40:0/1635090009 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9ad9d640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 0x7f8b9c15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b93fff640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c2b0 0x7f8b9c155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 -- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c2b0 msgr2=0x7f8b9c155b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c2b0 0x7f8b9c155b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 -- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 msgr2=0x7f8b9c15f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 0x7f8b9c15f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 -- 172.21.15.40:0/1635090009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b9c15ea80 con 0x7f8b9c0b4680 2024-04-14T09:59:12.548 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9ad9d640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 0x7f8b9c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.543+0000 7f8b9a59c640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c4d0 tx=0x7f8b8c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.544+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c017070 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.544+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b9c0c92f0 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.544+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b8c005d00 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.544+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b8c0072b0 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.544+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b9c0c98b0 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.545+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b9c0756f0 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.545+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b8c01a070 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.546+0000 7f8b92ffd640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 0x7f8b7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.546+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8b8c08b250 con 0x7f8b9c0b4680 2024-04-14T09:59:12.549 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.546+0000 7f8b93fff640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 0x7f8b7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:12.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.546+0000 7f8b93fff640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 0x7f8b7c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009560 tx=0x7f8b84009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:12.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.551+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8b9c15ea80 con 0x7f8b9c0b4680 2024-04-14T09:59:12.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:12.808+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]} v 0) -- 0x7f8b9c0b8020 con 0x7f8b9c0b4680 2024-04-14T09:59:13.550 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.549+0000 7f8b92ffd640 1 -- 172.21.15.40:0/1635090009 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_acls.TestACLs.test_acls"]}]=0 v71) ==== 123+0+0 (secure 0 0 0) 0x7f8b8c058c40 con 0x7f8b9c0b4680 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 msgr2=0x7f8b7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 0x7f8b7c06edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009560 tx=0x7f8b84009190 comp rx=0 tx=0).stop 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 msgr2=0x7f8b9c0c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8b8c00c4d0 tx=0x7f8b8c00c990 comp rx=0 tx=0).stop 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 shutdown_connections 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8b7c06c8f0 0x7f8b7c06edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.553 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8b9c15ef70 0x7f8b9c15f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8b9c15c2b0 0x7f8b9c155b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 --2- 172.21.15.40:0/1635090009 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8b9c0b4680 0x7f8b9c0c5c80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 >> 172.21.15.40:0/1635090009 conn(0x7f8b9c0b3b90 msgr2=0x7f8b9c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:13.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 shutdown_connections 2024-04-14T09:59:13.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.552+0000 7f8ba0cde640 1 -- 172.21.15.40:0/1635090009 wait complete. 2024-04-14T09:59:13.566 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-14T09:59:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 Processor -- start 2024-04-14T09:59:13.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 -- start start 2024-04-14T09:59:13.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef8161c80 0x7f0ef80d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ef80d1200 0x7f0ef80cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef80b10e0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef80b1380 con 0x7f0ef80d1200 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0efe036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef80b1660 con 0x7f0ef8161c80 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.677+0000 7f0ef6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43818/0 (socket says 172.21.15.40:43818) 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/1901485957 learned_addr learned my addr 172.21.15.40:0/1901485957 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef7fff640 1 --2- 172.21.15.40:0/1901485957 >> v2:172.21.15.136:3300/0 conn(0x7f0ef80d1200 0x7f0ef80cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef77fe640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef8161c80 0x7f0ef80d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/1901485957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef8161c80 msgr2=0x7f0ef80d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef8161c80 0x7f0ef80d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/1901485957 >> v2:172.21.15.136:3300/0 conn(0x7f0ef80d1200 msgr2=0x7f0ef80cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/1901485957 >> v2:172.21.15.136:3300/0 conn(0x7f0ef80d1200 0x7f0ef80cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.678+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/1901485957 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef80d3340 con 0x7f0ef80d2e50 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ec1bfd76959272 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:13.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0ef67fc640 1 -- 172.21.15.40:0/1901485957 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0317c0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0ef67fc640 1 -- 172.21.15.40:0/1901485957 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec037070 con 0x7f0ef80d2e50 2024-04-14T09:59:13.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0ef67fc640 1 -- 172.21.15.40:0/1901485957 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec031b80 con 0x7f0ef80d2e50 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 -- 172.21.15.40:0/1901485957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 msgr2=0x7f0ef80d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec02b860 comp rx=0 tx=0).stop 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 -- 172.21.15.40:0/1901485957 shutdown_connections 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 --2- 172.21.15.40:0/1901485957 >> v2:172.21.15.136:3300/0 conn(0x7f0ef80d1200 0x7f0ef80cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80d0cc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 --2- 172.21.15.40:0/1901485957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef8161c80 0x7f0ef80d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 -- 172.21.15.40:0/1901485957 >> 172.21.15.40:0/1901485957 conn(0x7f0ef809d5e0 msgr2=0x7f0ef80d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:13.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 -- 172.21.15.40:0/1901485957 shutdown_connections 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.679+0000 7f0efe036640 1 -- 172.21.15.40:0/1901485957 wait complete. 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.680+0000 7f0efe036640 1 Processor -- start 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 -- start start 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef80d1200 0x7f0ef80cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef8161c80 0x7f0ef806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80cf460 con 0x7f0ef80d2e50 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef80d0390 con 0x7f0ef8161c80 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0efe036640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef80cf5e0 con 0x7f0ef80d1200 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0ef6ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43832/0 (socket says 172.21.15.40:43832) 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.681+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/3457108491 learned_addr learned my addr 172.21.15.40:0/3457108491 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:13.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef77fe640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef80d1200 0x7f0ef80cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef7fff640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef8161c80 0x7f0ef806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef80d1200 msgr2=0x7f0ef80cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef80d1200 0x7f0ef80cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef8161c80 msgr2=0x7f0ef806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef8161c80 0x7f0ef806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 -- 172.21.15.40:0/3457108491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef80ca290 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0ef6ffd640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0097c0 tx=0x7f0eec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec032650 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec0327f0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef80b61a0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec032be0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.682+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef80ca810 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.683+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef8075760 con 0x7f0ef80d2e50 2024-04-14T09:59:13.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.684+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0eec04c060 con 0x7f0ef80d2e50 2024-04-14T09:59:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.684+0000 7f0edffff640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 0x7f0ee406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.684+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f0eec0ad2f0 con 0x7f0ef80d2e50 2024-04-14T09:59:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.684+0000 7f0ef77fe640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 0x7f0ee406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:13.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.685+0000 7f0ef77fe640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 0x7f0ee406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009aa0 tx=0x7f0ee8009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:13.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.689+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0eec040070 con 0x7f0ef80d2e50 2024-04-14T09:59:13.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.872+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0ef80cdc70 con 0x7f0ef80d2e50 2024-04-14T09:59:13.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.874+0000 7f0edffff640 1 -- 172.21.15.40:0/3457108491 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f0eec0ad110 con 0x7f0ef80d2e50 2024-04-14T09:59:13.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 msgr2=0x7f0ee406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 0x7f0ee406ede0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009aa0 tx=0x7f0ee8009190 comp rx=0 tx=0).stop 2024-04-14T09:59:13.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 msgr2=0x7f0ef80cde90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0097c0 tx=0x7f0eec0046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 shutdown_connections 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f0ee406c920 0x7f0ee406ede0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0ef8161c80 0x7f0ef806c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f0ef80d2e50 0x7f0ef80cde90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 --2- 172.21.15.40:0/3457108491 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ef80d1200 0x7f0ef80cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.876+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 >> 172.21.15.40:0/3457108491 conn(0x7f0ef809d5e0 msgr2=0x7f0ef80b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.877+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 shutdown_connections 2024-04-14T09:59:13.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:13.877+0000 7f0efe036640 1 -- 172.21.15.40:0/3457108491 wait complete. 2024-04-14T09:59:13.888 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-14T09:59:13.888 DEBUG:teuthology.orchestra.run.smithi040:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T09:59:13.935 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-14T09:59:13.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-14T09:59:13.981 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:13.981 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:13.995 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:13.996 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:14.051 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:14.051 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:14.106 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:14.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.247+0000 7f78e4715640 1 Processor -- start 2024-04-14T09:59:14.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.247+0000 7f78e4715640 1 -- start start 2024-04-14T09:59:14.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e4715640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 0x7f78dc0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e4715640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78dc09b150 0x7f78dc168350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e4715640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78dc06c760 con 0x7f78dc06d800 2024-04-14T09:59:14.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e4715640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f78dc06d370 con 0x7f78dc09b150 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e4715640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f78dc06ca40 con 0x7f78dc15e370 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e2cb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78dc09b150 0x7f78dc168350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e2cb2640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78dc09b150 0x7f78dc168350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43840/0 (socket says 172.21.15.40:43840) 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e2cb2640 1 -- 172.21.15.40:0/2983417630 learned_addr learned my addr 172.21.15.40:0/2983417630 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.248+0000 7f78e24b1640 1 --2- 172.21.15.40:0/2983417630 >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 0x7f78dc0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e2cb2640 1 -- 172.21.15.40:0/2983417630 >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 msgr2=0x7f78dc0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e2cb2640 1 --2- 172.21.15.40:0/2983417630 >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 0x7f78dc0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e2cb2640 1 -- 172.21.15.40:0/2983417630 >> v1:172.21.15.136:6789/0 conn(0x7f78dc06d800 legacy=0x7f78dc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e2cb2640 1 -- 172.21.15.40:0/2983417630 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc06cd20 con 0x7f78dc09b150 2024-04-14T09:59:14.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e24b1640 1 --2- 172.21.15.40:0/2983417630 >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 0x7f78dc0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.249+0000 7f78e2cb2640 1 --2- 172.21.15.40:0/2983417630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc09b150 0x7f78dc168350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78dc06f4e0 tx=0x7f78d402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f54149654fef78 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e14af640 1 -- 172.21.15.40:0/2983417630 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d402cb20 con 0x7f78dc09b150 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e14af640 1 -- 172.21.15.40:0/2983417630 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d402ccc0 con 0x7f78dc09b150 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e14af640 1 -- 172.21.15.40:0/2983417630 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4034610 con 0x7f78dc09b150 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 -- 172.21.15.40:0/2983417630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc09b150 msgr2=0x7f78dc168350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 --2- 172.21.15.40:0/2983417630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc09b150 0x7f78dc168350 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f78dc06f4e0 tx=0x7f78d402bf80 comp rx=0 tx=0).stop 2024-04-14T09:59:14.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 -- 172.21.15.40:0/2983417630 shutdown_connections 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 --2- 172.21.15.40:0/2983417630 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc09b150 0x7f78dc168350 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 --2- 172.21.15.40:0/2983417630 >> v2:172.21.15.136:3300/0 conn(0x7f78dc15e370 0x7f78dc0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 -- 172.21.15.40:0/2983417630 >> 172.21.15.40:0/2983417630 conn(0x7f78dc0b3ba0 msgr2=0x7f78dc0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 -- 172.21.15.40:0/2983417630 shutdown_connections 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.250+0000 7f78e4715640 1 -- 172.21.15.40:0/2983417630 wait complete. 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.251+0000 7f78e4715640 1 Processor -- start 2024-04-14T09:59:14.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.251+0000 7f78e4715640 1 -- start start 2024-04-14T09:59:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78dc09b150 0x7f78dc14a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78dc15e370 0x7f78dc160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15e8d0 con 0x7f78dc06d800 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc15e750 con 0x7f78dc09b150 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e4715640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc0d12f0 con 0x7f78dc15e370 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43850/0 (socket says 172.21.15.40:43850) 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 -- 172.21.15.40:0/2947081366 learned_addr learned my addr 172.21.15.40:0/2947081366 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e1cb0640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78dc09b150 0x7f78dc14a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e2cb2640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78dc15e370 0x7f78dc160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 -- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78dc15e370 msgr2=0x7f78dc160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78dc15e370 0x7f78dc160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 -- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78dc09b150 msgr2=0x7f78dc14a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78dc09b150 0x7f78dc14a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.252+0000 7f78e24b1640 1 -- 172.21.15.40:0/2947081366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc1538a0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78e24b1640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78d800d7d0 tx=0x7f78d800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8004030 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d80041d0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc0b57e0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d800b6c0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.253+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc0b5da0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.254+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc0756f0 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.254+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78d800b860 con 0x7f78dc06d800 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.254+0000 7f78d2ffd640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 0x7f78c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.255+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f78d808c050 con 0x7f78dc06d800 2024-04-14T09:59:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.255+0000 7f78e1cb0640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 0x7f78c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.255+0000 7f78e1cb0640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 0x7f78c006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc15ef30 tx=0x7f78cc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.259 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.259+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f78d8059a30 con 0x7f78dc06d800 2024-04-14T09:59:14.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.444+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78dc0b8030 con 0x7f78dc06d800 2024-04-14T09:59:14.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.446+0000 7f78d2ffd640 1 -- 172.21.15.40:0/2947081366 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7f78d805dd30 con 0x7f78dc06d800 2024-04-14T09:59:14.446 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:14.447 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 msgr2=0x7f78c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 0x7f78c006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f78dc15ef30 tx=0x7f78cc009040 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 msgr2=0x7f78dc153b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f78d800d7d0 tx=0x7f78d800dc90 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 shutdown_connections 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f78c006c8f0 0x7f78c006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f78dc15e370 0x7f78dc160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78dc09b150 0x7f78dc14a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.447+0000 7f78e4715640 1 --2- 172.21.15.40:0/2947081366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78dc06d800 0x7f78dc153b50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.448+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 >> 172.21.15.40:0/2947081366 conn(0x7f78dc0b3ba0 msgr2=0x7f78dc0b29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.448+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 shutdown_connections 2024-04-14T09:59:14.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.448+0000 7f78e4715640 1 -- 172.21.15.40:0/2947081366 wait complete. 2024-04-14T09:59:14.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:14.460 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:14.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.564+0000 7f41f5dfe640 1 Processor -- start 2024-04-14T09:59:14.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.564+0000 7f41f5dfe640 1 -- start start 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41f5dfe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41f00c7e30 0x7f41f00d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41f5dfe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 0x7f41f00d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41f5dfe640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41f00d2f30 con 0x7f41f015e3d0 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41f5dfe640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f41f00cf000 con 0x7f41f00c7e30 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41f5dfe640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f41f00cf2e0 con 0x7f41f015e7b0 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41f00c7e30 0x7f41f00d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f41f00c7e30 0x7f41f00d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43852/0 (socket says 172.21.15.40:43852) 2024-04-14T09:59:14.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 -- 172.21.15.40:0/504012466 learned_addr learned my addr 172.21.15.40:0/504012466 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41effff640 1 --2- 172.21.15.40:0/504012466 >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 0x7f41f00d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 -- 172.21.15.40:0/504012466 >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 msgr2=0x7f41f00d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 --2- 172.21.15.40:0/504012466 >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 0x7f41f00d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 -- 172.21.15.40:0/504012466 >> v1:172.21.15.136:6789/0 conn(0x7f41f015e3d0 legacy=0x7f41f00d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41e6ffd640 1 -- 172.21.15.40:0/504012466 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00cf5c0 con 0x7f41f00c7e30 2024-04-14T09:59:14.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.565+0000 7f41effff640 1 --2- 172.21.15.40:0/504012466 >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 0x7f41f00d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:14.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41e6ffd640 1 --2- 172.21.15.40:0/504012466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f00c7e30 0x7f41f00d2170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f41f00ba340 tx=0x7f41d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345cfbfb37d34236 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41eeffd640 1 -- 172.21.15.40:0/504012466 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8034070 con 0x7f41f00c7e30 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41eeffd640 1 -- 172.21.15.40:0/504012466 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d8030860 con 0x7f41f00c7e30 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41eeffd640 1 -- 172.21.15.40:0/504012466 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d8030c30 con 0x7f41f00c7e30 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41f5dfe640 1 -- 172.21.15.40:0/504012466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f00c7e30 msgr2=0x7f41f00d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.566+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/504012466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f00c7e30 0x7f41f00d2170 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f41f00ba340 tx=0x7f41d802b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 -- 172.21.15.40:0/504012466 shutdown_connections 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/504012466 >> v2:172.21.15.136:3300/0 conn(0x7f41f015e7b0 0x7f41f00d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/504012466 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f00c7e30 0x7f41f00d2170 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 -- 172.21.15.40:0/504012466 >> 172.21.15.40:0/504012466 conn(0x7f41f008dc90 msgr2=0x7f41f009d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 -- 172.21.15.40:0/504012466 shutdown_connections 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.567+0000 7f41f5dfe640 1 -- 172.21.15.40:0/504012466 wait complete. 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.568+0000 7f41f5dfe640 1 Processor -- start 2024-04-14T09:59:14.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.568+0000 7f41f5dfe640 1 -- start start 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.568+0000 7f41f5dfe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f00c7e30 0x7f41f0159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.568+0000 7f41f5dfe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f015e3d0 0x7f41f00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00d3390 con 0x7f41f015e7b0 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f41f00d3210 con 0x7f41f00c7e30 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f41f00d4740 con 0x7f41f015e3d0 2024-04-14T09:59:14.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43856/0 (socket says 172.21.15.40:43856) 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 -- 172.21.15.40:0/2065439750 learned_addr learned my addr 172.21.15.40:0/2065439750 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41ef7fe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f00c7e30 0x7f41f0159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41e6ffd640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f015e3d0 0x7f41f00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 -- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f015e3d0 msgr2=0x7f41f00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f015e3d0 0x7f41f00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 -- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f00c7e30 msgr2=0x7f41f0159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f00c7e30 0x7f41f0159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 -- 172.21.15.40:0/2065439750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f00cd7a0 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41effff640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41e8007ea0 tx=0x7f41e8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e801a070 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41e8003bb0 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f00cda80 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41e800de70 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.569+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f00ce040 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.570+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f0075760 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.571+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41e801d070 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.571+0000 7f41ecff9640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 0x7f41d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.572+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f41e808c1a0 con 0x7f41f015e7b0 2024-04-14T09:59:14.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.572+0000 7f41ef7fe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 0x7f41d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.575 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.572+0000 7f41ef7fe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 0x7f41d006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001780 tx=0x7f41e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.576+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f41e8010070 con 0x7f41f015e7b0 2024-04-14T09:59:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.757+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f41f0068e80 con 0x7f41f015e7b0 2024-04-14T09:59:14.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.757+0000 7f41ecff9640 1 -- 172.21.15.40:0/2065439750 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f41e8059b80 con 0x7f41f015e7b0 2024-04-14T09:59:14.758 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 msgr2=0x7f41d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 0x7f41d006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f41e0001780 tx=0x7f41e0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 msgr2=0x7f41f00cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f41e8007ea0 tx=0x7f41e8007f90 comp rx=0 tx=0).stop 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 shutdown_connections 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f41d006c8f0 0x7f41d006edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f41f015e7b0 0x7f41f00cffb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f41f015e3d0 0x7f41f00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 --2- 172.21.15.40:0/2065439750 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f41f00c7e30 0x7f41f0159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 >> 172.21.15.40:0/2065439750 conn(0x7f41f008dc90 msgr2=0x7f41f006cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 shutdown_connections 2024-04-14T09:59:14.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.759+0000 7f41f5dfe640 1 -- 172.21.15.40:0/2065439750 wait complete. 2024-04-14T09:59:14.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:14.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.875+0000 7f6f4a22d640 1 Processor -- start 2024-04-14T09:59:14.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.875+0000 7f6f4a22d640 1 -- start start 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f4a22d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 0x7f6f440d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f4a22d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f4415e7b0 0x7f6f440d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f4a22d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f440d2f30 con 0x7f6f440c7e30 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f4a22d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6f440cf000 con 0x7f6f4415e7b0 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f4a22d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6f440cf2e0 con 0x7f6f4415e3d0 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f4415e7b0 0x7f6f440d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6f4415e7b0 0x7f6f440d2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43866/0 (socket says 172.21.15.40:43866) 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 -- 172.21.15.40:0/198120020 learned_addr learned my addr 172.21.15.40:0/198120020 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f437fe640 1 --2- 172.21.15.40:0/198120020 >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 0x7f6f440d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 -- 172.21.15.40:0/198120020 >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 msgr2=0x7f6f440d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 --2- 172.21.15.40:0/198120020 >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 0x7f6f440d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 -- 172.21.15.40:0/198120020 >> v1:172.21.15.136:6789/0 conn(0x7f6f440c7e30 legacy=0x7f6f440d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f43fff640 1 -- 172.21.15.40:0/198120020 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f440cf5c0 con 0x7f6f4415e7b0 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.876+0000 7f6f437fe640 1 --2- 172.21.15.40:0/198120020 >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 0x7f6f440d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.877+0000 7f6f43fff640 1 --2- 172.21.15.40:0/198120020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f4415e7b0 0x7f6f440d2880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6f440b6e70 tx=0x7f6f3c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8971f47b0b0df515 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.877+0000 7f6f427fc640 1 -- 172.21.15.40:0/198120020 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c02cb20 con 0x7f6f4415e7b0 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.877+0000 7f6f427fc640 1 -- 172.21.15.40:0/198120020 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c02ccc0 con 0x7f6f4415e7b0 2024-04-14T09:59:14.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.877+0000 7f6f427fc640 1 -- 172.21.15.40:0/198120020 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c034610 con 0x7f6f4415e7b0 2024-04-14T09:59:14.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 -- 172.21.15.40:0/198120020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f4415e7b0 msgr2=0x7f6f440d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/198120020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f4415e7b0 0x7f6f440d2880 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6f440b6e70 tx=0x7f6f3c02bf80 comp rx=0 tx=0).stop 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 -- 172.21.15.40:0/198120020 shutdown_connections 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/198120020 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f4415e7b0 0x7f6f440d2880 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/198120020 >> v2:172.21.15.136:3300/0 conn(0x7f6f4415e3d0 0x7f6f440d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 -- 172.21.15.40:0/198120020 >> 172.21.15.40:0/198120020 conn(0x7f6f4408dc90 msgr2=0x7f6f4409d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 -- 172.21.15.40:0/198120020 shutdown_connections 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.878+0000 7f6f4a22d640 1 -- 172.21.15.40:0/198120020 wait complete. 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.879+0000 7f6f4a22d640 1 Processor -- start 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.879+0000 7f6f4a22d640 1 -- start start 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f4415e3d0 0x7f6f441596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f4415e7b0 0x7f6f44160ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6f440d46f0 con 0x7f6f440c7e30 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6f440d4570 con 0x7f6f4415e7b0 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f4a22d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6f440d4870 con 0x7f6f4415e3d0 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43868/0 (socket says 172.21.15.40:43868) 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 -- 172.21.15.40:0/2733107585 learned_addr learned my addr 172.21.15.40:0/2733107585 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f43fff640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f4415e7b0 0x7f6f44160ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f42ffd640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f4415e3d0 0x7f6f441596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 -- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f4415e3d0 msgr2=0x7f6f441596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f4415e3d0 0x7f6f441596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 -- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f4415e7b0 msgr2=0x7f6f44160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f4415e7b0 0x7f6f44160ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.880+0000 7f6f437fe640 1 -- 172.21.15.40:0/2733107585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f440b9930 con 0x7f6f440c7e30 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f437fe640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e960 tx=0x7f6f3400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34017070 con 0x7f6f440c7e30 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3400ca00 con 0x7f6f440c7e30 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f44161710 con 0x7f6f440c7e30 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400cdd0 con 0x7f6f440c7e30 2024-04-14T09:59:14.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.881+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f440cc8f0 con 0x7f6f440c7e30 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.882+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f44075760 con 0x7f6f440c7e30 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.882+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f3401a070 con 0x7f6f440c7e30 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.882+0000 7f6f2bfff640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 0x7f6f3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.883+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6f3408be20 con 0x7f6f440c7e30 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.883+0000 7f6f42ffd640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 0x7f6f3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:14.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.883+0000 7f6f42ffd640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 0x7f6f3006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6f441f7b20 tx=0x7f6f38009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:14.887 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:14.887+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6f34059760 con 0x7f6f440c7e30 2024-04-14T09:59:15.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.074+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6f4406dbb0 con 0x7f6f440c7e30 2024-04-14T09:59:15.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.074+0000 7f6f2bfff640 1 -- 172.21.15.40:0/2733107585 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6f3405da60 con 0x7f6f440c7e30 2024-04-14T09:59:15.075 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:15.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 msgr2=0x7f6f3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 0x7f6f3006edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6f441f7b20 tx=0x7f6f38009040 comp rx=0 tx=0).stop 2024-04-14T09:59:15.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 msgr2=0x7f6f440cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400e960 tx=0x7f6f3400ee20 comp rx=0 tx=0).stop 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 shutdown_connections 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6f3006c8f0 0x7f6f3006edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6f4415e7b0 0x7f6f44160ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6f4415e3d0 0x7f6f441596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 --2- 172.21.15.40:0/2733107585 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6f440c7e30 0x7f6f440cd0f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 >> 172.21.15.40:0/2733107585 conn(0x7f6f4408dc90 msgr2=0x7f6f440d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 shutdown_connections 2024-04-14T09:59:15.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.076+0000 7f6f4a22d640 1 -- 172.21.15.40:0/2733107585 wait complete. 2024-04-14T09:59:15.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:15.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.191+0000 7f93c19cc640 1 Processor -- start 2024-04-14T09:59:15.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 -- start start 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93bc0b4700 0x7f93bc09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93bc0d1e60 con 0x7f93bc06f560 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f93bc0b19c0 con 0x7f93bc0b4700 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.192+0000 7f93c19cc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f93bc0d1670 con 0x7f93bc09aa40 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93ba7fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93bc0b4700 0x7f93bc09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:34372/0 (socket says 172.21.15.40:34372) 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 -- 172.21.15.40:0/2159380870 learned_addr learned my addr 172.21.15.40:0/2159380870 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93bb7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f93bc06f560 0x7f93bc06f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:51816/0 (socket says 172.21.15.40:51816) 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 -- 172.21.15.40:0/2159380870 >> v2:172.21.15.136:3300/0 conn(0x7f93bc0b4700 msgr2=0x7f93bc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:15.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 --2- 172.21.15.40:0/2159380870 >> v2:172.21.15.136:3300/0 conn(0x7f93bc0b4700 0x7f93bc09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 -- 172.21.15.40:0/2159380870 >> v1:172.21.15.136:6789/0 conn(0x7f93bc06f560 legacy=0x7f93bc06f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.193+0000 7f93baffd640 1 -- 172.21.15.40:0/2159380870 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc09b360 con 0x7f93bc09aa40 2024-04-14T09:59:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93baffd640 1 --2- 172.21.15.40:0/2159380870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90ef258b45599d09 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93b9ffb640 1 -- 172.21.15.40:0/2159380870 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4034070 con 0x7f93bc09aa40 2024-04-14T09:59:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93b9ffb640 1 -- 172.21.15.40:0/2159380870 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b4030840 con 0x7f93bc09aa40 2024-04-14T09:59:15.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93b9ffb640 1 -- 172.21.15.40:0/2159380870 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b4030c10 con 0x7f93bc09aa40 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 -- 172.21.15.40:0/2159380870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 msgr2=0x7f93bc070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 --2- 172.21.15.40:0/2159380870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f93b4009870 tx=0x7f93b402b980 comp rx=0 tx=0).stop 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 -- 172.21.15.40:0/2159380870 shutdown_connections 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 --2- 172.21.15.40:0/2159380870 >> v2:172.21.15.136:3300/0 conn(0x7f93bc0b4700 0x7f93bc09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 --2- 172.21.15.40:0/2159380870 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc09aa40 0x7f93bc070810 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 -- 172.21.15.40:0/2159380870 >> 172.21.15.40:0/2159380870 conn(0x7f93bc0b3be0 msgr2=0x7f93bc0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 -- 172.21.15.40:0/2159380870 shutdown_connections 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.194+0000 7f93c19cc640 1 -- 172.21.15.40:0/2159380870 wait complete. 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.195+0000 7f93c19cc640 1 Processor -- start 2024-04-14T09:59:15.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 -- start start 2024-04-14T09:59:15.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 0x7f93bc1dcd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93bc09aa40 0x7f93bc0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc0710c0 con 0x7f93bc0b4700 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f93bc070de0 con 0x7f93bc09aa40 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.196+0000 7f93c19cc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f93bc06c6d0 con 0x7f93bc06f560 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43872/0 (socket says 172.21.15.40:43872) 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 -- 172.21.15.40:0/65224710 learned_addr learned my addr 172.21.15.40:0/65224710 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93baffd640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 0x7f93bc1dcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93ba7fc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93bc09aa40 0x7f93bc0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 -- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 msgr2=0x7f93bc1dcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 0x7f93bc1dcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 -- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93bc09aa40 msgr2=0x7f93bc0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93bc09aa40 0x7f93bc0c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 -- 172.21.15.40:0/65224710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93bc1dd240 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93baffd640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 0x7f93bc1dcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93bb7fe640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c730 tx=0x7f93ac00cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac018070 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93ac004d60 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93bc0c9c10 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac00a880 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.197+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93bc0ca1d0 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.198+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93bc075760 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.199+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93ac01b070 con 0x7f93bc0b4700 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.199+0000 7f93b3fff640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.199+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f93ac08b330 con 0x7f93bc0b4700 2024-04-14T09:59:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.199+0000 7f93baffd640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.200+0000 7f93baffd640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 0x7f939c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93b4036000 tx=0x7f93b4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.204 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.204+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f93bc0d1e60 con 0x7f93bc0b4700 2024-04-14T09:59:15.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.388+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f93bc09af50 con 0x7f93bc0b4700 2024-04-14T09:59:15.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.388+0000 7f93b3fff640 1 -- 172.21.15.40:0/65224710 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f93ac058d10 con 0x7f93bc0b4700 2024-04-14T09:59:15.389 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 msgr2=0x7f939c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 0x7f939c06edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93b4036000 tx=0x7f93b4008030 comp rx=0 tx=0).stop 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 msgr2=0x7f93bc09f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f93ac00c730 tx=0x7f93ac00cb30 comp rx=0 tx=0).stop 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 shutdown_connections 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f939c06c8f0 0x7f939c06edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f93bc0b4700 0x7f93bc09f190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93bc09aa40 0x7f93bc0c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 --2- 172.21.15.40:0/65224710 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93bc06f560 0x7f93bc1dcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 >> 172.21.15.40:0/65224710 conn(0x7f93bc0b3be0 msgr2=0x7f93bc0b1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 shutdown_connections 2024-04-14T09:59:15.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.390+0000 7f93c19cc640 1 -- 172.21.15.40:0/65224710 wait complete. 2024-04-14T09:59:15.401 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:15.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.506+0000 7f9637d5e640 1 Processor -- start 2024-04-14T09:59:15.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 -- start start 2024-04-14T09:59:15.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9630161c80 0x7f96300d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96300d2e50 0x7f96300d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96300d1200 0x7f96300cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f96300b10e0 con 0x7f96300d2e50 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f96300b1380 con 0x7f9630161c80 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9637d5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f96300b1660 con 0x7f96300d1200 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f96352f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96300d2e50 0x7f96300d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f96352f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f96300d2e50 0x7f96300d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43878/0 (socket says 172.21.15.40:43878) 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f96352f9640 1 -- 172.21.15.40:0/2468876385 learned_addr learned my addr 172.21.15.40:0/2468876385 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f9635afa640 1 --2- 172.21.15.40:0/2468876385 >> v2:172.21.15.136:3300/0 conn(0x7f9630161c80 0x7f96300d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.507+0000 7f96362fb640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96300d1200 0x7f96300cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 -- 172.21.15.40:0/2468876385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96300d1200 msgr2=0x7f96300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96300d1200 0x7f96300cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 -- 172.21.15.40:0/2468876385 >> v2:172.21.15.136:3300/0 conn(0x7f9630161c80 msgr2=0x7f96300d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 --2- 172.21.15.40:0/2468876385 >> v2:172.21.15.136:3300/0 conn(0x7f9630161c80 0x7f96300d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 -- 172.21.15.40:0/2468876385 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96300d3340 con 0x7f96300d2e50 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.508+0000 7f96352f9640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f96300d0cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f963008ea10 tx=0x7f962002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35f89707cf5b553 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9634af8640 1 -- 172.21.15.40:0/2468876385 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962002e070 con 0x7f96300d2e50 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9634af8640 1 -- 172.21.15.40:0/2468876385 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620037070 con 0x7f96300d2e50 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9634af8640 1 -- 172.21.15.40:0/2468876385 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620031a00 con 0x7f96300d2e50 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 -- 172.21.15.40:0/2468876385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 msgr2=0x7f96300d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f96300d0cc0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f963008ea10 tx=0x7f962002b880 comp rx=0 tx=0).stop 2024-04-14T09:59:15.511 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 -- 172.21.15.40:0/2468876385 shutdown_connections 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96300d1200 0x7f96300cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 --2- 172.21.15.40:0/2468876385 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f96300d0cc0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 --2- 172.21.15.40:0/2468876385 >> v2:172.21.15.136:3300/0 conn(0x7f9630161c80 0x7f96300d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 -- 172.21.15.40:0/2468876385 >> 172.21.15.40:0/2468876385 conn(0x7f963009d5e0 msgr2=0x7f96300d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 -- 172.21.15.40:0/2468876385 shutdown_connections 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.509+0000 7f9637d5e640 1 -- 172.21.15.40:0/2468876385 wait complete. 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.510+0000 7f9637d5e640 1 Processor -- start 2024-04-14T09:59:15.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.510+0000 7f9637d5e640 1 -- start start 2024-04-14T09:59:15.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 0x7f963015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 0x7f96300ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f96300cf460 con 0x7f96300d2e50 2024-04-14T09:59:15.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96300d0390 con 0x7f96300d1200 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9637d5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f96300cf5e0 con 0x7f9630161c80 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43880/0 (socket says 172.21.15.40:43880) 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 -- 172.21.15.40:0/3329225419 learned_addr learned my addr 172.21.15.40:0/3329225419 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9635afa640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 0x7f963015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96362fb640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 0x7f96300ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 -- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 msgr2=0x7f96300ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 0x7f96300ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 -- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 msgr2=0x7f963015e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 0x7f963015e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96352f9640 1 -- 172.21.15.40:0/3329225419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96300c7eb0 con 0x7f96300d2e50 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f9635afa640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 0x7f963015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.511+0000 7f96362fb640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 0x7f96300ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:15.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f96352f9640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9620000c00 tx=0x7f96200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620032670 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620032830 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620032c20 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96300c8190 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.512+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96300c8750 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.513+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9630075760 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.513+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f962004c060 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.514+0000 7f96267fc640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 0x7f961406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.514+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f96200ad370 con 0x7f96300d2e50 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.514+0000 7f9635afa640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 0x7f961406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.516 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.514+0000 7f9635afa640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 0x7f961406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f962c009af0 tx=0x7f962c008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.518 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.518+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9620040070 con 0x7f96300d2e50 2024-04-14T09:59:15.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.705+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f96300b9270 con 0x7f96300d2e50 2024-04-14T09:59:15.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.705+0000 7f96267fc640 1 -- 172.21.15.40:0/3329225419 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f962007b430 con 0x7f96300d2e50 2024-04-14T09:59:15.706 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 msgr2=0x7f961406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 0x7f961406ede0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f962c009af0 tx=0x7f962c008040 comp rx=0 tx=0).stop 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 msgr2=0x7f963015a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9620000c00 tx=0x7f96200046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 shutdown_connections 2024-04-14T09:59:15.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f961406c920 0x7f961406ede0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9630161c80 0x7f96300ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f96300d2e50 0x7f963015a650 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 --2- 172.21.15.40:0/3329225419 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96300d1200 0x7f963015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 >> 172.21.15.40:0/3329225419 conn(0x7f963009d5e0 msgr2=0x7f96300b9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 shutdown_connections 2024-04-14T09:59:15.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.707+0000 7f9637d5e640 1 -- 172.21.15.40:0/3329225419 wait complete. 2024-04-14T09:59:15.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:59:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.820+0000 7f95c39dc640 1 Processor -- start 2024-04-14T09:59:15.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.820+0000 7f95c39dc640 1 -- start start 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c39dc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95bc0c7e30 0x7f95bc0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c39dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c39dc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc0d2f30 con 0x7f95bc15e3d0 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c39dc640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f95bc0cf000 con 0x7f95bc0c7e30 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c39dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc0cf2e0 con 0x7f95bc15e7b0 2024-04-14T09:59:15.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95bc0c7e30 0x7f95bc0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f95bc0c7e30 0x7f95bc0d2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43890/0 (socket says 172.21.15.40:43890) 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 -- 172.21.15.40:0/837556926 learned_addr learned my addr 172.21.15.40:0/837556926 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c1f79640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 -- 172.21.15.40:0/837556926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 msgr2=0x7f95bc0d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0d26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 -- 172.21.15.40:0/837556926 >> v1:172.21.15.136:6789/0 conn(0x7f95bc15e3d0 legacy=0x7f95bc0d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95b3fff640 1 -- 172.21.15.40:0/837556926 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063652033 0 0) 0x7f95bc0d2f30 con 0x7f95bc15e3d0 2024-04-14T09:59:15.823 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.821+0000 7f95c0f77640 1 -- 172.21.15.40:0/837556926 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc0cf5c0 con 0x7f95bc0c7e30 2024-04-14T09:59:15.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.822+0000 7f95c0f77640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc0c7e30 0x7f95bc0d2170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c90f905d16db25 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.822+0000 7f95b3fff640 1 -- 172.21.15.40:0/837556926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac034070 con 0x7f95bc0c7e30 2024-04-14T09:59:15.824 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.822+0000 7f95b3fff640 1 -- 172.21.15.40:0/837556926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac030840 con 0x7f95bc0c7e30 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.822+0000 7f95b3fff640 1 -- 172.21.15.40:0/837556926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac030c10 con 0x7f95bc0c7e30 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 -- 172.21.15.40:0/837556926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc0c7e30 msgr2=0x7f95bc0d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc0c7e30 0x7f95bc0d2170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac02b980 comp rx=0 tx=0).stop 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 -- 172.21.15.40:0/837556926 shutdown_connections 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0d26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 --2- 172.21.15.40:0/837556926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc0c7e30 0x7f95bc0d2170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 -- 172.21.15.40:0/837556926 >> 172.21.15.40:0/837556926 conn(0x7f95bc08dc90 msgr2=0x7f95bc09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 -- 172.21.15.40:0/837556926 shutdown_connections 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.823+0000 7f95c39dc640 1 -- 172.21.15.40:0/837556926 wait complete. 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.824+0000 7f95c39dc640 1 Processor -- start 2024-04-14T09:59:15.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.824+0000 7f95c39dc640 1 -- start start 2024-04-14T09:59:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95bc0c7e30 0x7f95bc15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc0d3390 con 0x7f95bc15e3d0 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f95bc0d3210 con 0x7f95bc0c7e30 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c39dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f95bc0d4740 con 0x7f95bc15e7b0 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43892/0 (socket says 172.21.15.40:43892) 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 -- 172.21.15.40:0/2370913036 learned_addr learned my addr 172.21.15.40:0/2370913036 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c1778640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95bc0c7e30 0x7f95bc15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c1f79640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 -- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 msgr2=0x7f95bc0b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 -- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95bc0c7e30 msgr2=0x7f95bc15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:15.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95bc0c7e30 0x7f95bc15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 -- 172.21.15.40:0/2370913036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc0b7410 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.825+0000 7f95c0f77640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.826+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac048070 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.826+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ac030640 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.826+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc0b76f0 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.826+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ac034040 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.826+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95bc0b7cb0 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.827+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95bc0d3aa0 con 0x7f95bc15e3d0 2024-04-14T09:59:15.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.827+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95ac04b070 con 0x7f95bc15e3d0 2024-04-14T09:59:15.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.828+0000 7f95b1ffb640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 0x7f95a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:15.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.828+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f95ac0add40 con 0x7f95bc15e3d0 2024-04-14T09:59:15.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.828+0000 7f95c1778640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 0x7f95a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:15.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.828+0000 7f95c1778640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 0x7f95a006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95b40012e0 tx=0x7f95b4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:15.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:15.832+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f95bc0d3aa0 con 0x7f95bc15e3d0 2024-04-14T09:59:16.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.028+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95bc075760 con 0x7f95bc15e3d0 2024-04-14T09:59:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.029+0000 7f95b1ffb640 1 -- 172.21.15.40:0/2370913036 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f95ac07b7b0 con 0x7f95bc15e3d0 2024-04-14T09:59:16.030 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 msgr2=0x7f95a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 0x7f95a006edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f95b40012e0 tx=0x7f95b4009040 comp rx=0 tx=0).stop 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 msgr2=0x7f95bc0cdb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f95ac009870 tx=0x7f95ac004730 comp rx=0 tx=0).stop 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 shutdown_connections 2024-04-14T09:59:16.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f95a006c8f0 0x7f95a006edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f95bc15e7b0 0x7f95bc0b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f95bc15e3d0 0x7f95bc0cdb60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 --2- 172.21.15.40:0/2370913036 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f95bc0c7e30 0x7f95bc15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 >> 172.21.15.40:0/2370913036 conn(0x7f95bc08dc90 msgr2=0x7f95bc0d1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 shutdown_connections 2024-04-14T09:59:16.033 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.031+0000 7f95c39dc640 1 -- 172.21.15.40:0/2370913036 wait complete. 2024-04-14T09:59:16.042 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T09:59:16.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:16.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-04-14T09:59:16.070 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:59:16.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:16.071 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T09:59:16.126 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:16.126 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:16.142 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:16.143 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:16.198 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:16.198 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:16.253 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:16.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.354+0000 7fe90995e640 1 Processor -- start 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.354+0000 7fe90995e640 1 -- start start 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe90995e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe90415e370 0x7fe9040d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe90995e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90406c760 con 0x7fe90409b150 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe90995e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe90406ca40 con 0x7fe90406d800 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe90995e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe90406d370 con 0x7fe90415e370 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe902ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe90415e370 0x7fe9040d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe902ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe90415e370 0x7fe9040d0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43906/0 (socket says 172.21.15.40:43906) 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe902ffd640 1 -- 172.21.15.40:0/3910152366 learned_addr learned my addr 172.21.15.40:0/3910152366 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.355+0000 7fe9037fe640 1 --1- 172.21.15.40:0/3910152366 >> v1:172.21.15.40:6789/0 conn(0x7fe90409b150 0x7fe904168350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37870/0 (socket says 172.21.15.40:37870) 2024-04-14T09:59:16.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe902ffd640 1 -- 172.21.15.40:0/3910152366 >> v1:172.21.15.136:6789/0 conn(0x7fe90406d800 legacy=0x7fe90409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe902ffd640 1 -- 172.21.15.40:0/3910152366 >> v1:172.21.15.40:6789/0 conn(0x7fe90409b150 legacy=0x7fe904168350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe901ffb640 1 -- 172.21.15.40:0/3910152366 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294385643 0 0) 0x7fe90406c760 con 0x7fe90409b150 2024-04-14T09:59:16.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe902ffd640 1 -- 172.21.15.40:0/3910152366 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90406cd20 con 0x7fe90415e370 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe902ffd640 1 --2- 172.21.15.40:0/3910152366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90415e370 0x7fe9040d0db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009870 tx=0x7fe8fc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79db0406cc608443 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.356+0000 7fe901ffb640 1 -- 172.21.15.40:0/3910152366 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc02f840 con 0x7fe90415e370 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe901ffb640 1 -- 172.21.15.40:0/3910152366 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc02f9e0 con 0x7fe90415e370 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe901ffb640 1 -- 172.21.15.40:0/3910152366 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc02fdb0 con 0x7fe90415e370 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 -- 172.21.15.40:0/3910152366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90415e370 msgr2=0x7fe9040d0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.359 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 --2- 172.21.15.40:0/3910152366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90415e370 0x7fe9040d0db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc009870 tx=0x7fe8fc02ba20 comp rx=0 tx=0).stop 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 -- 172.21.15.40:0/3910152366 shutdown_connections 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 --2- 172.21.15.40:0/3910152366 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90415e370 0x7fe9040d0db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 -- 172.21.15.40:0/3910152366 >> 172.21.15.40:0/3910152366 conn(0x7fe9040b3ba0 msgr2=0x7fe9040b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 -- 172.21.15.40:0/3910152366 shutdown_connections 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.357+0000 7fe90995e640 1 -- 172.21.15.40:0/3910152366 wait complete. 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.358+0000 7fe90995e640 1 Processor -- start 2024-04-14T09:59:16.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.358+0000 7fe90995e640 1 -- start start 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe90409b150 0x7fe90415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe90415e370 0x7fe90409bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe90415e8d0 con 0x7fe90406d800 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe90415e750 con 0x7fe90409b150 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe90995e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe9040d12f0 con 0x7fe90415e370 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe902ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:43910/0 (socket says 172.21.15.40:43910) 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe902ffd640 1 -- 172.21.15.40:0/688655495 learned_addr learned my addr 172.21.15.40:0/688655495 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe9027fc640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe90409b150 0x7fe90415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.362 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.359+0000 7fe9037fe640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe90415e370 0x7fe90409bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 -- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe90415e370 msgr2=0x7fe90409bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe90415e370 0x7fe90409bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 -- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe90409b150 msgr2=0x7fe90415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe90409b150 0x7fe90415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 -- 172.21.15.40:0/688655495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe90415a950 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe902ffd640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000c00 tx=0x7fe8fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc041400 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8fc046070 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9040b5bf0 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc041800 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.360+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9040b61b0 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.361+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9040756f0 con 0x7fe90406d800 2024-04-14T09:59:16.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.362+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe8fc040070 con 0x7fe90406d800 2024-04-14T09:59:16.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.362+0000 7fe8fbfff640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 0x7fe8e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.362+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe8fc0ae5a0 con 0x7fe90406d800 2024-04-14T09:59:16.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.362+0000 7fe9027fc640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 0x7fe8e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.363+0000 7fe9027fc640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 0x7fe8e406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe9040c8be0 tx=0x7fe8ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.367 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.366+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe8fc033030 con 0x7fe90406d800 2024-04-14T09:59:16.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.555+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe90415ac40 con 0x7fe90406d800 2024-04-14T09:59:16.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.558+0000 7fe8fbfff640 1 -- 172.21.15.40:0/688655495 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fe8fc07c010 con 0x7fe90406d800 2024-04-14T09:59:16.559 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:16.559 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:16.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 msgr2=0x7fe8e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 0x7fe8e406edb0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe9040c8be0 tx=0x7fe8ec009040 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 msgr2=0x7fe9040c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000c00 tx=0x7fe8fc004730 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 shutdown_connections 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe8e406c8f0 0x7fe8e406edb0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe90415e370 0x7fe90409bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe90409b150 0x7fe90415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 --2- 172.21.15.40:0/688655495 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe90406d800 0x7fe9040c7220 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 >> 172.21.15.40:0/688655495 conn(0x7fe9040b3ba0 msgr2=0x7fe90409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 shutdown_connections 2024-04-14T09:59:16.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.560+0000 7fe90995e640 1 -- 172.21.15.40:0/688655495 wait complete. 2024-04-14T09:59:16.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:16.573 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:16.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 Processor -- start 2024-04-14T09:59:16.677 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 -- start start 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 0x7fc27c0d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc27c0d2f30 con 0x7fc27c15e3d0 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc27c0cf000 con 0x7fc27c0c7e30 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.677+0000 7fc281236640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c0cf2e0 con 0x7fc27c15e7b0 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27a59c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 0x7fc27c0d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:58568/0 (socket says 172.21.15.40:58568) 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27ad9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fc27c15e3d0 0x7fc27c0d4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41718/0 (socket says 172.21.15.40:41718) 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 -- 172.21.15.40:0/478298915 learned_addr learned my addr 172.21.15.40:0/478298915 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 -- 172.21.15.40:0/478298915 >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 msgr2=0x7fc27c0d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 --2- 172.21.15.40:0/478298915 >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 0x7fc27c0d2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.679 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 -- 172.21.15.40:0/478298915 >> v1:172.21.15.136:6789/0 conn(0x7fc27c15e3d0 legacy=0x7fc27c0d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27b59e640 1 -- 172.21.15.40:0/478298915 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c0cf5c0 con 0x7fc27c15e7b0 2024-04-14T09:59:16.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.678+0000 7fc27a59c640 1 --2- 172.21.15.40:0/478298915 >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 0x7fc27c0d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:16.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc27b59e640 1 --2- 172.21.15.40:0/478298915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27402bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0233ae2d154a504 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc279d9b640 1 -- 172.21.15.40:0/478298915 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc27402caf0 con 0x7fc27c15e7b0 2024-04-14T09:59:16.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc279d9b640 1 -- 172.21.15.40:0/478298915 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27402cc90 con 0x7fc27c15e7b0 2024-04-14T09:59:16.681 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc279d9b640 1 -- 172.21.15.40:0/478298915 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274034610 con 0x7fc27c15e7b0 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 -- 172.21.15.40:0/478298915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 msgr2=0x7fc27c0d26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 --2- 172.21.15.40:0/478298915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc274009e50 tx=0x7fc27402bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 -- 172.21.15.40:0/478298915 shutdown_connections 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 --2- 172.21.15.40:0/478298915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e7b0 0x7fc27c0d26b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 --2- 172.21.15.40:0/478298915 >> v2:172.21.15.136:3300/0 conn(0x7fc27c0c7e30 0x7fc27c0d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 -- 172.21.15.40:0/478298915 >> 172.21.15.40:0/478298915 conn(0x7fc27c08dc90 msgr2=0x7fc27c09d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 -- 172.21.15.40:0/478298915 shutdown_connections 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.679+0000 7fc281236640 1 -- 172.21.15.40:0/478298915 wait complete. 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.681+0000 7fc281236640 1 Processor -- start 2024-04-14T09:59:16.682 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.681+0000 7fc281236640 1 -- start start 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc27c0c7e30 0x7fc27c0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e3d0 0x7fc27c0b8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c0d3390 con 0x7fc27c15e7b0 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc27c0d3210 con 0x7fc27c0c7e30 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc27c0d4740 con 0x7fc27c15e3d0 2024-04-14T09:59:16.684 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33166/0 (socket says 172.21.15.40:33166) 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 -- 172.21.15.40:0/2139072394 learned_addr learned my addr 172.21.15.40:0/2139072394 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27a59c640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e3d0 0x7fc27c0b8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27ad9d640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc27c0c7e30 0x7fc27c0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 -- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e3d0 msgr2=0x7fc27c0b8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e3d0 0x7fc27c0b8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 -- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc27c0c7e30 msgr2=0x7fc27c0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc27c0c7e30 0x7fc27c0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 -- 172.21.15.40:0/2139072394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c15ebc0 con 0x7fc27c15e7b0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc27b59e640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc274036040 tx=0x7fc274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274043020 con 0x7fc27c15e7b0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc27403e450 con 0x7fc27c15e7b0 2024-04-14T09:59:16.685 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc27c15ee80 con 0x7fc27c15e7b0 2024-04-14T09:59:16.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc274009510 con 0x7fc27c15e7b0 2024-04-14T09:59:16.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.682+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc27c15f440 con 0x7fc27c15e7b0 2024-04-14T09:59:16.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.683+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc27c075760 con 0x7fc27c15e7b0 2024-04-14T09:59:16.686 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.684+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc274046020 con 0x7fc27c15e7b0 2024-04-14T09:59:16.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.684+0000 7fc2637fe640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 0x7fc26806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.684+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc2740ae570 con 0x7fc27c15e7b0 2024-04-14T09:59:16.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.685+0000 7fc27ad9d640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 0x7fc26806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.685+0000 7fc27ad9d640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 0x7fc26806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000f60 tx=0x7fc26c007e20 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.689+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc27404d030 con 0x7fc27c15e7b0 2024-04-14T09:59:16.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.870+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc27c0cb170 con 0x7fc27c15e7b0 2024-04-14T09:59:16.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.871+0000 7fc2637fe640 1 -- 172.21.15.40:0/2139072394 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc27407bf50 con 0x7fc27c15e7b0 2024-04-14T09:59:16.871 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:16.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 msgr2=0x7fc26806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 0x7fc26806edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc26c000f60 tx=0x7fc26c007e20 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 msgr2=0x7fc27c0b9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc274036040 tx=0x7fc274004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 shutdown_connections 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc26806c8f0 0x7fc26806edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc27c15e7b0 0x7fc27c0b9210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc27c15e3d0 0x7fc27c0b8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 --2- 172.21.15.40:0/2139072394 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc27c0c7e30 0x7fc27c0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 >> 172.21.15.40:0/2139072394 conn(0x7fc27c08dc90 msgr2=0x7fc27c15cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 shutdown_connections 2024-04-14T09:59:16.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.873+0000 7fc281236640 1 -- 172.21.15.40:0/2139072394 wait complete. 2024-04-14T09:59:16.884 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.989+0000 7fb0e195e640 1 Processor -- start 2024-04-14T09:59:16.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.989+0000 7fb0e195e640 1 -- start start 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0e195e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb0dc15fb20 0x7fb0dc070f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0e195e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc0ce660 0x7fb0dc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0e195e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc0cd810 con 0x7fb0dc09af80 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0e195e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc09b9d0 con 0x7fb0dc15fb20 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0e195e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc15ff00 con 0x7fb0dc0ce660 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0db7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb0dc09af80 0x7fb0dc0cfcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37952/0 (socket says 172.21.15.40:37952) 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0db7fe640 1 -- 172.21.15.40:0/300954658 learned_addr learned my addr 172.21.15.40:0/300954658 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:16.991 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0daffd640 1 --2- 172.21.15.40:0/300954658 >> v2:172.21.15.136:3300/0 conn(0x7fb0dc15fb20 0x7fb0dc070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0da7fc640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc0ce660 0x7fb0dc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0d9ffb640 1 -- 172.21.15.40:0/300954658 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2561996746 0 0) 0x7fb0dc0cd810 con 0x7fb0dc09af80 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0daffd640 1 -- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc0ce660 msgr2=0x7fb0dc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0daffd640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc0ce660 0x7fb0dc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0daffd640 1 -- 172.21.15.40:0/300954658 >> v1:172.21.15.40:6789/0 conn(0x7fb0dc09af80 legacy=0x7fb0dc0cfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.990+0000 7fb0daffd640 1 -- 172.21.15.40:0/300954658 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc09b6f0 con 0x7fb0dc15fb20 2024-04-14T09:59:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.991+0000 7fb0daffd640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc070f60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097a0 tx=0x7fb0d402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4418c00159694fbc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.991+0000 7fb0d9ffb640 1 -- 172.21.15.40:0/300954658 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4035020 con 0x7fb0dc15fb20 2024-04-14T09:59:16.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.991+0000 7fb0d9ffb640 1 -- 172.21.15.40:0/300954658 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4031830 con 0x7fb0dc15fb20 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.991+0000 7fb0d9ffb640 1 -- 172.21.15.40:0/300954658 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4031c00 con 0x7fb0dc15fb20 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 -- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 msgr2=0x7fb0dc070f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc070f60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb0d40097a0 tx=0x7fb0d402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 -- 172.21.15.40:0/300954658 shutdown_connections 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc0ce660 0x7fb0dc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 --2- 172.21.15.40:0/300954658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc070f60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 -- 172.21.15.40:0/300954658 >> 172.21.15.40:0/300954658 conn(0x7fb0dc0b3be0 msgr2=0x7fb0dc0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 -- 172.21.15.40:0/300954658 shutdown_connections 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.992+0000 7fb0e195e640 1 -- 172.21.15.40:0/300954658 wait complete. 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.993+0000 7fb0e195e640 1 Processor -- start 2024-04-14T09:59:16.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.993+0000 7fb0e195e640 1 -- start start 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc09af80 0x7fb0dc14d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc14de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0cdd90 con 0x7fb0dc0ce660 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0d1000 con 0x7fb0dc15fb20 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0e195e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc09b410 con 0x7fb0dc09af80 2024-04-14T09:59:16.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33168/0 (socket says 172.21.15.40:33168) 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 -- 172.21.15.40:0/861810582 learned_addr learned my addr 172.21.15.40:0/861810582 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0daffd640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc09af80 0x7fb0dc14d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0db7fe640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc14de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 -- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc09af80 msgr2=0x7fb0dc14d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc09af80 0x7fb0dc14d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 -- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 msgr2=0x7fb0dc14de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc14de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 -- 172.21.15.40:0/861810582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0ca2f0 con 0x7fb0dc0ce660 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0da7fc640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400e9e0 tx=0x7fb0c400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.994+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c4017070 con 0x7fb0dc0ce660 2024-04-14T09:59:16.998 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.995+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c400c9d0 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.995+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc0ca5b0 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.995+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c400cdc0 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.995+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc0cab70 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.996+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc075760 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.996+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0c401a070 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.996+0000 7fb0d3fff640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.996+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb0c408bf20 con 0x7fb0dc0ce660 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.997+0000 7fb0daffd640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:16.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:16.997+0000 7fb0daffd640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4036000 tx=0x7fb0d403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.001+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb0c4059860 con 0x7fb0dc0ce660 2024-04-14T09:59:17.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.184+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb0dc1e6010 con 0x7fb0dc0ce660 2024-04-14T09:59:17.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.185+0000 7fb0d3fff640 1 -- 172.21.15.40:0/861810582 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7fb0c405db60 con 0x7fb0dc0ce660 2024-04-14T09:59:17.185 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:17.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 msgr2=0x7fb0bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4036000 tx=0x7fb0d403d040 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 msgr2=0x7fb0dc0cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb0c400e9e0 tx=0x7fb0c400eea0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 shutdown_connections 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb0dc15fb20 0x7fb0dc14de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb0dc0ce660 0x7fb0dc0cb370 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 --2- 172.21.15.40:0/861810582 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0dc09af80 0x7fb0dc14d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.186+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 >> 172.21.15.40:0/861810582 conn(0x7fb0dc0b3be0 msgr2=0x7fb0dc15e720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.187+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 shutdown_connections 2024-04-14T09:59:17.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.187+0000 7fb0e195e640 1 -- 172.21.15.40:0/861810582 wait complete. 2024-04-14T09:59:17.198 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:17.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.302+0000 7fd85d836640 1 Processor -- start 2024-04-14T09:59:17.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.302+0000 7fd85d836640 1 -- start start 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd85d836640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858161ca0 0x7fd8580d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd85d836640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd858162bb0 0x7fd8580cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd85d836640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd858163040 con 0x7fd8580d0c80 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd85d836640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580d5000 con 0x7fd858161ca0 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd85d836640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd8580cf0d0 con 0x7fd858162bb0 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858161ca0 0x7fd8580d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd858161ca0 0x7fd8580d4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33174/0 (socket says 172.21.15.40:33174) 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 -- 172.21.15.40:0/127321070 learned_addr learned my addr 172.21.15.40:0/127321070 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd8567fc640 1 --2- 172.21.15.40:0/127321070 >> v2:172.21.15.136:3300/0 conn(0x7fd858162bb0 0x7fd8580cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 -- 172.21.15.40:0/127321070 >> v2:172.21.15.136:3300/0 conn(0x7fd858162bb0 msgr2=0x7fd8580cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 --2- 172.21.15.40:0/127321070 >> v2:172.21.15.136:3300/0 conn(0x7fd858162bb0 0x7fd8580cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 -- 172.21.15.40:0/127321070 >> v1:172.21.15.136:6789/0 conn(0x7fd8580d0c80 legacy=0x7fd8580d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.303+0000 7fd856ffd640 1 -- 172.21.15.40:0/127321070 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8580cf3b0 con 0x7fd858161ca0 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.304+0000 7fd856ffd640 1 --2- 172.21.15.40:0/127321070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd8580d4980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd85806bd50 tx=0x7fd85002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5209fcc2d36efa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.304+0000 7fd855ffb640 1 -- 172.21.15.40:0/127321070 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850035020 con 0x7fd858161ca0 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.304+0000 7fd855ffb640 1 -- 172.21.15.40:0/127321070 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd850031870 con 0x7fd858161ca0 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.304+0000 7fd855ffb640 1 -- 172.21.15.40:0/127321070 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd850031c40 con 0x7fd858161ca0 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 -- 172.21.15.40:0/127321070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 msgr2=0x7fd8580d4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 --2- 172.21.15.40:0/127321070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd8580d4980 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd85806bd50 tx=0x7fd85002b910 comp rx=0 tx=0).stop 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 -- 172.21.15.40:0/127321070 shutdown_connections 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 --2- 172.21.15.40:0/127321070 >> v2:172.21.15.136:3300/0 conn(0x7fd858162bb0 0x7fd8580cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 --2- 172.21.15.40:0/127321070 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd8580d4980 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 -- 172.21.15.40:0/127321070 >> 172.21.15.40:0/127321070 conn(0x7fd85809d5c0 msgr2=0x7fd8580d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 -- 172.21.15.40:0/127321070 shutdown_connections 2024-04-14T09:59:17.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.305+0000 7fd85d836640 1 -- 172.21.15.40:0/127321070 wait complete. 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.306+0000 7fd85d836640 1 Processor -- start 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.306+0000 7fd85d836640 1 -- start start 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8580d0c80 0x7fd8581f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd858162bb0 0x7fd85814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580ced80 con 0x7fd858161ca0 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd8580d00f0 con 0x7fd858162bb0 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd85d836640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd8580b70c0 con 0x7fd8580d0c80 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33180/0 (socket says 172.21.15.40:33180) 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 -- 172.21.15.40:0/3357618944 learned_addr learned my addr 172.21.15.40:0/3357618944 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd856ffd640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8580d0c80 0x7fd8581f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8577fe640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd858162bb0 0x7fd85814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 -- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8580d0c80 msgr2=0x7fd8581f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8580d0c80 0x7fd8581f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 -- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd858162bb0 msgr2=0x7fd85814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd858162bb0 0x7fd85814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 -- 172.21.15.40:0/3357618944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8581f48d0 con 0x7fd858161ca0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd8567fc640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e870 tx=0x7fd84000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.307+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd840017070 con 0x7fd858161ca0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.308+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd84000c940 con 0x7fd858161ca0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.308+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85814b6a0 con 0x7fd858161ca0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.308+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84000cd30 con 0x7fd858161ca0 2024-04-14T09:59:17.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.308+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85814bc60 con 0x7fd858161ca0 2024-04-14T09:59:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.309+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd858075760 con 0x7fd858161ca0 2024-04-14T09:59:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.309+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd84001a070 con 0x7fd858161ca0 2024-04-14T09:59:17.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.309+0000 7fd84ffff640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.310+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fd84008bd70 con 0x7fd858161ca0 2024-04-14T09:59:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.310+0000 7fd856ffd640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.310+0000 7fd856ffd640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd850036000 tx=0x7fd85003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.314+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd8581f48d0 con 0x7fd858161ca0 2024-04-14T09:59:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.496+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd8580d0a60 con 0x7fd858161ca0 2024-04-14T09:59:17.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.497+0000 7fd84ffff640 1 -- 172.21.15.40:0/3357618944 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fd840059750 con 0x7fd858161ca0 2024-04-14T09:59:17.497 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:17.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 msgr2=0x7fd83806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 0x7fd83806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd850036000 tx=0x7fd85003c040 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 msgr2=0x7fd85814e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd84000e870 tx=0x7fd84000ed30 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 shutdown_connections 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd83806c8f0 0x7fd83806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd858162bb0 0x7fd85814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd858161ca0 0x7fd85814e6d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 --2- 172.21.15.40:0/3357618944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd8580d0c80 0x7fd8581f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 >> 172.21.15.40:0/3357618944 conn(0x7fd85809d5c0 msgr2=0x7fd85806c350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 shutdown_connections 2024-04-14T09:59:17.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.499+0000 7fd85d836640 1 -- 172.21.15.40:0/3357618944 wait complete. 2024-04-14T09:59:17.510 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:17.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 Processor -- start 2024-04-14T09:59:17.617 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 -- start start 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b6015e5d0 0x7f5b600cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b600cf7b0 con 0x7f5b600cf210 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b600cfa90 con 0x7f5b600d4880 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b6651e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6015e9b0 con 0x7f5b6015e5d0 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.617+0000 7f5b5ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5b6015e5d0 0x7f5b600cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5b600cf210 0x7f5b600d4170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37956/0 (socket says 172.21.15.40:37956) 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5f7fe640 1 -- 172.21.15.40:0/977319837 learned_addr learned my addr 172.21.15.40:0/977319837 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 472199327 0 0) 0x7f5b600cf7b0 con 0x7f5b600cf210 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b4c003520 con 0x7f5b600cf210 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5ffff640 1 -- 172.21.15.40:0/977319837 >> v1:172.21.15.136:6789/0 conn(0x7f5b600d4880 legacy=0x7f5b600d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374308081 0 0) 0x7f5b600cfa90 con 0x7f5b600d4880 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5ffff640 1 -- 172.21.15.40:0/977319837 >> v1:172.21.15.40:6789/0 conn(0x7f5b600cf210 legacy=0x7f5b600d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.618+0000 7f5b5ffff640 1 -- 172.21.15.40:0/977319837 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b600cfd70 con 0x7f5b6015e5d0 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b5ffff640 1 --2- 172.21.15.40:0/977319837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b6015e5d0 0x7f5b600cecd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b500097a0 tx=0x7f5b5002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700a9533cd6a7834 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50034070 con 0x7f5b6015e5d0 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b50030610 con 0x7f5b6015e5d0 2024-04-14T09:59:17.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b5effd640 1 -- 172.21.15.40:0/977319837 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b500309e0 con 0x7f5b6015e5d0 2024-04-14T09:59:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 -- 172.21.15.40:0/977319837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b6015e5d0 msgr2=0x7f5b600cecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 --2- 172.21.15.40:0/977319837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b6015e5d0 0x7f5b600cecd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b500097a0 tx=0x7f5b5002b960 comp rx=0 tx=0).stop 2024-04-14T09:59:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 -- 172.21.15.40:0/977319837 shutdown_connections 2024-04-14T09:59:17.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 --2- 172.21.15.40:0/977319837 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b6015e5d0 0x7f5b600cecd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 -- 172.21.15.40:0/977319837 >> 172.21.15.40:0/977319837 conn(0x7f5b6008dce0 msgr2=0x7f5b6009d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 -- 172.21.15.40:0/977319837 shutdown_connections 2024-04-14T09:59:17.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.619+0000 7f5b6651e640 1 -- 172.21.15.40:0/977319837 wait complete. 2024-04-14T09:59:17.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.620+0000 7f5b6651e640 1 Processor -- start 2024-04-14T09:59:17.622 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 -- start start 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5b600cf210 0x7f5b600b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b6015e5d0 0x7f5b60154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5b600b5820 con 0x7f5b600d4880 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5b600d03c0 con 0x7f5b6015e5d0 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b6651e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5b600b59a0 con 0x7f5b600cf210 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33192/0 (socket says 172.21.15.40:33192) 2024-04-14T09:59:17.624 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.621+0000 7f5b5f7fe640 1 -- 172.21.15.40:0/3342300407 learned_addr learned my addr 172.21.15.40:0/3342300407 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b64abb640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b6015e5d0 0x7f5b60154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5ffff640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5b600cf210 0x7f5b600b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 -- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5b600cf210 msgr2=0x7f5b600b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5b600cf210 0x7f5b600b2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 -- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b6015e5d0 msgr2=0x7f5b60154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b6015e5d0 0x7f5b60154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 -- 172.21.15.40:0/3342300407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b600b3180 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5f7fe640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c430 tx=0x7f5b4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b48017070 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b48005ce0 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b600b3460 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b480072f0 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.622+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b600cbf90 con 0x7f5b600d4880 2024-04-14T09:59:17.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.623+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b600d46a0 con 0x7f5b600d4880 2024-04-14T09:59:17.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.623+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b4801a070 con 0x7f5b600d4880 2024-04-14T09:59:17.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.624+0000 7f5b5cff9640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 0x7f5b4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.624+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f5b4808b2a0 con 0x7f5b600d4880 2024-04-14T09:59:17.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.624+0000 7f5b5ffff640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 0x7f5b4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.624+0000 7f5b5ffff640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 0x7f5b4006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b50036000 tx=0x7f5b5003c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.628+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5b600d46a0 con 0x7f5b600d4880 2024-04-14T09:59:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.812+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f5b60075760 con 0x7f5b600d4880 2024-04-14T09:59:17.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.813+0000 7f5b5cff9640 1 -- 172.21.15.40:0/3342300407 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f5b48058d10 con 0x7f5b600d4880 2024-04-14T09:59:17.813 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:17.815 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 msgr2=0x7f5b4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 0x7f5b4006edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b50036000 tx=0x7f5b5003c040 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 msgr2=0x7f5b600b79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b4800c430 tx=0x7f5b4800c8f0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 shutdown_connections 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5b4006c8f0 0x7f5b4006edb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5b6015e5d0 0x7f5b60154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5b600d4880 0x7f5b600b79d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 --2- 172.21.15.40:0/3342300407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5b600cf210 0x7f5b600b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.814+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 >> 172.21.15.40:0/3342300407 conn(0x7f5b6008dce0 msgr2=0x7f5b6006d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.815+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 shutdown_connections 2024-04-14T09:59:17.816 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.815+0000 7f5b6651e640 1 -- 172.21.15.40:0/3342300407 wait complete. 2024-04-14T09:59:17.826 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:59:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.928+0000 7fba653c8640 1 Processor -- start 2024-04-14T09:59:17.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.928+0000 7fba653c8640 1 -- start start 2024-04-14T09:59:17.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba653c8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fba6015e3d0 0x7fba600d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba653c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba600d2f30 con 0x7fba6015e7b0 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba653c8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba600cf000 con 0x7fba600c7e30 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba653c8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fba600cf2e0 con 0x7fba6015e3d0 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba5f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba6015e7b0 0x7fba600cfae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37972/0 (socket says 172.21.15.40:37972) 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba5f7fe640 1 -- 172.21.15.40:0/4020568736 learned_addr learned my addr 172.21.15.40:0/4020568736 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.929+0000 7fba5effd640 1 --2- 172.21.15.40:0/4020568736 >> v2:172.21.15.136:3300/0 conn(0x7fba6015e3d0 0x7fba600d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637733987 0 0) 0x7fba600d2f30 con 0x7fba6015e7b0 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba4c003520 con 0x7fba6015e7b0 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5effd640 1 -- 172.21.15.40:0/4020568736 >> v1:172.21.15.136:6789/0 conn(0x7fba600c7e30 legacy=0x7fba600d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5effd640 1 -- 172.21.15.40:0/4020568736 >> v1:172.21.15.40:6789/0 conn(0x7fba6015e7b0 legacy=0x7fba600cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1325523905 0 0) 0x7fba600cf000 con 0x7fba600c7e30 2024-04-14T09:59:17.931 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.930+0000 7fba5effd640 1 -- 172.21.15.40:0/4020568736 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba600cf5c0 con 0x7fba6015e3d0 2024-04-14T09:59:17.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba5effd640 1 --2- 172.21.15.40:0/4020568736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600d4030 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba580097a0 tx=0x7fba5802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac05b5aaa59f806d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba58034070 con 0x7fba6015e3d0 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba58030610 con 0x7fba6015e3d0 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba5dffb640 1 -- 172.21.15.40:0/4020568736 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba580309c0 con 0x7fba6015e3d0 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 -- 172.21.15.40:0/4020568736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 msgr2=0x7fba600d4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 --2- 172.21.15.40:0/4020568736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600d4030 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fba580097a0 tx=0x7fba5802b960 comp rx=0 tx=0).stop 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 -- 172.21.15.40:0/4020568736 shutdown_connections 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 --2- 172.21.15.40:0/4020568736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600d4030 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 -- 172.21.15.40:0/4020568736 >> 172.21.15.40:0/4020568736 conn(0x7fba6008dc90 msgr2=0x7fba6009d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 -- 172.21.15.40:0/4020568736 shutdown_connections 2024-04-14T09:59:17.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.931+0000 7fba653c8640 1 -- 172.21.15.40:0/4020568736 wait complete. 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 Processor -- start 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 -- start start 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba600c7e30 0x7fba600ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba600d2a00 con 0x7fba6015e7b0 2024-04-14T09:59:17.935 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba600d2880 con 0x7fba6015e3d0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba653c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fba600d2b80 con 0x7fba600c7e30 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.933+0000 7fba5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33194/0 (socket says 172.21.15.40:33194) 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 -- 172.21.15.40:0/1323932836 learned_addr learned my addr 172.21.15.40:0/1323932836 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5effd640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba600c7e30 0x7fba600ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5e7fc640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 -- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba600c7e30 msgr2=0x7fba600ccf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba600c7e30 0x7fba600ccf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 -- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 msgr2=0x7fba600ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 -- 172.21.15.40:0/1323932836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba600cbe70 con 0x7fba6015e7b0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba5f7fe640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fba5000cad0 tx=0x7fba5000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba50017070 con 0x7fba6015e7b0 2024-04-14T09:59:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba5000ac30 con 0x7fba6015e7b0 2024-04-14T09:59:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba50012400 con 0x7fba6015e7b0 2024-04-14T09:59:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba600cc150 con 0x7fba6015e7b0 2024-04-14T09:59:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.934+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba600cc710 con 0x7fba6015e7b0 2024-04-14T09:59:17.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.935+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba60075760 con 0x7fba6015e7b0 2024-04-14T09:59:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.936+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba5001a070 con 0x7fba6015e7b0 2024-04-14T09:59:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.936+0000 7fba577fe640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 0x7fba4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.936+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fba5008bc60 con 0x7fba6015e7b0 2024-04-14T09:59:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.936+0000 7fba5effd640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 0x7fba4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:17.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.937+0000 7fba5effd640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 0x7fba4006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba58036000 tx=0x7fba5803b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:17.941 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:17.940+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fba50059640 con 0x7fba6015e7b0 2024-04-14T09:59:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.135+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba600cb170 con 0x7fba6015e7b0 2024-04-14T09:59:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.136+0000 7fba577fe640 1 -- 172.21.15.40:0/1323932836 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7fba5008b070 con 0x7fba6015e7b0 2024-04-14T09:59:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:59:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 msgr2=0x7fba4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 0x7fba4006edb0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba58036000 tx=0x7fba5803b040 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 msgr2=0x7fba600cb3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fba5000cad0 tx=0x7fba5000cf90 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 shutdown_connections 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba4006c8f0 0x7fba4006edb0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba6015e7b0 0x7fba600cb3b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba6015e3d0 0x7fba600ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.137+0000 7fba653c8640 1 --2- 172.21.15.40:0/1323932836 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba600c7e30 0x7fba600ccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.138+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 >> 172.21.15.40:0/1323932836 conn(0x7fba6008dc90 msgr2=0x7fba60162660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.138+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 shutdown_connections 2024-04-14T09:59:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.138+0000 7fba653c8640 1 -- 172.21.15.40:0/1323932836 wait complete. 2024-04-14T09:59:18.149 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-14T09:59:18.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:18.149 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-04-14T09:59:18.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:59:18.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:18.178 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-14T09:59:18.341 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:18.341 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:18.359 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:18.360 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:18.414 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:18.414 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:18.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:18.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.610+0000 7ff2ed5e0640 1 Processor -- start 2024-04-14T09:59:18.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.610+0000 7ff2ed5e0640 1 -- start start 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2ed5e0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff2e80d0da0 0x7ff2e80cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2ed5e0640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e80ccba0 con 0x7ff2e815c330 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2ed5e0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2e80cce40 con 0x7ff2e80b46c0 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2ed5e0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff2e80cd770 con 0x7ff2e80d0da0 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2e6ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff2e815c330 0x7ff2e80d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37988/0 (socket says 172.21.15.40:37988) 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2e6ffd640 1 -- 172.21.15.40:0/1284531370 learned_addr learned my addr 172.21.15.40:0/1284531370 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2e67fc640 1 --2- 172.21.15.40:0/1284531370 >> v2:172.21.15.136:3300/0 conn(0x7ff2e80d0da0 0x7ff2e80cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.611+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040416848 0 0) 0x7ff2e80ccba0 con 0x7ff2e815c330 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2d4003520 con 0x7ff2e815c330 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492417926 0 0) 0x7ff2e80cce40 con 0x7ff2e80b46c0 2024-04-14T09:59:18.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2e80ccba0 con 0x7ff2e80b46c0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e67fc640 1 -- 172.21.15.40:0/1284531370 >> v1:172.21.15.136:6789/0 conn(0x7ff2e80b46c0 legacy=0x7ff2e806f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e67fc640 1 -- 172.21.15.40:0/1284531370 >> v1:172.21.15.40:6789/0 conn(0x7ff2e815c330 legacy=0x7ff2e80d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e67fc640 1 -- 172.21.15.40:0/1284531370 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e80cd120 con 0x7ff2e80d0da0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.612+0000 7ff2e67fc640 1 --2- 172.21.15.40:0/1284531370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80d0da0 0x7ff2e80cdc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00097a0 tx=0x7ff2d002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1b633235ad95a5d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d0034070 con 0x7ff2e80d0da0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d0030610 con 0x7ff2e80d0da0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2e5ffb640 1 -- 172.21.15.40:0/1284531370 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d00309e0 con 0x7ff2e80d0da0 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/1284531370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80d0da0 msgr2=0x7ff2e80cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/1284531370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80d0da0 0x7ff2e80cdc00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00097a0 tx=0x7ff2d002b960 comp rx=0 tx=0).stop 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/1284531370 shutdown_connections 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/1284531370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80d0da0 0x7ff2e80cdc00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/1284531370 >> 172.21.15.40:0/1284531370 conn(0x7ff2e80b3ba0 msgr2=0x7ff2e80b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/1284531370 shutdown_connections 2024-04-14T09:59:18.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.613+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/1284531370 wait complete. 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.614+0000 7ff2ed5e0640 1 Processor -- start 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.614+0000 7ff2ed5e0640 1 -- start start 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 0x7ff2e80b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2e80d0da0 0x7ff2e81f5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e80cfe00 con 0x7ff2e815c330 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e80cfc80 con 0x7ff2e80b46c0 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2ed5e0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff2e80cff80 con 0x7ff2e80d0da0 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2e77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2e77fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33206/0 (socket says 172.21.15.40:33206) 2024-04-14T09:59:18.618 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2e77fe640 1 -- 172.21.15.40:0/878836608 learned_addr learned my addr 172.21.15.40:0/878836608 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2e6ffd640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 0x7ff2e80b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.615+0000 7ff2e67fc640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2e80d0da0 0x7ff2e81f5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 -- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2e80d0da0 msgr2=0x7ff2e81f5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2e80d0da0 0x7ff2e81f5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 -- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 msgr2=0x7ff2e80b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 0x7ff2e80b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 -- 172.21.15.40:0/878836608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e80b6000 con 0x7ff2e815c330 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e6ffd640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 0x7ff2e80b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2e77fe640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c7a0 tx=0x7ff2d800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8003b70 con 0x7ff2e815c330 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2d8003d30 con 0x7ff2e815c330 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e80b62e0 con 0x7ff2e815c330 2024-04-14T09:59:18.619 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2d800aa90 con 0x7ff2e815c330 2024-04-14T09:59:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.616+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e81f3280 con 0x7ff2e815c330 2024-04-14T09:59:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.617+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e80756f0 con 0x7ff2e815c330 2024-04-14T09:59:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.617+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2d800ac30 con 0x7ff2e815c330 2024-04-14T09:59:18.620 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.618+0000 7ff2df7fe640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.618+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff2d808bcc0 con 0x7ff2e815c330 2024-04-14T09:59:18.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.618+0000 7ff2e6ffd640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.621 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.618+0000 7ff2e6ffd640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 0x7ff2c806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000f60 tx=0x7ff2e0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.623 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.623+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff2d8059730 con 0x7ff2e815c330 2024-04-14T09:59:18.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.809+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2e80b8030 con 0x7ff2e815c330 2024-04-14T09:59:18.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.810+0000 7ff2df7fe640 1 -- 172.21.15.40:0/878836608 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7ff2d805da30 con 0x7ff2e815c330 2024-04-14T09:59:18.811 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:18.811 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:18.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 msgr2=0x7ff2c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 0x7ff2c806edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0000f60 tx=0x7ff2e0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 msgr2=0x7ff2e81f5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff2d800c7a0 tx=0x7ff2d800cc60 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 shutdown_connections 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff2c806c8f0 0x7ff2c806edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff2e815c330 0x7ff2e81f5770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2e80d0da0 0x7ff2e81f5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 --2- 172.21.15.40:0/878836608 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2e80b46c0 0x7ff2e80b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.812+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 >> 172.21.15.40:0/878836608 conn(0x7ff2e80b3ba0 msgr2=0x7ff2e80d0690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.813+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 shutdown_connections 2024-04-14T09:59:18.814 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.813+0000 7ff2ed5e0640 1 -- 172.21.15.40:0/878836608 wait complete. 2024-04-14T09:59:18.824 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:18.825 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.929+0000 7f90c2b7b640 1 Processor -- start 2024-04-14T09:59:18.930 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.929+0000 7f90c2b7b640 1 -- start start 2024-04-14T09:59:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f90bc0d0830 0x7f90bc0cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90bc0b1590 0x7f90bc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0c10 0x7f90bc09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.932 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f90bc06f890 con 0x7f90bc0b1590 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f90bc15c900 con 0x7f90bc0d0830 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c2b7b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc0cd6e0 con 0x7f90bc0d0c10 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90bc0b1590 0x7f90bc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f90bc0b1590 0x7f90bc09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33214/0 (socket says 172.21.15.40:33214) 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 -- 172.21.15.40:0/351944198 learned_addr learned my addr 172.21.15.40:0/351944198 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c0917640 1 --2- 172.21.15.40:0/351944198 >> v2:172.21.15.136:3300/0 conn(0x7f90bc0d0830 0x7f90bc0cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90c1118640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0c10 0x7f90bc09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 -- 172.21.15.40:0/351944198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0c10 msgr2=0x7f90bc09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0c10 0x7f90bc09af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 -- 172.21.15.40:0/351944198 >> v2:172.21.15.136:3300/0 conn(0x7f90bc0d0830 msgr2=0x7f90bc0cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 --2- 172.21.15.40:0/351944198 >> v2:172.21.15.136:3300/0 conn(0x7f90bc0d0830 0x7f90bc0cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.930+0000 7f90bbfff640 1 -- 172.21.15.40:0/351944198 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc0cd9c0 con 0x7f90bc0b1590 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.931+0000 7f90bbfff640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc09aa40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90bc074c20 tx=0x7f90a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd5d6c12cb68fb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.933 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.931+0000 7f90bb7fe640 1 -- 172.21.15.40:0/351944198 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8035020 con 0x7f90bc0b1590 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.931+0000 7f90bb7fe640 1 -- 172.21.15.40:0/351944198 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a8031870 con 0x7f90bc0b1590 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.931+0000 7f90bb7fe640 1 -- 172.21.15.40:0/351944198 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8031c40 con 0x7f90bc0b1590 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- 172.21.15.40:0/351944198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 msgr2=0x7f90bc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc09aa40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f90bc074c20 tx=0x7f90a802b910 comp rx=0 tx=0).stop 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- 172.21.15.40:0/351944198 shutdown_connections 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0c10 0x7f90bc09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/351944198 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc09aa40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/351944198 >> v2:172.21.15.136:3300/0 conn(0x7f90bc0d0830 0x7f90bc0cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- 172.21.15.40:0/351944198 >> 172.21.15.40:0/351944198 conn(0x7f90bc0b3ad0 msgr2=0x7f90bc0b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- 172.21.15.40:0/351944198 shutdown_connections 2024-04-14T09:59:18.934 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- 172.21.15.40:0/351944198 wait complete. 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 Processor -- start 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.933+0000 7f90c2b7b640 1 -- start start 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0830 0x7f90bc156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90bc0d0c10 0x7f90bc1f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc06f520 con 0x7f90bc0b1590 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90bc0cdf80 con 0x7f90bc0d0c10 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90bc09b4c0 con 0x7f90bc0d0830 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33216/0 (socket says 172.21.15.40:33216) 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 -- 172.21.15.40:0/647666857 learned_addr learned my addr 172.21.15.40:0/647666857 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90bbfff640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0830 0x7f90bc156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c1118640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90bc0d0c10 0x7f90bc1f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 -- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0830 msgr2=0x7f90bc156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0830 0x7f90bc156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 -- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90bc0d0c10 msgr2=0x7f90bc1f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90bc0d0c10 0x7f90bc1f5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:18.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 -- 172.21.15.40:0/647666857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90bc0b6c00 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c0917640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9b0 tx=0x7f90b000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0017070 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90b000c9a0 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90bc0b6ee0 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b000cd90 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.934+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90bc09fa60 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.935+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90bc156e90 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.936+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90b001a070 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.936+0000 7f90b97fa640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 0x7f90a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.937+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f90b008be40 con 0x7f90bc0b1590 2024-04-14T09:59:18.939 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.937+0000 7f90bbfff640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 0x7f90a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:18.940 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.937+0000 7f90bbfff640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 0x7f90a006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90a8036000 tx=0x7f90a803c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:18.942 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:18.941+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f90b00598b0 con 0x7f90bc0b1590 2024-04-14T09:59:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.126+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f90bc075760 con 0x7f90bc0b1590 2024-04-14T09:59:19.127 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.127+0000 7f90b97fa640 1 -- 172.21.15.40:0/647666857 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f90b00600d0 con 0x7f90bc0b1590 2024-04-14T09:59:19.127 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 msgr2=0x7f90a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 0x7f90a006edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f90a8036000 tx=0x7f90a803c040 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 msgr2=0x7f90bc1562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9b0 tx=0x7f90b000ee70 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 shutdown_connections 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f90a006c8f0 0x7f90a006edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f90bc0d0c10 0x7f90bc1f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f90bc0d0830 0x7f90bc156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 --2- 172.21.15.40:0/647666857 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f90bc0b1590 0x7f90bc1562c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 >> 172.21.15.40:0/647666857 conn(0x7f90bc0b3ad0 msgr2=0x7f90bc0ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 shutdown_connections 2024-04-14T09:59:19.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.129+0000 7f90c2b7b640 1 -- 172.21.15.40:0/647666857 wait complete. 2024-04-14T09:59:19.141 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:19.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 Processor -- start 2024-04-14T09:59:19.246 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 -- start start 2024-04-14T09:59:19.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f84280cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8428070d30 0x7f842809b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f842815c900 con 0x7f84280b1590 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f842806f890 con 0x7f8428070d30 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842e6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f84280cd6e0 con 0x7f84280d0830 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f84277fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f84280b1590 0x7f842809aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38002/0 (socket says 172.21.15.40:38002) 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f84277fe640 1 -- 172.21.15.40:0/743984346 learned_addr learned my addr 172.21.15.40:0/743984346 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f8427fff640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f84280cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842cc7b640 1 --2- 172.21.15.40:0/743984346 >> v2:172.21.15.136:3300/0 conn(0x7f8428070d30 0x7f842809b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f8426ffd640 1 -- 172.21.15.40:0/743984346 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123706409 0 0) 0x7f842815c900 con 0x7f84280b1590 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f8426ffd640 1 -- 172.21.15.40:0/743984346 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8410003520 con 0x7f84280b1590 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842cc7b640 1 -- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 msgr2=0x7f84280cfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842cc7b640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f84280cfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842cc7b640 1 -- 172.21.15.40:0/743984346 >> v1:172.21.15.40:6789/0 conn(0x7f84280b1590 legacy=0x7f842809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f842cc7b640 1 -- 172.21.15.40:0/743984346 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84280cd9c0 con 0x7f8428070d30 2024-04-14T09:59:19.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.246+0000 7f8427fff640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f84280cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.247+0000 7f842cc7b640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842809b150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8420009d90 tx=0x7f842002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4f466bf7f3d0c5f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.247+0000 7f8426ffd640 1 -- 172.21.15.40:0/743984346 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420039070 con 0x7f8428070d30 2024-04-14T09:59:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.247+0000 7f8426ffd640 1 -- 172.21.15.40:0/743984346 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842002cc50 con 0x7f8428070d30 2024-04-14T09:59:19.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.247+0000 7f8426ffd640 1 -- 172.21.15.40:0/743984346 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420034440 con 0x7f8428070d30 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 -- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 msgr2=0x7f842809b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842809b150 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8420009d90 tx=0x7f842002bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 -- 172.21.15.40:0/743984346 shutdown_connections 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842809b150 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 --2- 172.21.15.40:0/743984346 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f84280cfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 -- 172.21.15.40:0/743984346 >> 172.21.15.40:0/743984346 conn(0x7f84280b3ad0 msgr2=0x7f84280b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 -- 172.21.15.40:0/743984346 shutdown_connections 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.248+0000 7f842e6de640 1 -- 172.21.15.40:0/743984346 wait complete. 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.249+0000 7f842e6de640 1 Processor -- start 2024-04-14T09:59:19.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.249+0000 7f842e6de640 1 -- start start 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f8428150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f842806f520 con 0x7f84280b1590 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f84280cdf80 con 0x7f8428070d30 2024-04-14T09:59:19.252 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842e6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f842809b690 con 0x7f84280d0830 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33224/0 (socket says 172.21.15.40:33224) 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 -- 172.21.15.40:0/3676031930 learned_addr learned my addr 172.21.15.40:0/3676031930 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f8427fff640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f842cc7b640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f8428150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 -- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 msgr2=0x7f8428150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f8428150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 -- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 msgr2=0x7f842814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 -- 172.21.15.40:0/3676031930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f842814fc90 con 0x7f84280b1590 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.250+0000 7f84277fe640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c430 tx=0x7f841c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.251+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c017070 con 0x7f84280b1590 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.251+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f841c005ce0 con 0x7f84280b1590 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.251+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f841c0072f0 con 0x7f84280b1590 2024-04-14T09:59:19.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.251+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f842814ff70 con 0x7f84280b1590 2024-04-14T09:59:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.251+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8428150530 con 0x7f84280b1590 2024-04-14T09:59:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.252+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8428075760 con 0x7f84280b1590 2024-04-14T09:59:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.252+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f841c01a070 con 0x7f84280b1590 2024-04-14T09:59:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.253+0000 7f8424ff9640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.253+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f841c08b380 con 0x7f84280b1590 2024-04-14T09:59:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.253+0000 7f8427fff640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.253+0000 7f8427fff640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 0x7f841406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f842815bf30 tx=0x7f8418009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.258 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.257+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f841c058d60 con 0x7f84280b1590 2024-04-14T09:59:19.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.441+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f84280d03a0 con 0x7f84280b1590 2024-04-14T09:59:19.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.441+0000 7f8424ff9640 1 -- 172.21.15.40:0/3676031930 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f841c05d060 con 0x7f84280b1590 2024-04-14T09:59:19.442 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 msgr2=0x7f841406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 0x7f841406edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f842815bf30 tx=0x7f8418009190 comp rx=0 tx=0).stop 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 msgr2=0x7f84280cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c430 tx=0x7f841c00c8f0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 shutdown_connections 2024-04-14T09:59:19.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f841406c8f0 0x7f841406edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84280d0830 0x7f8428150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84280b1590 0x7f84280cb3a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 --2- 172.21.15.40:0/3676031930 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8428070d30 0x7f842814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 >> 172.21.15.40:0/3676031930 conn(0x7f84280b3ad0 msgr2=0x7f84280b2860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 shutdown_connections 2024-04-14T09:59:19.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.443+0000 7f842e6de640 1 -- 172.21.15.40:0/3676031930 wait complete. 2024-04-14T09:59:19.455 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:19.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.559+0000 7f6e40bbb640 1 Processor -- start 2024-04-14T09:59:19.559 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.559+0000 7f6e40bbb640 1 -- start start 2024-04-14T09:59:19.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e40bbb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.560 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e40bbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e40bbb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0ce110 con 0x7f6e3c15c340 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e40bbb640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0d0710 con 0x7f6e3c15c720 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e40bbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0cd030 con 0x7f6e3c06f630 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e39d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e3a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6e3c15c340 0x7f6e3c0cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38018/0 (socket says 172.21.15.40:38018) 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e3a59c640 1 -- 172.21.15.40:0/1669422163 learned_addr learned my addr 172.21.15.40:0/1669422163 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.560+0000 7f6e39d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33236/0 (socket says 172.21.15.40:33236) 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e39d9b640 1 -- 172.21.15.40:0/1669422163 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 msgr2=0x7f6e3c0cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e39d9b640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e39d9b640 1 -- 172.21.15.40:0/1669422163 >> v1:172.21.15.40:6789/0 conn(0x7f6e3c15c340 legacy=0x7f6e3c0cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e3959a640 1 -- 172.21.15.40:0/1669422163 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550427417 0 0) 0x7f6e2c001110 con 0x7f6e3c15c340 2024-04-14T09:59:19.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.561+0000 7f6e39d9b640 1 -- 172.21.15.40:0/1669422163 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0d0960 con 0x7f6e3c15c720 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e39d9b640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097a0 tx=0x7f6e3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf18e4b0fa3b7f5f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e3959a640 1 -- 172.21.15.40:0/1669422163 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30035020 con 0x7f6e3c15c720 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e3959a640 1 -- 172.21.15.40:0/1669422163 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e30031830 con 0x7f6e3c15c720 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e3959a640 1 -- 172.21.15.40:0/1669422163 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30031c00 con 0x7f6e3c15c720 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 -- 172.21.15.40:0/1669422163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 msgr2=0x7f6e3c0b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6e300097a0 tx=0x7f6e3002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 -- 172.21.15.40:0/1669422163 shutdown_connections 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/1669422163 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0b4740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 -- 172.21.15.40:0/1669422163 >> 172.21.15.40:0/1669422163 conn(0x7f6e3c0b3c20 msgr2=0x7f6e3c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 -- 172.21.15.40:0/1669422163 shutdown_connections 2024-04-14T09:59:19.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.562+0000 7f6e40bbb640 1 -- 172.21.15.40:0/1669422163 wait complete. 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 Processor -- start 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 -- start start 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0d0f20 con 0x7f6e3c15c340 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c06fae0 con 0x7f6e3c15c720 2024-04-14T09:59:19.565 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.564+0000 7f6e40bbb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c0ccc20 con 0x7f6e3c06f630 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33252/0 (socket says 172.21.15.40:33252) 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 -- 172.21.15.40:0/3811074319 learned_addr learned my addr 172.21.15.40:0/3811074319 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e3ad9d640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 -- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 msgr2=0x7f6e3c0ca8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0ca8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 -- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c720 msgr2=0x7f6e3c0c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 -- 172.21.15.40:0/3811074319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0cc310 con 0x7f6e3c15c340 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e39d9b640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e3002bee0 tx=0x7f6e300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.566 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30041070 con 0x7f6e3c15c340 2024-04-14T09:59:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3003f070 con 0x7f6e3c15c340 2024-04-14T09:59:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30035040 con 0x7f6e3c15c340 2024-04-14T09:59:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c0cbd50 con 0x7f6e3c15c340 2024-04-14T09:59:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.565+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c06c740 con 0x7f6e3c15c340 2024-04-14T09:59:19.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.566+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c0d1520 con 0x7f6e3c15c340 2024-04-14T09:59:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.567+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e30038020 con 0x7f6e3c15c340 2024-04-14T09:59:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.567+0000 7f6e2affd640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 0x7f6e1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.567+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f6e300ad790 con 0x7f6e3c15c340 2024-04-14T09:59:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.567+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 0x7f6e1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.568+0000 7f6e3a59c640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 0x7f6e1c06ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.573+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6e3c0d1520 con 0x7f6e3c15c340 2024-04-14T09:59:19.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.759+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6e3c075760 con 0x7f6e3c15c340 2024-04-14T09:59:19.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.759+0000 7f6e2affd640 1 -- 172.21.15.40:0/3811074319 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f6e30031800 con 0x7f6e3c15c340 2024-04-14T09:59:19.759 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 msgr2=0x7f6e1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 0x7f6e1c06ede0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e2c000f60 tx=0x7f6e2c007b50 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 msgr2=0x7f6e3c15a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6e3002bee0 tx=0x7f6e300046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 shutdown_connections 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6e1c06c920 0x7f6e1c06ede0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e3c15c720 0x7f6e3c0c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6e3c15c340 0x7f6e3c15a650 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 --2- 172.21.15.40:0/3811074319 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e3c06f630 0x7f6e3c0ca8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 >> 172.21.15.40:0/3811074319 conn(0x7f6e3c0b3c20 msgr2=0x7f6e3c0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 shutdown_connections 2024-04-14T09:59:19.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.761+0000 7f6e40bbb640 1 -- 172.21.15.40:0/3811074319 wait complete. 2024-04-14T09:59:19.771 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:19.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.876+0000 7fc2ee515640 1 Processor -- start 2024-04-14T09:59:19.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.876+0000 7fc2ee515640 1 -- start start 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ee515640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc2e815e7b0 0x7fc2e80d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ee515640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e80d2f30 con 0x7fc2e815e3d0 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ee515640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2e80cf000 con 0x7fc2e80c7e30 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ee515640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc2e80cf2e0 con 0x7fc2e815e7b0 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2e7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc2e815e3d0 0x7fc2e80d4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38030/0 (socket says 172.21.15.40:38030) 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2e7fff640 1 -- 172.21.15.40:0/1478795954 learned_addr learned my addr 172.21.15.40:0/1478795954 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ecab2640 1 --2- 172.21.15.40:0/1478795954 >> v2:172.21.15.136:3300/0 conn(0x7fc2e815e7b0 0x7fc2e80d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431839195 0 0) 0x7fc2e80d2f30 con 0x7fc2e815e3d0 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2d0003520 con 0x7fc2e815e3d0 2024-04-14T09:59:19.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ecab2640 1 -- 172.21.15.40:0/1478795954 >> v1:172.21.15.136:6789/0 conn(0x7fc2e80c7e30 legacy=0x7fc2e80d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2ecab2640 1 -- 172.21.15.40:0/1478795954 >> v1:172.21.15.40:6789/0 conn(0x7fc2e815e3d0 legacy=0x7fc2e80d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.877+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 303488356 0 0) 0x7fc2e80cf000 con 0x7fc2e80c7e30 2024-04-14T09:59:19.878 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.878+0000 7fc2ecab2640 1 -- 172.21.15.40:0/1478795954 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e80cf5c0 con 0x7fc2e815e7b0 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.878+0000 7fc2ecab2640 1 --2- 172.21.15.40:0/1478795954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e80d2880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009d90 tx=0x7fc2e002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4beba78588d91190 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.878+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0039070 con 0x7fc2e815e7b0 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.878+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e002cd00 con 0x7fc2e815e7b0 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2e6ffd640 1 -- 172.21.15.40:0/1478795954 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0034660 con 0x7fc2e815e7b0 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 -- 172.21.15.40:0/1478795954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 msgr2=0x7fc2e80d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 --2- 172.21.15.40:0/1478795954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e80d2880 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009d90 tx=0x7fc2e002bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 -- 172.21.15.40:0/1478795954 shutdown_connections 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 --2- 172.21.15.40:0/1478795954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e80d2880 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 -- 172.21.15.40:0/1478795954 >> 172.21.15.40:0/1478795954 conn(0x7fc2e808dc90 msgr2=0x7fc2e809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 -- 172.21.15.40:0/1478795954 shutdown_connections 2024-04-14T09:59:19.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.879+0000 7fc2ee515640 1 -- 172.21.15.40:0/1478795954 wait complete. 2024-04-14T09:59:19.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.880+0000 7fc2ee515640 1 Processor -- start 2024-04-14T09:59:19.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.880+0000 7fc2ee515640 1 -- start start 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e815e3d0 0x7fc2e80b6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e80d48c0 con 0x7fc2e80c7e30 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e80d4740 con 0x7fc2e815e7b0 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ee515640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc2e80d4a40 con 0x7fc2e815e3d0 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33258/0 (socket says 172.21.15.40:33258) 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e7fff640 1 -- 172.21.15.40:0/3708335580 learned_addr learned my addr 172.21.15.40:0/3708335580 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2ecab2640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e77fe640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e815e3d0 0x7fc2e80b6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e7fff640 1 -- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e815e3d0 msgr2=0x7fc2e80b6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.881+0000 7fc2e7fff640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e815e3d0 0x7fc2e80b6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e7fff640 1 -- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 msgr2=0x7fc2e815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e7fff640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e815fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e7fff640 1 -- 172.21.15.40:0/3708335580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e80cca10 con 0x7fc2e80c7e30 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e7fff640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c460 tx=0x7fc2d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8017070 con 0x7fc2e80c7e30 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2d8005ce0 con 0x7fc2e80c7e30 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e80cccf0 con 0x7fc2e80c7e30 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8007290 con 0x7fc2e80c7e30 2024-04-14T09:59:19.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.882+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e81f3d30 con 0x7fc2e80c7e30 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.883+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2e8075760 con 0x7fc2e80c7e30 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.884+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2d801a070 con 0x7fc2e80c7e30 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.884+0000 7fc2e4ff9640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 0x7fc2d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.884+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc2d808b310 con 0x7fc2e80c7e30 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.884+0000 7fc2e77fe640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 0x7fc2d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:19.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.885+0000 7fc2e77fe640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 0x7fc2d406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2e815def0 tx=0x7fc2dc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:19.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:19.889+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc2d8058c60 con 0x7fc2e80c7e30 2024-04-14T09:59:20.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.075+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc2e80d51d0 con 0x7fc2e80c7e30 2024-04-14T09:59:20.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.075+0000 7fc2e4ff9640 1 -- 172.21.15.40:0/3708335580 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc2d805cf60 con 0x7fc2e80c7e30 2024-04-14T09:59:20.075 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 msgr2=0x7fc2d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 0x7fc2d406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc2e815def0 tx=0x7fc2dc009040 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 msgr2=0x7fc2e81f37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800c460 tx=0x7fc2d800c920 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 shutdown_connections 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc2d406c8f0 0x7fc2d406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc2e815e7b0 0x7fc2e815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc2e815e3d0 0x7fc2e80b6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 --2- 172.21.15.40:0/3708335580 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc2e80c7e30 0x7fc2e81f37f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 >> 172.21.15.40:0/3708335580 conn(0x7fc2e808dc90 msgr2=0x7fc2e80c9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:20.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 shutdown_connections 2024-04-14T09:59:20.078 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.077+0000 7fc2ee515640 1 -- 172.21.15.40:0/3708335580 wait complete. 2024-04-14T09:59:20.088 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:59:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.190+0000 7f1bf4cde640 1 Processor -- start 2024-04-14T09:59:20.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.190+0000 7f1bf4cde640 1 -- start start 2024-04-14T09:59:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bf4cde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 0x7f1bf00d2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bf4cde640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf00d2f30 con 0x7f1bf00c7e30 2024-04-14T09:59:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bf4cde640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf00cf000 con 0x7f1bf015e3d0 2024-04-14T09:59:20.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bf4cde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf00cf2e0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bedd9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1bf00c7e30 0x7f1bf00d2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38040/0 (socket says 172.21.15.40:38040) 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bedd9b640 1 -- 172.21.15.40:0/4062632051 learned_addr learned my addr 172.21.15.40:0/4062632051 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1beed9d640 1 --2- 172.21.15.40:0/4062632051 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 0x7f1bf00d2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.191+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3008018260 0 0) 0x7f1bf00d2f30 con 0x7f1bf00c7e30 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bdc003520 con 0x7f1bf00c7e30 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307116178 0 0) 0x7f1bf00cf000 con 0x7f1bf015e3d0 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bf00d2f30 con 0x7f1bf015e3d0 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1beed9d640 1 -- 172.21.15.40:0/4062632051 >> v1:172.21.15.136:6789/0 conn(0x7f1bf015e3d0 legacy=0x7f1bf00d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1beed9d640 1 -- 172.21.15.40:0/4062632051 >> v1:172.21.15.40:6789/0 conn(0x7f1bf00c7e30 legacy=0x7f1bf00d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1beed9d640 1 -- 172.21.15.40:0/4062632051 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf00cf5c0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.192+0000 7f1beed9d640 1 --2- 172.21.15.40:0/4062632051 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 0x7f1bf00d2880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009dc0 tx=0x7f1be002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b241bf832c257f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0039070 con 0x7f1bf015e7b0 2024-04-14T09:59:20.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be002ccd0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bed59a640 1 -- 172.21.15.40:0/4062632051 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0034640 con 0x7f1bf015e7b0 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 -- 172.21.15.40:0/4062632051 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 msgr2=0x7f1bf00d2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/4062632051 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 0x7f1bf00d2880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009dc0 tx=0x7f1be002bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 -- 172.21.15.40:0/4062632051 shutdown_connections 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/4062632051 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e7b0 0x7f1bf00d2880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 -- 172.21.15.40:0/4062632051 >> 172.21.15.40:0/4062632051 conn(0x7f1bf008dc90 msgr2=0x7f1bf009d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 -- 172.21.15.40:0/4062632051 shutdown_connections 2024-04-14T09:59:20.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.193+0000 7f1bf4cde640 1 -- 172.21.15.40:0/4062632051 wait complete. 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.194+0000 7f1bf4cde640 1 Processor -- start 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 -- start start 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bf00c7e30 0x7f1bf015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e3d0 0x7f1bf015af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00d48c0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf00d4740 con 0x7f1bf00c7e30 2024-04-14T09:59:20.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bf4cde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf00d4a40 con 0x7f1bf015e3d0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1beed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33268/0 (socket says 172.21.15.40:33268) 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1beed9d640 1 -- 172.21.15.40:0/1789503230 learned_addr learned my addr 172.21.15.40:0/1789503230 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bee59c640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bf00c7e30 0x7f1bf015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.195+0000 7f1bedd9b640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e3d0 0x7f1bf015af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 -- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e3d0 msgr2=0x7f1bf015af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e3d0 0x7f1bf015af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 -- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bf00c7e30 msgr2=0x7f1bf015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bf00c7e30 0x7f1bf015eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 -- 172.21.15.40:0/1789503230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf00b8a30 con 0x7f1bf015e7b0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1beed9d640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009ee0 tx=0x7f1be0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0039050 con 0x7f1bf015e7b0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be0045070 con 0x7f1bf015e7b0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf01e8910 con 0x7f1bf015e7b0 2024-04-14T09:59:20.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0009450 con 0x7f1bf015e7b0 2024-04-14T09:59:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.196+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf01e8ed0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.197+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf00b8c00 con 0x7f1bf015e7b0 2024-04-14T09:59:20.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.198+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1be003e850 con 0x7f1bf015e7b0 2024-04-14T09:59:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.198+0000 7f1be6ffd640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 0x7f1bd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.198+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1be00aeb00 con 0x7f1bf015e7b0 2024-04-14T09:59:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.198+0000 7f1bee59c640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 0x7f1bd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.198+0000 7f1bee59c640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 0x7f1bd006edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1be8007fd0 tx=0x7f1be8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.202+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1be007c6c0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.398+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1bf0075760 con 0x7f1bf015e7b0 2024-04-14T09:59:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.398+0000 7f1be6ffd640 1 -- 172.21.15.40:0/1789503230 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f1be00809c0 con 0x7f1bf015e7b0 2024-04-14T09:59:20.398 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:59:20.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 msgr2=0x7f1bd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 0x7f1bd006edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1be8007fd0 tx=0x7f1be8009040 comp rx=0 tx=0).stop 2024-04-14T09:59:20.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 msgr2=0x7f1bf01e7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1be0009ee0 tx=0x7f1be0004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 shutdown_connections 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1bd006c8f0 0x7f1bd006edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1bf015e7b0 0x7f1bf01e7f50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bf015e3d0 0x7f1bf015af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 --2- 172.21.15.40:0/1789503230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bf00c7e30 0x7f1bf015eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 >> 172.21.15.40:0/1789503230 conn(0x7f1bf008dc90 msgr2=0x7f1bf006d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 shutdown_connections 2024-04-14T09:59:20.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.400+0000 7f1bf4cde640 1 -- 172.21.15.40:0/1789503230 wait complete. 2024-04-14T09:59:20.411 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-04-14T09:59:20.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:20.411 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-04-14T09:59:20.438 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:59:20.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:20.438 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-14T09:59:20.493 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:20.493 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:20.508 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:20.509 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:20.563 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:20.563 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:20.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:20.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.722+0000 7fa32eea2640 1 Processor -- start 2024-04-14T09:59:20.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.722+0000 7fa32eea2640 1 -- start start 2024-04-14T09:59:20.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32eea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 0x7fa32815c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32eea2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32815d3d0 con 0x7fa3280d0a80 2024-04-14T09:59:20.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32eea2640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32815d6b0 con 0x7fa32806e8b0 2024-04-14T09:59:20.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32eea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa3280cfe20 con 0x7fa3280d0620 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32d43f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3280d0a80 0x7fa328072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38054/0 (socket says 172.21.15.40:38054) 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa32d43f640 1 -- 172.21.15.40:0/1124340520 learned_addr learned my addr 172.21.15.40:0/1124340520 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa327fff640 1 --2- 172.21.15.40:0/1124340520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 0x7fa32815c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.723+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2426580442 0 0) 0x7fa32815d3d0 con 0x7fa3280d0a80 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa314003520 con 0x7fa3280d0a80 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3408138501 0 0) 0x7fa32815d6b0 con 0x7fa32806e8b0 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa32815d3d0 con 0x7fa32806e8b0 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa327fff640 1 -- 172.21.15.40:0/1124340520 >> v1:172.21.15.136:6789/0 conn(0x7fa32806e8b0 legacy=0x7fa32806ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa327fff640 1 -- 172.21.15.40:0/1124340520 >> v1:172.21.15.40:6789/0 conn(0x7fa3280d0a80 legacy=0x7fa328072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa327fff640 1 -- 172.21.15.40:0/1124340520 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32806ba60 con 0x7fa3280d0620 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.724+0000 7fa327fff640 1 --2- 172.21.15.40:0/1124340520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 0x7fa32815c7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa318009dc0 tx=0x7fa31802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=529c966a823d559f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318039070 con 0x7fa3280d0620 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa31802ccd0 con 0x7fa3280d0620 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa3277fe640 1 -- 172.21.15.40:0/1124340520 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318034660 con 0x7fa3280d0620 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 -- 172.21.15.40:0/1124340520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 msgr2=0x7fa32815c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 --2- 172.21.15.40:0/1124340520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 0x7fa32815c7c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa318009dc0 tx=0x7fa31802bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:20.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 -- 172.21.15.40:0/1124340520 shutdown_connections 2024-04-14T09:59:20.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 --2- 172.21.15.40:0/1124340520 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0620 0x7fa32815c7c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 -- 172.21.15.40:0/1124340520 >> 172.21.15.40:0/1124340520 conn(0x7fa3280b6540 msgr2=0x7fa3280b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:20.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 -- 172.21.15.40:0/1124340520 shutdown_connections 2024-04-14T09:59:20.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.725+0000 7fa32eea2640 1 -- 172.21.15.40:0/1124340520 wait complete. 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.726+0000 7fa32eea2640 1 Processor -- start 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.726+0000 7fa32eea2640 1 -- start start 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa32806e8b0 0x7fa328152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0a80 0x7fa3281404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3280cfbc0 con 0x7fa3280d0620 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3280cfa40 con 0x7fa32806e8b0 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32eea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa328072a30 con 0x7fa3280d0a80 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa327fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa327fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33276/0 (socket says 172.21.15.40:33276) 2024-04-14T09:59:20.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa327fff640 1 -- 172.21.15.40:0/3349801027 learned_addr learned my addr 172.21.15.40:0/3349801027 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32d43f640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0a80 0x7fa3281404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.727+0000 7fa32cc3e640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa32806e8b0 0x7fa328152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 -- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0a80 msgr2=0x7fa3281404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0a80 0x7fa3281404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 -- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa32806e8b0 msgr2=0x7fa328152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa32806e8b0 0x7fa328152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 -- 172.21.15.40:0/3349801027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32815c040 con 0x7fa3280d0620 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa327fff640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa318000f80 tx=0x7fa318004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318039050 con 0x7fa3280d0620 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318045070 con 0x7fa3280d0620 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318009450 con 0x7fa3280d0620 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa328140b70 con 0x7fa3280d0620 2024-04-14T09:59:20.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.728+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa328141130 con 0x7fa3280d0620 2024-04-14T09:59:20.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.729+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3280756f0 con 0x7fa3280d0620 2024-04-14T09:59:20.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.729+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa31803e850 con 0x7fa3280d0620 2024-04-14T09:59:20.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.730+0000 7fa3257fa640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 0x7fa30806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:20.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.730+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa3180aeb80 con 0x7fa3280d0620 2024-04-14T09:59:20.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.730+0000 7fa32cc3e640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 0x7fa30806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:20.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.731+0000 7fa32cc3e640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 0x7fa30806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa320007fd0 tx=0x7fa320009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:20.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.735+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa31807c710 con 0x7fa3280d0620 2024-04-14T09:59:20.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.919+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa32815dbd0 con 0x7fa3280d0620 2024-04-14T09:59:20.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.920+0000 7fa3257fa640 1 -- 172.21.15.40:0/3349801027 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fa318080a10 con 0x7fa3280d0620 2024-04-14T09:59:20.920 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:20.920 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:20.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.922+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 msgr2=0x7fa30806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.922+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 0x7fa30806edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa320007fd0 tx=0x7fa320009040 comp rx=0 tx=0).stop 2024-04-14T09:59:20.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.922+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 msgr2=0x7fa32813ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:20.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.922+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa318000f80 tx=0x7fa318004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 shutdown_connections 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa30806c8f0 0x7fa30806edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3280d0a80 0x7fa3281404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3280d0620 0x7fa32813ffb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 --2- 172.21.15.40:0/3349801027 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa32806e8b0 0x7fa328152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 >> 172.21.15.40:0/3349801027 conn(0x7fa3280b6540 msgr2=0x7fa32815c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 shutdown_connections 2024-04-14T09:59:20.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:20.923+0000 7fa32eea2640 1 -- 172.21.15.40:0/3349801027 wait complete. 2024-04-14T09:59:20.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:20.934 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.039+0000 7f355fa88640 1 Processor -- start 2024-04-14T09:59:21.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.039+0000 7f355fa88640 1 -- start start 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355fa88640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f355815e3a0 0x7f3558147680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355fa88640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f35581450f0 0x7f35580b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355fa88640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35580b2db0 con 0x7f35580b31d0 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355fa88640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f355806d960 con 0x7f355815e3a0 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355fa88640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f355806dc40 con 0x7f35581450f0 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f355815e3a0 0x7f3558147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f355815e3a0 0x7f3558147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33282/0 (socket says 172.21.15.40:33282) 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 -- 172.21.15.40:0/1845150772 learned_addr learned my addr 172.21.15.40:0/1845150772 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d023640 1 --2- 172.21.15.40:0/1845150772 >> v2:172.21.15.136:3300/0 conn(0x7f35581450f0 0x7f35580b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 -- 172.21.15.40:0/1845150772 >> v2:172.21.15.136:3300/0 conn(0x7f35581450f0 msgr2=0x7f35580b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 --2- 172.21.15.40:0/1845150772 >> v2:172.21.15.136:3300/0 conn(0x7f35581450f0 0x7f35580b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 -- 172.21.15.40:0/1845150772 >> v1:172.21.15.136:6789/0 conn(0x7f35580b31d0 legacy=0x7f3558161f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.040+0000 7f355d824640 1 -- 172.21.15.40:0/1845150772 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355806df20 con 0x7f355815e3a0 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.041+0000 7f355d824640 1 --2- 172.21.15.40:0/1845150772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f3558147680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3558070290 tx=0x7f355402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57efbc6d18e11d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.041+0000 7f355c822640 1 -- 172.21.15.40:0/1845150772 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554034070 con 0x7f355815e3a0 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.041+0000 7f355c822640 1 -- 172.21.15.40:0/1845150772 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3554030860 con 0x7f355815e3a0 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.041+0000 7f355c822640 1 -- 172.21.15.40:0/1845150772 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3554030c30 con 0x7f355815e3a0 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 -- 172.21.15.40:0/1845150772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 msgr2=0x7f3558147680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 --2- 172.21.15.40:0/1845150772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f3558147680 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3558070290 tx=0x7f355402b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 -- 172.21.15.40:0/1845150772 shutdown_connections 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 --2- 172.21.15.40:0/1845150772 >> v2:172.21.15.136:3300/0 conn(0x7f35581450f0 0x7f35580b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 --2- 172.21.15.40:0/1845150772 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f3558147680 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 -- 172.21.15.40:0/1845150772 >> 172.21.15.40:0/1845150772 conn(0x7f35580b56f0 msgr2=0x7f35580b5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 -- 172.21.15.40:0/1845150772 shutdown_connections 2024-04-14T09:59:21.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.042+0000 7f355fa88640 1 -- 172.21.15.40:0/1845150772 wait complete. 2024-04-14T09:59:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.043+0000 7f355fa88640 1 Processor -- start 2024-04-14T09:59:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.043+0000 7f355fa88640 1 -- start start 2024-04-14T09:59:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 0x7f35580aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35581450f0 0x7f3558098ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.044 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f355815e780 con 0x7f355815e3a0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f355806e4e0 con 0x7f35580b31d0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35580b3620 con 0x7f35581450f0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33284/0 (socket says 172.21.15.40:33284) 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 -- 172.21.15.40:0/1787809264 learned_addr learned my addr 172.21.15.40:0/1787809264 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355d824640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 0x7f35580aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355d023640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35581450f0 0x7f3558098ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 -- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35581450f0 msgr2=0x7f3558098ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35581450f0 0x7f3558098ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 -- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 msgr2=0x7f35580aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 0x7f35580aec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 -- 172.21.15.40:0/1787809264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35580ae820 con 0x7f355815e3a0 2024-04-14T09:59:21.045 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355d824640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 0x7f35580aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355e025640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7a0 tx=0x7f355000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3550003b70 con 0x7f355815e3a0 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3550003d30 con 0x7f355815e3a0 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3558090210 con 0x7f355815e3a0 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.044+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355000aa90 con 0x7f355815e3a0 2024-04-14T09:59:21.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.045+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3558156290 con 0x7f355815e3a0 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.045+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3558075760 con 0x7f355815e3a0 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.046+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f355000ac30 con 0x7f355815e3a0 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.046+0000 7f354e7fc640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 0x7f353c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.046+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f355008bd70 con 0x7f355815e3a0 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.047+0000 7f355d824640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 0x7f353c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.047+0000 7f355d824640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 0x7f353c06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3554036000 tx=0x7f355403b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.051+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3558090210 con 0x7f355815e3a0 2024-04-14T09:59:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.232+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3558159b30 con 0x7f355815e3a0 2024-04-14T09:59:21.232 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.233+0000 7f354e7fc640 1 -- 172.21.15.40:0/1787809264 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f35580b2db0 con 0x7f355815e3a0 2024-04-14T09:59:21.232 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 msgr2=0x7f353c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.234 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 0x7f353c06edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3554036000 tx=0x7f355403b040 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 msgr2=0x7f35581f3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f355000c7a0 tx=0x7f355000cc60 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 shutdown_connections 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f353c06c8f0 0x7f353c06edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f355815e3a0 0x7f35581f3a30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35581450f0 0x7f3558098ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.234+0000 7f355fa88640 1 --2- 172.21.15.40:0/1787809264 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35580b31d0 0x7f35580aec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.235+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 >> 172.21.15.40:0/1787809264 conn(0x7f35580b56f0 msgr2=0x7f3558099560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.235+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 shutdown_connections 2024-04-14T09:59:21.235 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.235+0000 7f355fa88640 1 -- 172.21.15.40:0/1787809264 wait complete. 2024-04-14T09:59:21.245 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.350+0000 7f776c0b7640 1 Processor -- start 2024-04-14T09:59:21.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.350+0000 7f776c0b7640 1 -- start start 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776c0b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7764145c60 0x7f776406b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776c0b7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77640cfdc0 con 0x7f77640ce1a0 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776c0b7640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77640d00a0 con 0x7f77640d0b80 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776c0b7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7764146040 con 0x7f7764145c60 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f7769e53640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7764145c60 0x7f776406b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776a654640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f77640ce1a0 0x7f776415c890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38058/0 (socket says 172.21.15.40:38058) 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f776a654640 1 -- 172.21.15.40:0/1665133056 learned_addr learned my addr 172.21.15.40:0/1665133056 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f7769e53640 1 -- 172.21.15.40:0/1665133056 >> v1:172.21.15.136:6789/0 conn(0x7f77640d0b80 legacy=0x7f77640cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f7769e53640 1 -- 172.21.15.40:0/1665133056 >> v1:172.21.15.40:6789/0 conn(0x7f77640ce1a0 legacy=0x7f776415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f7768e51640 1 -- 172.21.15.40:0/1665133056 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456116952 0 0) 0x7f77640d00a0 con 0x7f77640d0b80 2024-04-14T09:59:21.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.351+0000 7f7769e53640 1 -- 172.21.15.40:0/1665133056 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77640d0380 con 0x7f7764145c60 2024-04-14T09:59:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.352+0000 7f7769e53640 1 --2- 172.21.15.40:0/1665133056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f776406b520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f77600097a0 tx=0x7f776002b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f69279583a732c24 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.352+0000 7f7768e51640 1 -- 172.21.15.40:0/1665133056 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760037070 con 0x7f7764145c60 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.352+0000 7f7768e51640 1 -- 172.21.15.40:0/1665133056 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7760030710 con 0x7f7764145c60 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.352+0000 7f7768e51640 1 -- 172.21.15.40:0/1665133056 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760030ae0 con 0x7f7764145c60 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 -- 172.21.15.40:0/1665133056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 msgr2=0x7f776406b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 --2- 172.21.15.40:0/1665133056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f776406b520 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f77600097a0 tx=0x7f776002b710 comp rx=0 tx=0).stop 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 -- 172.21.15.40:0/1665133056 shutdown_connections 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 --2- 172.21.15.40:0/1665133056 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f776406b520 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 -- 172.21.15.40:0/1665133056 >> 172.21.15.40:0/1665133056 conn(0x7f77640b2db0 msgr2=0x7f77640b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 -- 172.21.15.40:0/1665133056 shutdown_connections 2024-04-14T09:59:21.353 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.353+0000 7f776c0b7640 1 -- 172.21.15.40:0/1665133056 wait complete. 2024-04-14T09:59:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.354+0000 7f776c0b7640 1 Processor -- start 2024-04-14T09:59:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.354+0000 7f776c0b7640 1 -- start start 2024-04-14T09:59:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77640ce1a0 0x7f776415b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77640d0b80 0x7f77641f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f776406ba60 con 0x7f7764145c60 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77640cfad0 con 0x7f77640ce1a0 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f776406bbe0 con 0x7f77640d0b80 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33304/0 (socket says 172.21.15.40:33304) 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 -- 172.21.15.40:0/3790887740 learned_addr learned my addr 172.21.15.40:0/3790887740 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f7769e53640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77640ce1a0 0x7f776415b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f7769652640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77640d0b80 0x7f77641f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 -- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77640d0b80 msgr2=0x7f77641f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77640d0b80 0x7f77641f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 -- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77640ce1a0 msgr2=0x7f776415b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77640ce1a0 0x7f776415b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 -- 172.21.15.40:0/3790887740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77641e6560 con 0x7f7764145c60 2024-04-14T09:59:21.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776a654640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f775c00cb20 tx=0x7f775c002090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c018070 con 0x7f7764145c60 2024-04-14T09:59:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f775c00a700 con 0x7f7764145c60 2024-04-14T09:59:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77641e6800 con 0x7f7764145c60 2024-04-14T09:59:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.355+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f775c00aad0 con 0x7f7764145c60 2024-04-14T09:59:21.357 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.356+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77640ccc90 con 0x7f7764145c60 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.356+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7764075760 con 0x7f7764145c60 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.357+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f775c01b070 con 0x7f7764145c60 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.357+0000 7f775a7fc640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 0x7f774806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.357+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f775c08b690 con 0x7f7764145c60 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.357+0000 7f7769e53640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 0x7f774806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.358 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.358+0000 7f7769e53640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 0x7f774806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7760034000 tx=0x7f7760008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.362+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f775c00ac70 con 0x7f7764145c60 2024-04-14T09:59:21.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.545+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f776406c150 con 0x7f7764145c60 2024-04-14T09:59:21.545 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.545+0000 7f775a7fc640 1 -- 172.21.15.40:0/3790887740 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f775c059060 con 0x7f7764145c60 2024-04-14T09:59:21.545 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 msgr2=0x7f774806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 0x7f774806edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7760034000 tx=0x7f7760008030 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 msgr2=0x7f77641f8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f775c00cb20 tx=0x7f775c002090 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 shutdown_connections 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f774806c8f0 0x7f774806edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7764145c60 0x7f77641f8010 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77640d0b80 0x7f77641f7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 --2- 172.21.15.40:0/3790887740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77640ce1a0 0x7f776415b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 >> 172.21.15.40:0/3790887740 conn(0x7f77640b2db0 msgr2=0x7f77640cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 shutdown_connections 2024-04-14T09:59:21.547 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.547+0000 7f776c0b7640 1 -- 172.21.15.40:0/3790887740 wait complete. 2024-04-14T09:59:21.558 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:21.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.663+0000 7fa3b911e640 1 Processor -- start 2024-04-14T09:59:21.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.663+0000 7fa3b911e640 1 -- start start 2024-04-14T09:59:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b911e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b4169360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b911e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b40cf7b0 con 0x7fa3b415e5d0 2024-04-14T09:59:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b911e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b40cfa90 con 0x7fa3b40d4170 2024-04-14T09:59:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b911e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b415e9b0 con 0x7fa3b40d1860 2024-04-14T09:59:21.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3b415e5d0 0x7fa3b40cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38068/0 (socket says 172.21.15.40:38068) 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b2d9d640 1 -- 172.21.15.40:0/565649490 learned_addr learned my addr 172.21.15.40:0/565649490 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b359e640 1 --2- 172.21.15.40:0/565649490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b4169360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283823926 0 0) 0x7fa3b40cf7b0 con 0x7fa3b415e5d0 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.664+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a0003520 con 0x7fa3b415e5d0 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 326333877 0 0) 0x7fa3b40cfa90 con 0x7fa3b40d4170 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3b40cf7b0 con 0x7fa3b40d4170 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b359e640 1 -- 172.21.15.40:0/565649490 >> v1:172.21.15.136:6789/0 conn(0x7fa3b40d4170 legacy=0x7fa3b40d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b359e640 1 -- 172.21.15.40:0/565649490 >> v1:172.21.15.40:6789/0 conn(0x7fa3b415e5d0 legacy=0x7fa3b40cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.665 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b359e640 1 -- 172.21.15.40:0/565649490 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b40cfd70 con 0x7fa3b40d1860 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b359e640 1 --2- 172.21.15.40:0/565649490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b4169360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009dc0 tx=0x7fa3a402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679c6af4fdf3fc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.665+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4039070 con 0x7fa3b40d1860 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a402ccd0 con 0x7fa3b40d1860 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b1d9b640 1 -- 172.21.15.40:0/565649490 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4034660 con 0x7fa3b40d1860 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 -- 172.21.15.40:0/565649490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 msgr2=0x7fa3b4169360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 --2- 172.21.15.40:0/565649490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b4169360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009dc0 tx=0x7fa3a402bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 -- 172.21.15.40:0/565649490 shutdown_connections 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 --2- 172.21.15.40:0/565649490 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b4169360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 -- 172.21.15.40:0/565649490 >> 172.21.15.40:0/565649490 conn(0x7fa3b408dce0 msgr2=0x7fa3b409d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 -- 172.21.15.40:0/565649490 shutdown_connections 2024-04-14T09:59:21.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.666+0000 7fa3b911e640 1 -- 172.21.15.40:0/565649490 wait complete. 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 Processor -- start 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 -- start start 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3b415e5d0 0x7fa3b40b1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40cf3e0 con 0x7fa3b40d4170 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b40d03c0 con 0x7fa3b415e5d0 2024-04-14T09:59:21.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b911e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b40cf560 con 0x7fa3b40d1860 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33308/0 (socket says 172.21.15.40:33308) 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.668+0000 7fa3b259c640 1 -- 172.21.15.40:0/779278052 learned_addr learned my addr 172.21.15.40:0/779278052 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b2d9d640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b359e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3b415e5d0 0x7fa3b40b1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 -- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 msgr2=0x7fa3b414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b414dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 -- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3b415e5d0 msgr2=0x7fa3b40b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3b415e5d0 0x7fa3b40b1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 -- 172.21.15.40:0/779278052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b40b3bc0 con 0x7fa3b40d4170 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b259c640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c400 tx=0x7fa39c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c017070 con 0x7fa3b40d4170 2024-04-14T09:59:21.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39c0052d0 con 0x7fa3b40d4170 2024-04-14T09:59:21.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b40b3ea0 con 0x7fa3b40d4170 2024-04-14T09:59:21.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c003810 con 0x7fa3b40d4170 2024-04-14T09:59:21.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.669+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b40b8180 con 0x7fa3b40d4170 2024-04-14T09:59:21.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.670+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b40b43c0 con 0x7fa3b40d4170 2024-04-14T09:59:21.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.671+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa39c01a070 con 0x7fa3b40d4170 2024-04-14T09:59:21.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.671+0000 7fa3ab7fe640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.671+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa39c08b2c0 con 0x7fa3b40d4170 2024-04-14T09:59:21.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.671+0000 7fa3b2d9d640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.672+0000 7fa3b2d9d640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 0x7fa39406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0011e0 tx=0x7fa3ac007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.675+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa3b40b43c0 con 0x7fa3b40d4170 2024-04-14T09:59:21.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.859+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa3b4075760 con 0x7fa3b40d4170 2024-04-14T09:59:21.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.859+0000 7fa3ab7fe640 1 -- 172.21.15.40:0/779278052 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa39c058ca0 con 0x7fa3b40d4170 2024-04-14T09:59:21.859 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 msgr2=0x7fa39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 0x7fa39406edb0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac0011e0 tx=0x7fa3ac007d30 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 msgr2=0x7fa3b40b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00c400 tx=0x7fa39c00c8c0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 shutdown_connections 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa39406c8f0 0x7fa39406edb0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa3b415e5d0 0x7fa3b40b1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3b40d4170 0x7fa3b40b3150 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 --2- 172.21.15.40:0/779278052 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa3b40d1860 0x7fa3b414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 >> 172.21.15.40:0/779278052 conn(0x7fa3b408dce0 msgr2=0x7fa3b415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 shutdown_connections 2024-04-14T09:59:21.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.861+0000 7fa3b911e640 1 -- 172.21.15.40:0/779278052 wait complete. 2024-04-14T09:59:21.871 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.976+0000 7fc1680ad640 1 Processor -- start 2024-04-14T09:59:21.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.976+0000 7fc1680ad640 1 -- start start 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc1680ad640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc16015e5c0 0x7fc1600b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc1680ad640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc1600b00c0 0x7fc160070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc1680ad640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16015e9a0 con 0x7fc16006b520 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc1680ad640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc16006fa80 con 0x7fc16015e5c0 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc1680ad640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc16006fd60 con 0x7fc1600b00c0 2024-04-14T09:59:21.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc165e49640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc16015e5c0 0x7fc1600b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc16664a640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc16006b520 0x7fc1600ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38080/0 (socket says 172.21.15.40:38080) 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc16664a640 1 -- 172.21.15.40:0/3009831652 learned_addr learned my addr 172.21.15.40:0/3009831652 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc165648640 1 --2- 172.21.15.40:0/3009831652 >> v2:172.21.15.136:3300/0 conn(0x7fc1600b00c0 0x7fc160070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc165e49640 1 -- 172.21.15.40:0/3009831652 >> v2:172.21.15.136:3300/0 conn(0x7fc1600b00c0 msgr2=0x7fc160070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.977+0000 7fc165e49640 1 --2- 172.21.15.40:0/3009831652 >> v2:172.21.15.136:3300/0 conn(0x7fc1600b00c0 0x7fc160070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc165e49640 1 -- 172.21.15.40:0/3009831652 >> v1:172.21.15.40:6789/0 conn(0x7fc16006b520 legacy=0x7fc1600ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc165e49640 1 -- 172.21.15.40:0/3009831652 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc160070040 con 0x7fc16015e5c0 2024-04-14T09:59:21.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc164e47640 1 -- 172.21.15.40:0/3009831652 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698979760 0 0) 0x7fc16015e9a0 con 0x7fc16006b520 2024-04-14T09:59:21.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc165e49640 1 --2- 172.21.15.40:0/3009831652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc16015e5c0 0x7fc1600b4dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc160073c70 tx=0x7fc15802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3403dec9041ff9c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc164e47640 1 -- 172.21.15.40:0/3009831652 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158039070 con 0x7fc16015e5c0 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc164e47640 1 -- 172.21.15.40:0/3009831652 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15802cbf0 con 0x7fc16015e5c0 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.978+0000 7fc164e47640 1 -- 172.21.15.40:0/3009831652 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc158034440 con 0x7fc16015e5c0 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 -- 172.21.15.40:0/3009831652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc16015e5c0 msgr2=0x7fc1600b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 --2- 172.21.15.40:0/3009831652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc16015e5c0 0x7fc1600b4dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc160073c70 tx=0x7fc15802be40 comp rx=0 tx=0).stop 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 -- 172.21.15.40:0/3009831652 shutdown_connections 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 --2- 172.21.15.40:0/3009831652 >> v2:172.21.15.136:3300/0 conn(0x7fc1600b00c0 0x7fc160070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 --2- 172.21.15.40:0/3009831652 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc16015e5c0 0x7fc1600b4dd0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 -- 172.21.15.40:0/3009831652 >> 172.21.15.40:0/3009831652 conn(0x7fc1600b2db0 msgr2=0x7fc1600b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 -- 172.21.15.40:0/3009831652 shutdown_connections 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.979+0000 7fc1680ad640 1 -- 172.21.15.40:0/3009831652 wait complete. 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.980+0000 7fc1680ad640 1 Processor -- start 2024-04-14T09:59:21.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.980+0000 7fc1680ad640 1 -- start start 2024-04-14T09:59:21.982 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc16006b520 0x7fc1600cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc16015e5c0 0x7fc160161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc1600b09d0 con 0x7fc1600b00c0 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc160070d80 con 0x7fc16006b520 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc1680ad640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc1600adfc0 con 0x7fc16015e5c0 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33332/0 (socket says 172.21.15.40:33332) 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 -- 172.21.15.40:0/1922971014 learned_addr learned my addr 172.21.15.40:0/1922971014 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165e49640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc16006b520 0x7fc1600cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc16664a640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc16015e5c0 0x7fc160161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 -- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc16015e5c0 msgr2=0x7fc160161190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc16015e5c0 0x7fc160161190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.983 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 -- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc16006b520 msgr2=0x7fc1600cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc16006b520 0x7fc1600cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.981+0000 7fc165648640 1 -- 172.21.15.40:0/1922971014 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1600ccd20 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc165648640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc15400e9e0 tx=0x7fc15400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154017070 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15400c970 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15400cd60 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16015f9f0 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.982+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1601f4660 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.983+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16006c410 con 0x7fc1600b00c0 2024-04-14T09:59:21.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.983+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc15401a070 con 0x7fc1600b00c0 2024-04-14T09:59:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.984+0000 7fc15e7fc640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.984+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fc15408bdc0 con 0x7fc1600b00c0 2024-04-14T09:59:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.984+0000 7fc165e49640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:21.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.984+0000 7fc165e49640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 0x7fc14c06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc158036000 tx=0x7fc158030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:21.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:21.988+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc16006c410 con 0x7fc1600b00c0 2024-04-14T09:59:22.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.174+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc160075760 con 0x7fc1600b00c0 2024-04-14T09:59:22.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.174+0000 7fc15e7fc640 1 -- 172.21.15.40:0/1922971014 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fc154059830 con 0x7fc1600b00c0 2024-04-14T09:59:22.174 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:22.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 msgr2=0x7fc14c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 0x7fc14c06edb0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc158036000 tx=0x7fc158030000 comp rx=0 tx=0).stop 2024-04-14T09:59:22.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 msgr2=0x7fc1600cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc15400e9e0 tx=0x7fc15400eea0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 shutdown_connections 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc14c06c8f0 0x7fc14c06edb0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc16015e5c0 0x7fc160161190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc1600b00c0 0x7fc1600cd2c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 --2- 172.21.15.40:0/1922971014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc16006b520 0x7fc1600cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 >> 172.21.15.40:0/1922971014 conn(0x7fc1600b2db0 msgr2=0x7fc1600b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 shutdown_connections 2024-04-14T09:59:22.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.176+0000 7fc1680ad640 1 -- 172.21.15.40:0/1922971014 wait complete. 2024-04-14T09:59:22.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:59:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.290+0000 7ff618e36640 1 Processor -- start 2024-04-14T09:59:22.289 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.290+0000 7ff618e36640 1 -- start start 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff618e36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d4980 0x7ff614162bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff618e36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6140d0c80 0x7ff6140d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff618e36640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6140d5000 con 0x7ff614161ca0 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff618e36640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff6140d4de0 con 0x7ff6140d0c80 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff618e36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff6141630f0 con 0x7ff6140d4980 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6140d0c80 0x7ff6140d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff6140d0c80 0x7ff6140d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33348/0 (socket says 172.21.15.40:33348) 2024-04-14T09:59:22.291 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff61259c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff614161ca0 0x7ff6140cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41854/0 (socket says 172.21.15.40:41854) 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 -- 172.21.15.40:0/506018291 learned_addr learned my addr 172.21.15.40:0/506018291 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff609d9b640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d4980 0x7ff614162bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff611d9b640 1 -- 172.21.15.40:0/506018291 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282806634 0 0) 0x7ff6140d5000 con 0x7ff614161ca0 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 -- 172.21.15.40:0/506018291 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d4980 msgr2=0x7ff614162bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d4980 0x7ff614162bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 -- 172.21.15.40:0/506018291 >> v1:172.21.15.136:6789/0 conn(0x7ff614161ca0 legacy=0x7ff6140cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.292 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.291+0000 7ff612d9d640 1 -- 172.21.15.40:0/506018291 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6140cf0d0 con 0x7ff6140d0c80 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.292+0000 7ff612d9d640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6140d0c80 0x7ff6140d10d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e50 tx=0x7ff60c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2e3afe1990674c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.292+0000 7ff611d9b640 1 -- 172.21.15.40:0/506018291 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c02c9e0 con 0x7ff6140d0c80 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.292+0000 7ff611d9b640 1 -- 172.21.15.40:0/506018291 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c02cb80 con 0x7ff6140d0c80 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.292+0000 7ff611d9b640 1 -- 172.21.15.40:0/506018291 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c0343f0 con 0x7ff6140d0c80 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 -- 172.21.15.40:0/506018291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6140d0c80 msgr2=0x7ff6140d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.293 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6140d0c80 0x7ff6140d10d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009e50 tx=0x7ff60c02be40 comp rx=0 tx=0).stop 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 -- 172.21.15.40:0/506018291 shutdown_connections 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff6140d0c80 0x7ff6140d10d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 --2- 172.21.15.40:0/506018291 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d4980 0x7ff614162bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 -- 172.21.15.40:0/506018291 >> 172.21.15.40:0/506018291 conn(0x7ff61409d5c0 msgr2=0x7ff6140d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 -- 172.21.15.40:0/506018291 shutdown_connections 2024-04-14T09:59:22.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.293+0000 7ff618e36640 1 -- 172.21.15.40:0/506018291 wait complete. 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.294+0000 7ff618e36640 1 Processor -- start 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.294+0000 7ff618e36640 1 -- start start 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d0c80 0x7ff61414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6140d4980 0x7ff6140cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.296 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff6140cf690 con 0x7ff614161ca0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff6140d1610 con 0x7ff6140d4980 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff618e36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff6140ced80 con 0x7ff6140d0c80 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33364/0 (socket says 172.21.15.40:33364) 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 -- 172.21.15.40:0/636566640 learned_addr learned my addr 172.21.15.40:0/636566640 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff61259c640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d0c80 0x7ff61414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff609d9b640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6140d4980 0x7ff6140cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 -- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d0c80 msgr2=0x7ff61414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d0c80 0x7ff61414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 -- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6140d4980 msgr2=0x7ff6140cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6140d4980 0x7ff6140cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 -- 172.21.15.40:0/636566640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61414fc00 con 0x7ff614161ca0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.295+0000 7ff612d9d640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff60c036040 tx=0x7ff60c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.297 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.296+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c043030 con 0x7ff614161ca0 2024-04-14T09:59:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.296+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff60c03e450 con 0x7ff614161ca0 2024-04-14T09:59:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.296+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6140ccd00 con 0x7ff614161ca0 2024-04-14T09:59:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.296+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c009510 con 0x7ff614161ca0 2024-04-14T09:59:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.296+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6140cd2c0 con 0x7ff614161ca0 2024-04-14T09:59:22.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.297+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6140cb000 con 0x7ff614161ca0 2024-04-14T09:59:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.297+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff60c046070 con 0x7ff614161ca0 2024-04-14T09:59:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.297+0000 7ff60b7fe640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 0x7ff5f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.298+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7ff60c0ae0b0 con 0x7ff614161ca0 2024-04-14T09:59:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.298+0000 7ff61259c640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 0x7ff5f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.299 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.298+0000 7ff61259c640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 0x7ff5f406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.301 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.302+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff6140cb000 con 0x7ff614161ca0 2024-04-14T09:59:22.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.503+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff6140ba130 con 0x7ff614161ca0 2024-04-14T09:59:22.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.503+0000 7ff60b7fe640 1 -- 172.21.15.40:0/636566640 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7ff60c04d070 con 0x7ff614161ca0 2024-04-14T09:59:22.503 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 msgr2=0x7ff5f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 0x7ff5f406edb0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff604007fd0 tx=0x7ff604007de0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 msgr2=0x7ff61415e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff60c036040 tx=0x7ff60c004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 shutdown_connections 2024-04-14T09:59:22.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff5f406c8f0 0x7ff5f406edb0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff614161ca0 0x7ff61415e340 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6140d4980 0x7ff6140cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 --2- 172.21.15.40:0/636566640 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff6140d0c80 0x7ff61414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 >> 172.21.15.40:0/636566640 conn(0x7ff61409d5c0 msgr2=0x7ff61406d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 shutdown_connections 2024-04-14T09:59:22.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.505+0000 7ff618e36640 1 -- 172.21.15.40:0/636566640 wait complete. 2024-04-14T09:59:22.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-04-14T09:59:22.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:22.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-04-14T09:59:22.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T09:59:22.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:22.544 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-14T09:59:22.578 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:59:22.581 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:59:22.598 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-14T09:59:22.598 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:22.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.723+0000 7f761b6de640 1 Processor -- start 2024-04-14T09:59:22.722 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.723+0000 7f761b6de640 1 -- start start 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761b6de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f761409aa40 0x7f76140cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761b6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76140b45b0 0x7f76140aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761b6de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76140af1d0 con 0x7f761409ae20 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761b6de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f7614070270 con 0x7f761409aa40 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761b6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f76140b4a10 con 0x7f76140b45b0 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761947a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f761409aa40 0x7f76140cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f7619c7b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f761409ae20 0x7f7614070700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38096/0 (socket says 172.21.15.40:38096) 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f7619c7b640 1 -- 172.21.15.40:0/2099063673 learned_addr learned my addr 172.21.15.40:0/2099063673 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:22.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f7618c79640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76140b45b0 0x7f76140aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761947a640 1 -- 172.21.15.40:0/2099063673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76140b45b0 msgr2=0x7f76140aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:22.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761947a640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76140b45b0 0x7f76140aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761947a640 1 -- 172.21.15.40:0/2099063673 >> v1:172.21.15.40:6789/0 conn(0x7f761409ae20 legacy=0x7f7614070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.724+0000 7f761947a640 1 -- 172.21.15.40:0/2099063673 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761406f6a0 con 0x7f761409aa40 2024-04-14T09:59:22.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761947a640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761409aa40 0x7f76140cfd80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76100097a0 tx=0x7f761002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b347028128d1815f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f760bfff640 1 -- 172.21.15.40:0/2099063673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76100315a0 con 0x7f761409aa40 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f760bfff640 1 -- 172.21.15.40:0/2099063673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7610037070 con 0x7f761409aa40 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f760bfff640 1 -- 172.21.15.40:0/2099063673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7610031960 con 0x7f761409aa40 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761b6de640 1 -- 172.21.15.40:0/2099063673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761409aa40 msgr2=0x7f76140cfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761b6de640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761409aa40 0x7f76140cfd80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f76100097a0 tx=0x7f761002b840 comp rx=0 tx=0).stop 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761b6de640 1 -- 172.21.15.40:0/2099063673 shutdown_connections 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761b6de640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76140b45b0 0x7f76140aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.725+0000 7f761b6de640 1 --2- 172.21.15.40:0/2099063673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f761409aa40 0x7f76140cfd80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.726+0000 7f761b6de640 1 -- 172.21.15.40:0/2099063673 >> 172.21.15.40:0/2099063673 conn(0x7f76140b3a90 msgr2=0x7f76140b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.726+0000 7f761b6de640 1 -- 172.21.15.40:0/2099063673 shutdown_connections 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.726+0000 7f761b6de640 1 -- 172.21.15.40:0/2099063673 wait complete. 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 Processor -- start 2024-04-14T09:59:22.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 -- start start 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f761409aa40 0x7f76141569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f761409ae20 0x7f76140c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f761406ff00 con 0x7f76140b45b0 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f761406fc20 con 0x7f761409aa40 2024-04-14T09:59:22.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f761b6de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f761409b2b0 con 0x7f761409ae20 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.727+0000 7f7619c7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33368/0 (socket says 172.21.15.40:33368) 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 -- 172.21.15.40:0/1408357605 learned_addr learned my addr 172.21.15.40:0/1408357605 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7618c79640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f761409ae20 0x7f76140c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f761947a640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f761409aa40 0x7f76141569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 -- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f761409ae20 msgr2=0x7f76140c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f761409ae20 0x7f76140c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 -- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f761409aa40 msgr2=0x7f76141569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f761409aa40 0x7f76141569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 -- 172.21.15.40:0/1408357605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76140c6b50 con 0x7f76140b45b0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7619c7b640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ca80 tx=0x7f760c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c017070 con 0x7f76140b45b0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760c00ac30 con 0x7f76140b45b0 2024-04-14T09:59:22.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760c012600 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76140c6e30 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.728+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76140cb940 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.729+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76140c7000 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.730+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f760c01a070 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.730+0000 7f7609ffb640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 0x7f75f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.730+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f760c08bb70 con 0x7f76140b45b0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.730+0000 7f761947a640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 0x7f75f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:22.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.731+0000 7f761947a640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 0x7f75f806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7610036000 tx=0x7f761003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:22.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.734+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f760c00ae20 con 0x7f76140b45b0 2024-04-14T09:59:22.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.958+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76140756f0 con 0x7f76140b45b0 2024-04-14T09:59:22.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.958+0000 7f7609ffb640 1 -- 172.21.15.40:0/1408357605 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f760c059550 con 0x7f76140b45b0 2024-04-14T09:59:22.958 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:22.958 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:59:22.959 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 msgr2=0x7f75f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 0x7f75f806edb0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7610036000 tx=0x7f761003d040 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 msgr2=0x7f76140b6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f760c00ca80 tx=0x7f760c00cf40 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 shutdown_connections 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f75f806c8f0 0x7f75f806edb0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f76140b45b0 0x7f76140b6d60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f761409ae20 0x7f76140c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 --2- 172.21.15.40:0/1408357605 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f761409aa40 0x7f76141569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 >> 172.21.15.40:0/1408357605 conn(0x7f76140b3a90 msgr2=0x7f76140b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 shutdown_connections 2024-04-14T09:59:22.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:22.961+0000 7f761b6de640 1 -- 172.21.15.40:0/1408357605 wait complete. 2024-04-14T09:59:22.972 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.073+0000 7f8c02d1e640 1 Processor -- start 2024-04-14T09:59:23.073 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.073+0000 7f8c02d1e640 1 -- start start 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c02d1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c02d1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8bfc0b4680 0x7f8bfc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c02d1e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bfc0ccce0 con 0x7f8bfc15c690 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c02d1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0d01b0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c02d1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8bfc0ccf80 con 0x7f8bfc0b4680 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c00aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.074 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c00aba640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33378/0 (socket says 172.21.15.40:33378) 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c00aba640 1 -- 172.21.15.40:0/2258633260 learned_addr learned my addr 172.21.15.40:0/2258633260 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.074+0000 7f8c012bb640 1 --2- 172.21.15.40:0/2258633260 >> v2:172.21.15.136:3300/0 conn(0x7f8bfc0b4680 0x7f8bfc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8c00aba640 1 -- 172.21.15.40:0/2258633260 >> v2:172.21.15.136:3300/0 conn(0x7f8bfc0b4680 msgr2=0x7f8bfc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8c00aba640 1 --2- 172.21.15.40:0/2258633260 >> v2:172.21.15.136:3300/0 conn(0x7f8bfc0b4680 0x7f8bfc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8c00aba640 1 -- 172.21.15.40:0/2258633260 >> v1:172.21.15.136:6789/0 conn(0x7f8bfc15c690 legacy=0x7f8bfc0cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8bfb7fe640 1 -- 172.21.15.40:0/2258633260 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574364925 0 0) 0x7f8bfc0ccce0 con 0x7f8bfc15c690 2024-04-14T09:59:23.075 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8c00aba640 1 -- 172.21.15.40:0/2258633260 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc0cd260 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8c00aba640 1 --2- 172.21.15.40:0/2258633260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0d2040 tx=0x7f8bf402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e87cb5af06ab13 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.075+0000 7f8bfb7fe640 1 -- 172.21.15.40:0/2258633260 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf402cb20 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8bfb7fe640 1 -- 172.21.15.40:0/2258633260 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf402ccc0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8bfb7fe640 1 -- 172.21.15.40:0/2258633260 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4034610 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 -- 172.21.15.40:0/2258633260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 msgr2=0x7f8bfc0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.076 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/2258633260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0d2040 tx=0x7f8bf402bf80 comp rx=0 tx=0).stop 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 -- 172.21.15.40:0/2258633260 shutdown_connections 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/2258633260 >> v2:172.21.15.136:3300/0 conn(0x7f8bfc0b4680 0x7f8bfc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/2258633260 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc0cfc70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 -- 172.21.15.40:0/2258633260 >> 172.21.15.40:0/2258633260 conn(0x7f8bfc0b3b90 msgr2=0x7f8bfc0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 -- 172.21.15.40:0/2258633260 shutdown_connections 2024-04-14T09:59:23.077 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.076+0000 7f8c02d1e640 1 -- 172.21.15.40:0/2258633260 wait complete. 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.077+0000 7f8c02d1e640 1 Processor -- start 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.077+0000 7f8c02d1e640 1 -- start start 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bfc0b4680 0x7f8bfc0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bfc06c630 0x7f8bfc06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc09af80 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.079 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8bfc0d03e0 con 0x7f8bfc0b4680 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c02d1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8bfc09b100 con 0x7f8bfc06c630 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8bfbfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33386/0 (socket says 172.21.15.40:33386) 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8bfbfff640 1 -- 172.21.15.40:0/1308002915 learned_addr learned my addr 172.21.15.40:0/1308002915 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c00aba640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bfc0b4680 0x7f8bfc0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8c012bb640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bfc06c630 0x7f8bfc06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.078+0000 7f8bfbfff640 1 -- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bfc06c630 msgr2=0x7f8bfc06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bfbfff640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bfc06c630 0x7f8bfc06dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bfbfff640 1 -- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bfc0b4680 msgr2=0x7f8bfc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bfbfff640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bfc0b4680 0x7f8bfc0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bfbfff640 1 -- 172.21.15.40:0/1308002915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bfc06cbf0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bfbfff640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c440 tx=0x7f8bf000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0017070 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bf00035f0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bfc06ced0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00039e0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.079+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bfc06d490 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.080+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bfc0756f0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.081 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.080+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8bf001a070 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.081+0000 7f8bf97fa640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 0x7f8be806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.081+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8bf008b1b0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.081+0000 7f8c00aba640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 0x7f8be806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.081+0000 7f8c00aba640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 0x7f8be806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4035000 tx=0x7f8bf4030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.085+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8bf0058ce0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.268 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.269+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bfc0b8020 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.269 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.270+0000 7f8bf97fa640 1 -- 172.21.15.40:0/1308002915 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7f8bf005cfe0 con 0x7f8bfc15c2b0 2024-04-14T09:59:23.270 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:23.270 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 msgr2=0x7f8be806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 0x7f8be806edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4035000 tx=0x7f8bf4030000 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 msgr2=0x7f8bfc154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8bf000c440 tx=0x7f8bf000c900 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 shutdown_connections 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8be806c8f0 0x7f8be806edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8bfc06c630 0x7f8bfc06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8bfc15c2b0 0x7f8bfc154330 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 --2- 172.21.15.40:0/1308002915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8bfc0b4680 0x7f8bfc0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 >> 172.21.15.40:0/1308002915 conn(0x7f8bfc0b3b90 msgr2=0x7f8bfc070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 shutdown_connections 2024-04-14T09:59:23.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.272+0000 7f8c02d1e640 1 -- 172.21.15.40:0/1308002915 wait complete. 2024-04-14T09:59:23.283 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:58:20.862655+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:58:21.696533+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-14T09:58:25.404538+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-14T09:59:23.283 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.388+0000 7f24f9faa640 1 Processor -- start 2024-04-14T09:59:23.388 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.388+0000 7f24f9faa640 1 -- start start 2024-04-14T09:59:23.389 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f9faa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f24f40d0b40 0x7f24f40d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f9faa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f406cc40 con 0x7f24f4071020 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f9faa640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24f406c960 con 0x7f24f409b150 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f9faa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f24f40ce4a0 con 0x7f24f40d0b40 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f37fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f24f4071020 0x7f24f409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38108/0 (socket says 172.21.15.40:38108) 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f37fe640 1 -- 172.21.15.40:0/3894189566 learned_addr learned my addr 172.21.15.40:0/3894189566 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f3fff640 1 --2- 172.21.15.40:0/3894189566 >> v2:172.21.15.136:3300/0 conn(0x7f24f40d0b40 0x7f24f40d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748830073 0 0) 0x7f24f406cc40 con 0x7f24f4071020 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24dc003520 con 0x7f24f4071020 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3006097161 0 0) 0x7f24f406c960 con 0x7f24f409b150 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24f406cc40 con 0x7f24f409b150 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f3fff640 1 -- 172.21.15.40:0/3894189566 >> v1:172.21.15.136:6789/0 conn(0x7f24f409b150 legacy=0x7f24f40d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f3fff640 1 -- 172.21.15.40:0/3894189566 >> v1:172.21.15.40:6789/0 conn(0x7f24f4071020 legacy=0x7f24f409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.389+0000 7f24f3fff640 1 -- 172.21.15.40:0/3894189566 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f40cc6d0 con 0x7f24f40d0b40 2024-04-14T09:59:23.390 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.390+0000 7f24f3fff640 1 --2- 172.21.15.40:0/3894189566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f40d0ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009d90 tx=0x7f24ec02bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d443b53001550b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.390+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec039070 con 0x7f24f40d0b40 2024-04-14T09:59:23.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.390+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24ec02cd80 con 0x7f24f40d0b40 2024-04-14T09:59:23.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.390+0000 7f24f27fc640 1 -- 172.21.15.40:0/3894189566 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24ec034640 con 0x7f24f40d0b40 2024-04-14T09:59:23.391 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 -- 172.21.15.40:0/3894189566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 msgr2=0x7f24f40d0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 --2- 172.21.15.40:0/3894189566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f40d0ff0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f24ec009d90 tx=0x7f24ec02bfd0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 -- 172.21.15.40:0/3894189566 shutdown_connections 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 --2- 172.21.15.40:0/3894189566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f40d0ff0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 -- 172.21.15.40:0/3894189566 >> 172.21.15.40:0/3894189566 conn(0x7f24f40b3ad0 msgr2=0x7f24f40b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 -- 172.21.15.40:0/3894189566 shutdown_connections 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.391+0000 7f24f9faa640 1 -- 172.21.15.40:0/3894189566 wait complete. 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.392+0000 7f24f9faa640 1 Processor -- start 2024-04-14T09:59:23.392 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.392+0000 7f24f9faa640 1 -- start start 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24f409b150 0x7f24f41e0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f41e0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40ccf70 con 0x7f24f4071020 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f24f40ccc90 con 0x7f24f40d0b40 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f9faa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f24f406db50 con 0x7f24f409b150 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33398/0 (socket says 172.21.15.40:33398) 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 -- 172.21.15.40:0/1467902406 learned_addr learned my addr 172.21.15.40:0/1467902406 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f2ffd640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24f409b150 0x7f24f41e0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.394 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f3fff640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f41e0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 -- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24f409b150 msgr2=0x7f24f41e0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24f409b150 0x7f24f41e0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 -- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 msgr2=0x7f24f41e0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f41e0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.393+0000 7f24f37fe640 1 -- 172.21.15.40:0/1467902406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24f40c90b0 con 0x7f24f4071020 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24f37fe640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f24e400c440 tx=0x7f24e400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4017070 con 0x7f24f4071020 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24e4005ce0 con 0x7f24f4071020 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f40c68e0 con 0x7f24f4071020 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24e4007270 con 0x7f24f4071020 2024-04-14T09:59:23.395 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.394+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f40b5fe0 con 0x7f24f4071020 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.395+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f4075760 con 0x7f24f4071020 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.395+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f24e401a070 con 0x7f24f4071020 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.396+0000 7f24dbfff640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.396+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f24e408b0b0 con 0x7f24f4071020 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.396+0000 7f24f2ffd640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.397+0000 7f24f2ffd640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 0x7f24e006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24e8007fd0 tx=0x7f24e8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.400 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.400+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f24e4058b20 con 0x7f24f4071020 2024-04-14T09:59:23.588 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.589+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f24f406d1f0 con 0x7f24f4071020 2024-04-14T09:59:23.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.589+0000 7f24dbfff640 1 -- 172.21.15.40:0/1467902406 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7f24e405ce20 con 0x7f24f4071020 2024-04-14T09:59:23.589 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 msgr2=0x7f24e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 0x7f24e006edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f24e8007fd0 tx=0x7f24e8009040 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 msgr2=0x7f24f40c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f24e400c440 tx=0x7f24e400c900 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 shutdown_connections 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f24e006c8f0 0x7f24e006edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f24f40d0b40 0x7f24f41e0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f24f409b150 0x7f24f41e0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 --2- 172.21.15.40:0/1467902406 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f24f4071020 0x7f24f40c6300 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 >> 172.21.15.40:0/1467902406 conn(0x7f24f40b3ad0 msgr2=0x7f24f409aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 shutdown_connections 2024-04-14T09:59:23.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.591+0000 7f24f9faa640 1 -- 172.21.15.40:0/1467902406 wait complete. 2024-04-14T09:59:23.601 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.708+0000 7f1b37ea2640 1 Processor -- start 2024-04-14T09:59:23.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.708+0000 7f1b37ea2640 1 -- start start 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b37ea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 0x7f1b3009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b37ea2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 0x7f1b300cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b37ea2640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3006cc40 con 0x7f1b300cd9d0 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b37ea2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1b3009b3c0 con 0x7f1b3009af80 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b37ea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3006c960 con 0x7f1b30071020 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b3643f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1b300cd9d0 0x7f1b300cde60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38124/0 (socket says 172.21.15.40:38124) 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b3643f640 1 -- 172.21.15.40:0/1660032625 learned_addr learned my addr 172.21.15.40:0/1660032625 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1660032625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 0x7f1b3009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b3543d640 1 --2- 172.21.15.40:0/1660032625 >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 0x7f1b300cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b34c3c640 1 -- 172.21.15.40:0/1660032625 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838629118 0 0) 0x7f1b3006cc40 con 0x7f1b300cd9d0 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b34c3c640 1 -- 172.21.15.40:0/1660032625 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b1c003520 con 0x7f1b300cd9d0 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1660032625 >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 msgr2=0x7f1b300cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1660032625 >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 0x7f1b300cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1660032625 >> v1:172.21.15.40:6789/0 conn(0x7f1b300cd9d0 legacy=0x7f1b300cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1660032625 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300cc6d0 con 0x7f1b30071020 2024-04-14T09:59:23.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.709+0000 7f1b3543d640 1 --2- 172.21.15.40:0/1660032625 >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 0x7f1b300cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:23.711 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.710+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1660032625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 0x7f1b3009aa40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0fcfd269ec2e5a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.710+0000 7f1b34c3c640 1 -- 172.21.15.40:0/1660032625 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c034070 con 0x7f1b30071020 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.710+0000 7f1b34c3c640 1 -- 172.21.15.40:0/1660032625 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c030610 con 0x7f1b30071020 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.710+0000 7f1b34c3c640 1 -- 172.21.15.40:0/1660032625 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c0309e0 con 0x7f1b30071020 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1660032625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 msgr2=0x7f1b3009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1660032625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 0x7f1b3009aa40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0097a0 tx=0x7f1b2c02b960 comp rx=0 tx=0).stop 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1660032625 shutdown_connections 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1660032625 >> v2:172.21.15.136:3300/0 conn(0x7f1b3009af80 0x7f1b300cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1660032625 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b30071020 0x7f1b3009aa40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1660032625 >> 172.21.15.40:0/1660032625 conn(0x7f1b300b3ad0 msgr2=0x7f1b300b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1660032625 shutdown_connections 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.711+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1660032625 wait complete. 2024-04-14T09:59:23.712 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.712+0000 7f1b37ea2640 1 Processor -- start 2024-04-14T09:59:23.713 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.712+0000 7f1b37ea2640 1 -- start start 2024-04-14T09:59:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3009af80 0x7f1b30152250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b300cd9d0 0x7f1b300b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300ccf70 con 0x7f1b30071020 2024-04-14T09:59:23.714 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1b300ccc90 con 0x7f1b3009af80 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3006db50 con 0x7f1b300cd9d0 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33410/0 (socket says 172.21.15.40:33410) 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1401365655 learned_addr learned my addr 172.21.15.40:0/1401365655 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b3643f640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b300cd9d0 0x7f1b300b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b3543d640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3009af80 0x7f1b30152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b300cd9d0 msgr2=0x7f1b300b6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b300cd9d0 0x7f1b300b6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3009af80 msgr2=0x7f1b30152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3009af80 0x7f1b30152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 -- 172.21.15.40:0/1401365655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b300c66c0 con 0x7f1b30071020 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b35c3e640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0098c0 tx=0x7f1b2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c034040 con 0x7f1b30071020 2024-04-14T09:59:23.715 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2c03aaa0 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2c006e10 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.713+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b300c6960 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.714+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b300c87b0 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.714+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b30075760 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.715+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b2c04b060 con 0x7f1b30071020 2024-04-14T09:59:23.716 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.715+0000 7f1b267fc640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 0x7f1b1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.715+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f1b2c0ada90 con 0x7f1b30071020 2024-04-14T09:59:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.715+0000 7f1b3543d640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 0x7f1b1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:23.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.716+0000 7f1b3543d640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 0x7f1b1406ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009560 tx=0x7f1b20009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:23.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.720+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1b2c03f070 con 0x7f1b30071020 2024-04-14T09:59:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.901+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1b300cd6b0 con 0x7f1b30071020 2024-04-14T09:59:23.901 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.902+0000 7f1b267fc640 1 -- 172.21.15.40:0/1401365655 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f1b2c07b470 con 0x7f1b30071020 2024-04-14T09:59:23.902 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:23.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.903+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 msgr2=0x7f1b1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.903+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 0x7f1b1406ede0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1b20009560 tx=0x7f1b20009190 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.903+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 msgr2=0x7f1b300c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.903+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0098c0 tx=0x7f1b2c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 shutdown_connections 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c920 0x7f1b1406ede0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b300cd9d0 0x7f1b300b6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3009af80 0x7f1b30152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 --2- 172.21.15.40:0/1401365655 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b30071020 0x7f1b300c8270 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 >> 172.21.15.40:0/1401365655 conn(0x7f1b300b3ad0 msgr2=0x7f1b300b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 shutdown_connections 2024-04-14T09:59:23.904 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:23.904+0000 7f1b37ea2640 1 -- 172.21.15.40:0/1401365655 wait complete. 2024-04-14T09:59:23.914 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:24.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.019+0000 7fa9bfad1640 1 Processor -- start 2024-04-14T09:59:24.018 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.019+0000 7fa9bfad1640 1 -- start start 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bfad1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bfad1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bfad1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9b80d5000 con 0x7fa9b80d0c80 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bfad1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa9b80cf0d0 con 0x7fa9b8162bb0 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bfad1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80cf3b0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd06c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd06c640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:38556/0 (socket says 172.21.15.40:38556) 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.40:58806/0 (socket says 172.21.15.40:58806) 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd06c640 1 -- 172.21.15.40:0/2027953096 learned_addr learned my addr 172.21.15.40:0/2027953096 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9be06e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fa9b80d0c80 0x7fa9b80b70c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41874/0 (socket says 172.21.15.40:41874) 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 -- 172.21.15.40:0/2027953096 >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 msgr2=0x7fa9b80cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 --2- 172.21.15.40:0/2027953096 >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 -- 172.21.15.40:0/2027953096 >> v1:172.21.15.136:6789/0 conn(0x7fa9b80d0c80 legacy=0x7fa9b80b70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd86d640 1 -- 172.21.15.40:0/2027953096 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b80cf690 con 0x7fa9b8161ca0 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bc86b640 1 -- 172.21.15.40:0/2027953096 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870602359 0 0) 0x7fa9b80d5000 con 0x7fa9b80d0c80 2024-04-14T09:59:24.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.020+0000 7fa9bd06c640 1 --2- 172.21.15.40:0/2027953096 >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:24.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.021+0000 7fa9bd86d640 1 --2- 172.21.15.40:0/2027953096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40097a0 tx=0x7fa9b402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82bfdc8779516754 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.021+0000 7fa9bc86b640 1 -- 172.21.15.40:0/2027953096 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40315a0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.021+0000 7fa9bc86b640 1 -- 172.21.15.40:0/2027953096 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9b4037070 con 0x7fa9b8161ca0 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.021+0000 7fa9bc86b640 1 -- 172.21.15.40:0/2027953096 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b4031960 con 0x7fa9b8161ca0 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2027953096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 msgr2=0x7fa9b80d4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2027953096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40097a0 tx=0x7fa9b402b840 comp rx=0 tx=0).stop 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2027953096 shutdown_connections 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2027953096 >> v2:172.21.15.136:3300/0 conn(0x7fa9b8162bb0 0x7fa9b80cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2027953096 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8161ca0 0x7fa9b80d4980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2027953096 >> 172.21.15.40:0/2027953096 conn(0x7fa9b809d5c0 msgr2=0x7fa9b80d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2027953096 shutdown_connections 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.022+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2027953096 wait complete. 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.023+0000 7fa9bfad1640 1 Processor -- start 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.023+0000 7fa9bfad1640 1 -- start start 2024-04-14T09:59:24.025 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 0x7fa9b8160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 0x7fa9b80ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80ced80 con 0x7fa9b8161ca0 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa9b80d00f0 con 0x7fa9b80d0c80 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa9b80b77d0 con 0x7fa9b8162bb0 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd86d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 0x7fa9b8160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33412/0 (socket says 172.21.15.40:33412) 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 -- 172.21.15.40:0/2026026120 learned_addr learned my addr 172.21.15.40:0/2026026120 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9be06e640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 0x7fa9b80ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 -- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 msgr2=0x7fa9b80ccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 0x7fa9b80ccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 -- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 msgr2=0x7fa9b8160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 0x7fa9b8160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 -- 172.21.15.40:0/2026026120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9b815a3d0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd86d640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 0x7fa9b8160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9be06e640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 0x7fa9b80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bd06c640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e9b0 tx=0x7fa9a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8017070 con 0x7fa9b8161ca0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9a800c9a0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9b815a6b0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.024+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800cd50 con 0x7fa9b8161ca0 2024-04-14T09:59:24.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.025+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9b815ac70 con 0x7fa9b8161ca0 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.025+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9b8075760 con 0x7fa9b8161ca0 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.026+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9a801a070 con 0x7fa9b8161ca0 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.026+0000 7fa9ae7fc640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.026+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa9a808c150 con 0x7fa9b8161ca0 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.027+0000 7fa9bd86d640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.027+0000 7fa9bd86d640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 0x7fa99c06ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4036000 tx=0x7fa9b4008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.030 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.031+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa9a8059ab0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.217+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa9b80ba130 con 0x7fa9b8161ca0 2024-04-14T09:59:24.217 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.218+0000 7fa9ae7fc640 1 -- 172.21.15.40:0/2026026120 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7fa9a805ddb0 con 0x7fa9b8161ca0 2024-04-14T09:59:24.217 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 msgr2=0x7fa99c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 0x7fa99c06ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4036000 tx=0x7fa9b4008030 comp rx=0 tx=0).stop 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 msgr2=0x7fa9b814a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e9b0 tx=0x7fa9a800ee70 comp rx=0 tx=0).stop 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 shutdown_connections 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa99c06c920 0x7fa99c06ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa9b8162bb0 0x7fa9b80ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa9b8161ca0 0x7fa9b814a540 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 --2- 172.21.15.40:0/2026026120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa9b80d0c80 0x7fa9b8160e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 >> 172.21.15.40:0/2026026120 conn(0x7fa9b809d5c0 msgr2=0x7fa9b80d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 shutdown_connections 2024-04-14T09:59:24.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.220+0000 7fa9bfad1640 1 -- 172.21.15.40:0/2026026120 wait complete. 2024-04-14T09:59:24.230 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-14T09:59:24.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.335+0000 7fb51f4de640 1 Processor -- start 2024-04-14T09:59:24.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.335+0000 7fb51f4de640 1 -- start start 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51f4de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 0x7fb5180d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51f4de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 0x7fb5180d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51f4de640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb518163040 con 0x7fb518162bb0 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51f4de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb5180d15f0 con 0x7fb518161ca0 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51f4de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180d5000 con 0x7fb5180d0c80 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51ca79640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb518162bb0 0x7fb5180cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38128/0 (socket says 172.21.15.40:38128) 2024-04-14T09:59:24.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51ca79640 1 -- 172.21.15.40:0/4118380967 learned_addr learned my addr 172.21.15.40:0/4118380967 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51d27a640 1 --2- 172.21.15.40:0/4118380967 >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 0x7fb5180d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51da7b640 1 --2- 172.21.15.40:0/4118380967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 0x7fb5180d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb517fff640 1 -- 172.21.15.40:0/4118380967 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399604684 0 0) 0x7fb518163040 con 0x7fb518162bb0 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb517fff640 1 -- 172.21.15.40:0/4118380967 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb500003520 con 0x7fb518162bb0 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51da7b640 1 -- 172.21.15.40:0/4118380967 >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 msgr2=0x7fb5180d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51da7b640 1 --2- 172.21.15.40:0/4118380967 >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 0x7fb5180d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51da7b640 1 -- 172.21.15.40:0/4118380967 >> v1:172.21.15.40:6789/0 conn(0x7fb518162bb0 legacy=0x7fb5180cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51da7b640 1 -- 172.21.15.40:0/4118380967 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5180cf0d0 con 0x7fb5180d0c80 2024-04-14T09:59:24.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.336+0000 7fb51d27a640 1 --2- 172.21.15.40:0/4118380967 >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 0x7fb5180d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.337+0000 7fb51da7b640 1 --2- 172.21.15.40:0/4118380967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 0x7fb5180d10b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb508009d90 tx=0x7fb50802bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c128c977b69657 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.337+0000 7fb517fff640 1 -- 172.21.15.40:0/4118380967 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508039070 con 0x7fb5180d0c80 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.337+0000 7fb517fff640 1 -- 172.21.15.40:0/4118380967 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50802cb30 con 0x7fb5180d0c80 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.337+0000 7fb517fff640 1 -- 172.21.15.40:0/4118380967 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508034440 con 0x7fb5180d0c80 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 -- 172.21.15.40:0/4118380967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 msgr2=0x7fb5180d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 --2- 172.21.15.40:0/4118380967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 0x7fb5180d10b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb508009d90 tx=0x7fb50802bd80 comp rx=0 tx=0).stop 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 -- 172.21.15.40:0/4118380967 shutdown_connections 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 --2- 172.21.15.40:0/4118380967 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5180d0c80 0x7fb5180d10b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 --2- 172.21.15.40:0/4118380967 >> v2:172.21.15.136:3300/0 conn(0x7fb518161ca0 0x7fb5180d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 -- 172.21.15.40:0/4118380967 >> 172.21.15.40:0/4118380967 conn(0x7fb51809d5c0 msgr2=0x7fb5180d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 -- 172.21.15.40:0/4118380967 shutdown_connections 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.338+0000 7fb51f4de640 1 -- 172.21.15.40:0/4118380967 wait complete. 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.339+0000 7fb51f4de640 1 Processor -- start 2024-04-14T09:59:24.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.339+0000 7fb51f4de640 1 -- start start 2024-04-14T09:59:24.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5180d0c80 0x7fb5180cde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb518161ca0 0x7fb5180cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180ced80 con 0x7fb518162bb0 2024-04-14T09:59:24.341 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb5180cf690 con 0x7fb5180d0c80 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51f4de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb5180b70c0 con 0x7fb518161ca0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33416/0 (socket says 172.21.15.40:33416) 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 -- 172.21.15.40:0/770806250 learned_addr learned my addr 172.21.15.40:0/770806250 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51ca79640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb518161ca0 0x7fb5180cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51d27a640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5180d0c80 0x7fb5180cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 -- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb518161ca0 msgr2=0x7fb5180cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb518161ca0 0x7fb5180cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 -- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5180d0c80 msgr2=0x7fb5180cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5180d0c80 0x7fb5180cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 -- 172.21.15.40:0/770806250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5180cc290 con 0x7fb518162bb0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.340+0000 7fb51da7b640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb508009d90 tx=0x7fb508004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.341+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb508039050 con 0x7fb518162bb0 2024-04-14T09:59:24.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.341+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb508045070 con 0x7fb518162bb0 2024-04-14T09:59:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.341+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5180cc530 con 0x7fb518162bb0 2024-04-14T09:59:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.341+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb50803e850 con 0x7fb518162bb0 2024-04-14T09:59:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.341+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5180ccaf0 con 0x7fb518162bb0 2024-04-14T09:59:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.342+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb518075760 con 0x7fb518162bb0 2024-04-14T09:59:24.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.342+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb50803e9f0 con 0x7fb518162bb0 2024-04-14T09:59:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.343+0000 7fb515ffb640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 0x7fb50406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.343+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fb5080aea40 con 0x7fb518162bb0 2024-04-14T09:59:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.343+0000 7fb51d27a640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 0x7fb50406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.343+0000 7fb51d27a640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 0x7fb50406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5181f78b0 tx=0x7fb510009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.347+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb50807c5d0 con 0x7fb518162bb0 2024-04-14T09:59:24.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.533+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb5180d0a60 con 0x7fb518162bb0 2024-04-14T09:59:24.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.533+0000 7fb515ffb640 1 -- 172.21.15.40:0/770806250 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fb5080808d0 con 0x7fb518162bb0 2024-04-14T09:59:24.533 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:24.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 msgr2=0x7fb50406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 0x7fb50406edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5181f78b0 tx=0x7fb510009190 comp rx=0 tx=0).stop 2024-04-14T09:59:24.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 msgr2=0x7fb5180c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb508009d90 tx=0x7fb508004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 shutdown_connections 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb50406c8f0 0x7fb50406edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb518162bb0 0x7fb5180c9c50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb518161ca0 0x7fb5180cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 --2- 172.21.15.40:0/770806250 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5180d0c80 0x7fb5180cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 >> 172.21.15.40:0/770806250 conn(0x7fb51809d5c0 msgr2=0x7fb5180d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 shutdown_connections 2024-04-14T09:59:24.536 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.535+0000 7fb51f4de640 1 -- 172.21.15.40:0/770806250 wait complete. 2024-04-14T09:59:24.546 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:24.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.649+0000 7fa24a31e640 1 Processor -- start 2024-04-14T09:59:24.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.649+0000 7fa24a31e640 1 -- start start 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa24a31e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa24415e370 0x7fa2440d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa24a31e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24406d800 0x7fa24409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa24a31e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24406c760 con 0x7fa2440d12f0 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa24a31e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa24406d370 con 0x7fa24406d800 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa24a31e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa24406ca40 con 0x7fa24415e370 2024-04-14T09:59:24.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa2437fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24406d800 0x7fa24409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa2437fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa24406d800 0x7fa24409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33426/0 (socket says 172.21.15.40:33426) 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa2437fe640 1 -- 172.21.15.40:0/3529665298 learned_addr learned my addr 172.21.15.40:0/3529665298 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.650+0000 7fa243fff640 1 --2- 172.21.15.40:0/3529665298 >> v2:172.21.15.136:3300/0 conn(0x7fa24415e370 0x7fa2440d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.651+0000 7fa2437fe640 1 -- 172.21.15.40:0/3529665298 >> v2:172.21.15.136:3300/0 conn(0x7fa24415e370 msgr2=0x7fa2440d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.651+0000 7fa2437fe640 1 --2- 172.21.15.40:0/3529665298 >> v2:172.21.15.136:3300/0 conn(0x7fa24415e370 0x7fa2440d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.651+0000 7fa2437fe640 1 -- 172.21.15.40:0/3529665298 >> v1:172.21.15.136:6789/0 conn(0x7fa2440d12f0 legacy=0x7fa244162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.651+0000 7fa2437fe640 1 -- 172.21.15.40:0/3529665298 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24406cd20 con 0x7fa24406d800 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.651+0000 7fa2437fe640 1 --2- 172.21.15.40:0/3529665298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24406d800 0x7fa24409aa40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa24406f4e0 tx=0x7fa22c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81dca2cbf1178212 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa242ffd640 1 -- 172.21.15.40:0/3529665298 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c034070 con 0x7fa24406d800 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa242ffd640 1 -- 172.21.15.40:0/3529665298 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa22c030860 con 0x7fa24406d800 2024-04-14T09:59:24.652 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa242ffd640 1 -- 172.21.15.40:0/3529665298 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa22c030c30 con 0x7fa24406d800 2024-04-14T09:59:24.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 -- 172.21.15.40:0/3529665298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24406d800 msgr2=0x7fa24409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.655 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3529665298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24406d800 0x7fa24409aa40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa24406f4e0 tx=0x7fa22c02b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 -- 172.21.15.40:0/3529665298 shutdown_connections 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3529665298 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24406d800 0x7fa24409aa40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3529665298 >> v2:172.21.15.136:3300/0 conn(0x7fa24415e370 0x7fa2440d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 -- 172.21.15.40:0/3529665298 >> 172.21.15.40:0/3529665298 conn(0x7fa2440b3ba0 msgr2=0x7fa2440b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 -- 172.21.15.40:0/3529665298 shutdown_connections 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.652+0000 7fa24a31e640 1 -- 172.21.15.40:0/3529665298 wait complete. 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.653+0000 7fa24a31e640 1 Processor -- start 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.653+0000 7fa24a31e640 1 -- start start 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 0x7fa2441585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2440d12f0 0x7fa2440b7560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415e8d0 con 0x7fa24415e370 2024-04-14T09:59:24.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415e750 con 0x7fa24406d800 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa24a31e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa24409af80 con 0x7fa2440d12f0 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa2488bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa2488bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33436/0 (socket says 172.21.15.40:33436) 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa2488bb640 1 -- 172.21.15.40:0/3010424478 learned_addr learned my addr 172.21.15.40:0/3010424478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa243fff640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 0x7fa2441585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.654+0000 7fa2437fe640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2440d12f0 0x7fa2440b7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 -- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2440d12f0 msgr2=0x7fa2440b7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2440d12f0 0x7fa2440b7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 -- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 msgr2=0x7fa2441585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 0x7fa2441585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 -- 172.21.15.40:0/3010424478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2440b7aa0 con 0x7fa24415e370 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa243fff640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 0x7fa2441585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:24.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa2488bb640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c7a0 tx=0x7fa23c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c003b70 con 0x7fa24415e370 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23c003d30 con 0x7fa24415e370 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2440c5f30 con 0x7fa24415e370 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23c00aa90 con 0x7fa24415e370 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.655+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2440c64f0 con 0x7fa24415e370 2024-04-14T09:59:24.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.656+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2440756f0 con 0x7fa24415e370 2024-04-14T09:59:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.657+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa23c00ac30 con 0x7fa24415e370 2024-04-14T09:59:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.657+0000 7fa240ff9640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 0x7fa22406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.657+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fa23c08bd60 con 0x7fa24415e370 2024-04-14T09:59:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.657+0000 7fa243fff640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 0x7fa22406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:24.659 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.658+0000 7fa243fff640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 0x7fa22406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa234009e90 tx=0x7fa234009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:24.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.661+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa23c059740 con 0x7fa24415e370 2024-04-14T09:59:24.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.885+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2440b8030 con 0x7fa24415e370 2024-04-14T09:59:24.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.886+0000 7fa240ff9640 1 -- 172.21.15.40:0/3010424478 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7fa23c05da40 con 0x7fa24415e370 2024-04-14T09:59:24.886 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:24.886 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:59:24.886 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 msgr2=0x7fa22406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 0x7fa22406edb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa234009e90 tx=0x7fa234009190 comp rx=0 tx=0).stop 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 msgr2=0x7fa2440b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa23c00c7a0 tx=0x7fa23c00cc60 comp rx=0 tx=0).stop 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 shutdown_connections 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa22406c8f0 0x7fa22406edb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa24415e370 0x7fa2440b1e50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa2440d12f0 0x7fa2440b7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.888 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 --2- 172.21.15.40:0/3010424478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24406d800 0x7fa2441585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:24.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 >> 172.21.15.40:0/3010424478 conn(0x7fa2440b3ba0 msgr2=0x7fa2440b00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:24.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 shutdown_connections 2024-04-14T09:59:24.889 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:24.888+0000 7fa24a31e640 1 -- 172.21.15.40:0/3010424478 wait complete. 2024-04-14T09:59:24.899 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.001+0000 7f029c7a3640 1 Processor -- start 2024-04-14T09:59:25.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.001+0000 7f029c7a3640 1 -- start start 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029c7a3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f02940b4680 0x7f029406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029c7a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029409aa40 0x7f029409aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029c7a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02940d0210 con 0x7f029415e670 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029c7a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f029406da20 con 0x7f029409aa40 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029c7a3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f02940d0b00 con 0x7f02940b4680 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029409aa40 0x7f029409aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029a53f640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f029415e670 0x7f02940d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38142/0 (socket says 172.21.15.40:38142) 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f029409aa40 0x7f029409aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33450/0 (socket says 172.21.15.40:33450) 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029a53f640 1 -- 172.21.15.40:0/411798654 learned_addr learned my addr 172.21.15.40:0/411798654 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f0299d3e640 1 --2- 172.21.15.40:0/411798654 >> v2:172.21.15.136:3300/0 conn(0x7f02940b4680 0x7f029406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 -- 172.21.15.40:0/411798654 >> v2:172.21.15.136:3300/0 conn(0x7f02940b4680 msgr2=0x7f029406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:25.002 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 --2- 172.21.15.40:0/411798654 >> v2:172.21.15.136:3300/0 conn(0x7f02940b4680 0x7f029406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 -- 172.21.15.40:0/411798654 >> v1:172.21.15.40:6789/0 conn(0x7f029415e670 legacy=0x7f02940d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.003 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.002+0000 7f029ad40640 1 -- 172.21.15.40:0/411798654 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029406d740 con 0x7f029409aa40 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.003+0000 7f029ad40640 1 --2- 172.21.15.40:0/411798654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f029409aed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0294072c50 tx=0x7f028c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51bb2da268787e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.003+0000 7f029953d640 1 -- 172.21.15.40:0/411798654 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c039070 con 0x7f029409aa40 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.003+0000 7f029953d640 1 -- 172.21.15.40:0/411798654 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c02cd00 con 0x7f029409aa40 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.003+0000 7f029953d640 1 -- 172.21.15.40:0/411798654 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c034660 con 0x7f029409aa40 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 -- 172.21.15.40:0/411798654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 msgr2=0x7f029409aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 --2- 172.21.15.40:0/411798654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f029409aed0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0294072c50 tx=0x7f028c02bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 -- 172.21.15.40:0/411798654 shutdown_connections 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 --2- 172.21.15.40:0/411798654 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f029409aed0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 --2- 172.21.15.40:0/411798654 >> v2:172.21.15.136:3300/0 conn(0x7f02940b4680 0x7f029406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 -- 172.21.15.40:0/411798654 >> 172.21.15.40:0/411798654 conn(0x7f02940b3b90 msgr2=0x7f02940b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 -- 172.21.15.40:0/411798654 shutdown_connections 2024-04-14T09:59:25.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.004+0000 7f029c7a3640 1 -- 172.21.15.40:0/411798654 wait complete. 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.005+0000 7f029c7a3640 1 Processor -- start 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.005+0000 7f029c7a3640 1 -- start start 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02940b4680 0x7f02940b4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029415e670 0x7f02940b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f02940d0790 con 0x7f029409aa40 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f02940d16a0 con 0x7f029415e670 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f029406f5a0 con 0x7f02940b4680 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33458/0 (socket says 172.21.15.40:33458) 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 -- 172.21.15.40:0/266159911 learned_addr learned my addr 172.21.15.40:0/266159911 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:25.007 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029ad40640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029415e670 0x7f02940b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f0299d3e640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02940b4680 0x7f02940b4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 -- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02940b4680 msgr2=0x7f02940b4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02940b4680 0x7f02940b4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 -- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029415e670 msgr2=0x7f02940b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029415e670 0x7f02940b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 -- 172.21.15.40:0/266159911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02940b69d0 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029a53f640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f029000c3f0 tx=0x7f029000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0290017070 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0290005ce0 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02940b53f0 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02900072f0 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.006+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02940b59b0 con 0x7f029409aa40 2024-04-14T09:59:25.008 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.007+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02940756f0 con 0x7f029409aa40 2024-04-14T09:59:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.008+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f029001a070 con 0x7f029409aa40 2024-04-14T09:59:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.008+0000 7f028affd640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 0x7f027806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.008+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f029008b220 con 0x7f029409aa40 2024-04-14T09:59:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.008+0000 7f0299d3e640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 0x7f027806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.009 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.009+0000 7f0299d3e640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 0x7f027806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02940687f0 tx=0x7f0284009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.012 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.013+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f0290058c00 con 0x7f029409aa40 2024-04-14T09:59:25.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.201+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02940b8020 con 0x7f029409aa40 2024-04-14T09:59:25.202 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.203+0000 7f028affd640 1 -- 172.21.15.40:0/266159911 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7f029005cf00 con 0x7f029409aa40 2024-04-14T09:59:25.202 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:25.203 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 msgr2=0x7f027806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 0x7f027806edb0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f02940687f0 tx=0x7f0284009190 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 msgr2=0x7f02941606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f029000c3f0 tx=0x7f029000c8b0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 shutdown_connections 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f027806c8f0 0x7f027806edb0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f029415e670 0x7f02940b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f02940b4680 0x7f02940b4cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 --2- 172.21.15.40:0/266159911 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f029409aa40 0x7f02941606c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.205 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 >> 172.21.15.40:0/266159911 conn(0x7f02940b3b90 msgr2=0x7f02941629f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 shutdown_connections 2024-04-14T09:59:25.206 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.205+0000 7f029c7a3640 1 -- 172.21.15.40:0/266159911 wait complete. 2024-04-14T09:59:25.216 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T09:59:25.216 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:25.317 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.318+0000 7f8c9842d640 1 Processor -- start 2024-04-14T09:59:25.318 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.318+0000 7f8c9842d640 1 -- start start 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c9842d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 0x7f8c9006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c9842d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c9009aa40 0x7f8c9009aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c9842d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c900d0210 con 0x7f8c9015e670 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c9842d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8c9006da20 con 0x7f8c9009aa40 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c9842d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8c900d0b00 con 0x7f8c900b4680 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c9009aa40 0x7f8c9009aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c961c9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8c9015e670 0x7f8c900d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38156/0 (socket says 172.21.15.40:38156) 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c959c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 0x7f8c9006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8c9009aa40 0x7f8c9009aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33474/0 (socket says 172.21.15.40:33474) 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c961c9640 1 -- 172.21.15.40:0/885181550 learned_addr learned my addr 172.21.15.40:0/885181550 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 -- 172.21.15.40:0/885181550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 msgr2=0x7f8c9006cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 0x7f8c9006cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 -- 172.21.15.40:0/885181550 >> v1:172.21.15.40:6789/0 conn(0x7f8c9015e670 legacy=0x7f8c900d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c951c7640 1 -- 172.21.15.40:0/885181550 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375880186 0 0) 0x7f8c900d0210 con 0x7f8c9015e670 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c969ca640 1 -- 172.21.15.40:0/885181550 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9006d740 con 0x7f8c9009aa40 2024-04-14T09:59:25.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.319+0000 7f8c959c8640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 0x7f8c9006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.320+0000 7f8c969ca640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c9009aa40 0x7f8c9009aed0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c880097a0 tx=0x7f8c8802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813256bc9af1d80e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.320+0000 7f8c951c7640 1 -- 172.21.15.40:0/885181550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c88034070 con 0x7f8c9009aa40 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.320+0000 7f8c951c7640 1 -- 172.21.15.40:0/885181550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c88030610 con 0x7f8c9009aa40 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.320+0000 7f8c951c7640 1 -- 172.21.15.40:0/885181550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c880309e0 con 0x7f8c9009aa40 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 -- 172.21.15.40:0/885181550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c9009aa40 msgr2=0x7f8c9009aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c9009aa40 0x7f8c9009aed0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c880097a0 tx=0x7f8c8802b960 comp rx=0 tx=0).stop 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 -- 172.21.15.40:0/885181550 shutdown_connections 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c9009aa40 0x7f8c9009aed0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 --2- 172.21.15.40:0/885181550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c900b4680 0x7f8c9006cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 -- 172.21.15.40:0/885181550 >> 172.21.15.40:0/885181550 conn(0x7f8c900b3b90 msgr2=0x7f8c900b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 -- 172.21.15.40:0/885181550 shutdown_connections 2024-04-14T09:59:25.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.321+0000 7f8c9842d640 1 -- 172.21.15.40:0/885181550 wait complete. 2024-04-14T09:59:25.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.322+0000 7f8c9842d640 1 Processor -- start 2024-04-14T09:59:25.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.322+0000 7f8c9842d640 1 -- start start 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c9009aa40 0x7f8c9009f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015e670 0x7f8c900b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8c900d0790 con 0x7f8c900b4680 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8c900d16a0 con 0x7f8c9015e670 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c9842d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8c9006f5a0 con 0x7f8c9009aa40 2024-04-14T09:59:25.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33478/0 (socket says 172.21.15.40:33478) 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 -- 172.21.15.40:0/1096982550 learned_addr learned my addr 172.21.15.40:0/1096982550 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c969ca640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015e670 0x7f8c900b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c961c9640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c9009aa40 0x7f8c9009f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 -- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c9009aa40 msgr2=0x7f8c9009f6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c9009aa40 0x7f8c9009f6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 -- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015e670 msgr2=0x7f8c900b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015e670 0x7f8c900b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 -- 172.21.15.40:0/1096982550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c9009ca60 con 0x7f8c900b4680 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.323+0000 7f8c959c8640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ec10 tx=0x7f8c8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.324+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84017070 con 0x7f8c900b4680 2024-04-14T09:59:25.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.324+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c8400cc30 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.324+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c84013470 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.324+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c9009cd40 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.324+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c9009d300 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.325+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c900756f0 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.325+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c8401a070 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.326+0000 7f8c8effd640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.326+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8c8408c190 con 0x7f8c900b4680 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.326+0000 7f8c961c9640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.326+0000 7f8c961c9640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c800012e0 tx=0x7f8c80001630 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.329 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.330+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8c84059b70 con 0x7f8c900b4680 2024-04-14T09:59:25.551 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.552+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c90161240 con 0x7f8c900b4680 2024-04-14T09:59:25.552 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.552+0000 7f8c8effd640 1 -- 172.21.15.40:0/1096982550 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f8c8405de70 con 0x7f8c900b4680 2024-04-14T09:59:25.552 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:25.552 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:59:25.552 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:59:25.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 msgr2=0x7f8c7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8c800012e0 tx=0x7f8c80001630 comp rx=0 tx=0).stop 2024-04-14T09:59:25.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 msgr2=0x7f8c900b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.554 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ec10 tx=0x7f8c8400c520 comp rx=0 tx=0).stop 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 shutdown_connections 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8c7c06c8f0 0x7f8c7c06edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.554+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8c9015e670 0x7f8c900b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.555+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8c900b4680 0x7f8c900b23b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.555+0000 7f8c9842d640 1 --2- 172.21.15.40:0/1096982550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8c9009aa40 0x7f8c9009f6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.555+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 >> 172.21.15.40:0/1096982550 conn(0x7f8c900b3b90 msgr2=0x7f8c900693a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.555+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 shutdown_connections 2024-04-14T09:59:25.555 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.555+0000 7f8c9842d640 1 -- 172.21.15.40:0/1096982550 wait complete. 2024-04-14T09:59:25.565 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:25.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.667+0000 7f9211888640 1 Processor -- start 2024-04-14T09:59:25.666 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.667+0000 7f9211888640 1 -- start start 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f9211888640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f920c15e670 0x7f920c0b4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f9211888640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c09aa40 0x7f920c09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f9211888640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f920c0d0210 con 0x7f920c06cff0 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f9211888640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f920c06da20 con 0x7f920c15e670 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f9211888640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0d0b00 con 0x7f920c09aa40 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f920c15e670 0x7f920c0b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f92027fc640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f920c06cff0 0x7f920c0d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38166/0 (socket says 172.21.15.40:38166) 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f92027fc640 1 -- 172.21.15.40:0/3618046987 learned_addr learned my addr 172.21.15.40:0/3618046987 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:25.668 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920b7fe640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c09aa40 0x7f920c09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920affd640 1 -- 172.21.15.40:0/3618046987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c09aa40 msgr2=0x7f920c09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920affd640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c09aa40 0x7f920c09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920affd640 1 -- 172.21.15.40:0/3618046987 >> v1:172.21.15.40:6789/0 conn(0x7f920c06cff0 legacy=0x7f920c0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920a7fc640 1 -- 172.21.15.40:0/3618046987 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349690878 0 0) 0x7f920c0d0210 con 0x7f920c06cff0 2024-04-14T09:59:25.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.668+0000 7f920affd640 1 -- 172.21.15.40:0/3618046987 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c06d480 con 0x7f920c15e670 2024-04-14T09:59:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f920affd640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c15e670 0x7f920c0b4680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097a0 tx=0x7f91fc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926e5932cb8d437d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f920a7fc640 1 -- 172.21.15.40:0/3618046987 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc034070 con 0x7f920c15e670 2024-04-14T09:59:25.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f920a7fc640 1 -- 172.21.15.40:0/3618046987 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91fc030610 con 0x7f920c15e670 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f920a7fc640 1 -- 172.21.15.40:0/3618046987 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91fc0309e0 con 0x7f920c15e670 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f9211888640 1 -- 172.21.15.40:0/3618046987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c15e670 msgr2=0x7f920c0b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.669+0000 7f9211888640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c15e670 0x7f920c0b4680 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f91fc0097a0 tx=0x7f91fc02b960 comp rx=0 tx=0).stop 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 -- 172.21.15.40:0/3618046987 shutdown_connections 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c09aa40 0x7f920c09aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 --2- 172.21.15.40:0/3618046987 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c15e670 0x7f920c0b4680 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 -- 172.21.15.40:0/3618046987 >> 172.21.15.40:0/3618046987 conn(0x7f920c0b3b90 msgr2=0x7f920c0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 -- 172.21.15.40:0/3618046987 shutdown_connections 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.670+0000 7f9211888640 1 -- 172.21.15.40:0/3618046987 wait complete. 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.671+0000 7f9211888640 1 Processor -- start 2024-04-14T09:59:25.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.671+0000 7f9211888640 1 -- start start 2024-04-14T09:59:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.671+0000 7f9211888640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c06cff0 0x7f920c148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.674 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c15e670 0x7f920c148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0d04b0 con 0x7f920c09aa40 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f920c0d16a0 con 0x7f920c06cff0 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f920c0d0790 con 0x7f920c15e670 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33492/0 (socket says 172.21.15.40:33492) 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 -- 172.21.15.40:0/3787603136 learned_addr learned my addr 172.21.15.40:0/3787603136 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f920b7fe640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c15e670 0x7f920c148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f920affd640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c06cff0 0x7f920c148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 -- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c15e670 msgr2=0x7f920c148200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c15e670 0x7f920c148200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 -- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c06cff0 msgr2=0x7f920c148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c06cff0 0x7f920c148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 -- 172.21.15.40:0/3787603136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f920c14b0d0 con 0x7f920c09aa40 2024-04-14T09:59:25.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f92027fc640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c4d0 tx=0x7f91f400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4018070 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91f4007500 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f920c14b3b0 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f4004a20 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.672+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f920c14b970 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.673+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f920c0756f0 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.674+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f91f401b070 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.674+0000 7f9208ff9640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.674+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f91f408b200 con 0x7f920c09aa40 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.674+0000 7f920affd640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:25.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.675+0000 7f920affd640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 0x7f91ec06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91fc036000 tx=0x7f91fc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:25.678 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.679+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f91f4058be0 con 0x7f920c09aa40 2024-04-14T09:59:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.903+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f920c0b8020 con 0x7f920c09aa40 2024-04-14T09:59:25.903 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.904+0000 7f9208ff9640 1 -- 172.21.15.40:0/3787603136 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5180 (secure 0 0 0) 0x7f91f405cee0 con 0x7f920c09aa40 2024-04-14T09:59:25.904 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:25.904 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4241,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/3707853478","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6836","nonce":3707853478},{"type":"v1","addr":"172.21.15.136:6837","nonce":3707853478}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6834/1708965142","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1708965142},{"type":"v1","addr":"172.21.15.40:6834","nonce":1708965142}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/1415185750","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6833","nonce":1415185750},{"type":"v1","addr":"172.21.15.40:6835","nonce":1415185750}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:58:22.820415+0000","modified":"2024-04-14T09:58:44.815480+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4297},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4297":{"gid":4297,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/994538529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":994538529},{"type":"v1","addr":"172.21.15.136:6835","nonce":994538529}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4297,"qdb_cluster":[4297]},"id":1}]} 2024-04-14T09:59:25.904 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 9 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 msgr2=0x7f91ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 0x7f91ec06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f91fc036000 tx=0x7f91fc008030 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 msgr2=0x7f920c1f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f91f400c4d0 tx=0x7f91f400c990 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 shutdown_connections 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f920c15e670 0x7f920c148200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f920c09aa40 0x7f920c1f49c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 --2- 172.21.15.40:0/3787603136 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f920c06cff0 0x7f920c148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 >> 172.21.15.40:0/3787603136 conn(0x7f920c0b3b90 msgr2=0x7f920c0b1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:25.906 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 shutdown_connections 2024-04-14T09:59:25.907 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:25.906+0000 7f9211888640 1 -- 172.21.15.40:0/3787603136 wait complete. 2024-04-14T09:59:25.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.020+0000 7fe4d1c98640 1 Processor -- start 2024-04-14T09:59:26.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.020+0000 7fe4d1c98640 1 -- start start 2024-04-14T09:59:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4d1c98640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4cc15e650 0x7fe4cc0b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4d1c98640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc0b4c70 con 0x7fe4cc0b4760 2024-04-14T09:59:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4d1c98640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4cc0b4f50 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4d1c98640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe4cc0b5880 con 0x7fe4cc15e650 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4cb7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe4cc15e650 0x7fe4cc0b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4caffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe4cc0b4760 0x7fe4cc0d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38180/0 (socket says 172.21.15.40:38180) 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.021+0000 7fe4caffd640 1 -- 172.21.15.40:0/3298562231 learned_addr learned my addr 172.21.15.40:0/3298562231 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.40:0/3298562231 >> v1:172.21.15.136:6789/0 conn(0x7fe4cc0d2e80 legacy=0x7fe4cc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.40:0/3298562231 >> v1:172.21.15.40:6789/0 conn(0x7fe4cc0b4760 legacy=0x7fe4cc0d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4ca7fc640 1 -- 172.21.15.40:0/3298562231 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 823456340 0 0) 0x7fe4cc0b4c70 con 0x7fe4cc0b4760 2024-04-14T09:59:26.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4cb7fe640 1 -- 172.21.15.40:0/3298562231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc0b5230 con 0x7fe4cc15e650 2024-04-14T09:59:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4cb7fe640 1 --2- 172.21.15.40:0/3298562231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0b4220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4059cce08dcd6300 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.023 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4ca7fc640 1 -- 172.21.15.40:0/3298562231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc034070 con 0x7fe4cc15e650 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4ca7fc640 1 -- 172.21.15.40:0/3298562231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4bc030610 con 0x7fe4cc15e650 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.022+0000 7fe4ca7fc640 1 -- 172.21.15.40:0/3298562231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0309e0 con 0x7fe4cc15e650 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 -- 172.21.15.40:0/3298562231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15e650 msgr2=0x7fe4cc0b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/3298562231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0b4220 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc0097a0 tx=0x7fe4bc02b960 comp rx=0 tx=0).stop 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 -- 172.21.15.40:0/3298562231 shutdown_connections 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/3298562231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0b4220 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 -- 172.21.15.40:0/3298562231 >> 172.21.15.40:0/3298562231 conn(0x7fe4cc09d580 msgr2=0x7fe4cc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 -- 172.21.15.40:0/3298562231 shutdown_connections 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.023+0000 7fe4d1c98640 1 -- 172.21.15.40:0/3298562231 wait complete. 2024-04-14T09:59:26.024 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.024+0000 7fe4d1c98640 1 Processor -- start 2024-04-14T09:59:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.024+0000 7fe4d1c98640 1 -- start start 2024-04-14T09:59:26.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc0b4760 0x7fe4cc14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc15ea30 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe4cc0d2270 con 0x7fe4cc15e650 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4d1c98640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe4cc15ebb0 con 0x7fe4cc0b4760 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4caffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33514/0 (socket says 172.21.15.40:33514) 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4caffd640 1 -- 172.21.15.40:0/623371651 learned_addr learned my addr 172.21.15.40:0/623371651 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4cb7fe640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc0b4760 0x7fe4cc14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.025+0000 7fe4cbfff640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 -- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc0b4760 msgr2=0x7fe4cc14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc0b4760 0x7fe4cc14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.027 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 -- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc15e650 msgr2=0x7fe4cc0cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 -- 172.21.15.40:0/623371651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4cc161de0 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4caffd640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c460 tx=0x7fe4c000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0018070 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c0007520 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0004a20 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4cc0cab60 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.026+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4cc1544f0 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.028 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.027+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4cc0756f0 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.028+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4c001b070 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.028+0000 7fe4b3fff640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 0x7fe4b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.028+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fe4c008b260 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.028+0000 7fe4cb7fe640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 0x7fe4b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.029 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.029+0000 7fe4cb7fe640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 0x7fe4b806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc036000 tx=0x7fe4bc008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.032+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe4c0058c40 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.216 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.217+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4cc0cae40 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.218 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.218+0000 7fe4b3fff640 1 -- 172.21.15.40:0/623371651 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18878 (secure 0 0 0) 0x7fe4c005cf40 con 0x7fe4cc0d2e80 2024-04-14T09:59:26.218 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:26.218 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":27,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:04.516415+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:58:20.862655+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-14T09:58:21.696533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-14T09:58:25.404538+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"3.3f","mappings":[{"from":7,"to":1}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 msgr2=0x7fe4b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 0x7fe4b806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc036000 tx=0x7fe4bc008030 comp rx=0 tx=0).stop 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 msgr2=0x7fe4cc0cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000c460 tx=0x7fe4c000c920 comp rx=0 tx=0).stop 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 shutdown_connections 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe4b806c8f0 0x7fe4b806edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.220 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe4cc15e650 0x7fe4cc0cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe4cc0d2e80 0x7fe4cc0cc3d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 --2- 172.21.15.40:0/623371651 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe4cc0b4760 0x7fe4cc14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 >> 172.21.15.40:0/623371651 conn(0x7fe4cc09d580 msgr2=0x7fe4cc0d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 shutdown_connections 2024-04-14T09:59:26.221 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.220+0000 7fe4d1c98640 1 -- 172.21.15.40:0/623371651 wait complete. 2024-04-14T09:59:26.231 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-14T09:59:26.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.335+0000 7f8a36715640 1 Processor -- start 2024-04-14T09:59:26.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.335+0000 7f8a36715640 1 -- start start 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a36715640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a30145a30 0x7f8a3015d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a36715640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a3006d230 0x7f8a3006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a36715640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a30145e10 con 0x7f8a3015fd60 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a36715640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8a3015d730 con 0x7f8a3006d230 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a36715640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8a300cdcb0 con 0x7f8a30145a30 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2f7fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8a3006d230 0x7f8a3006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a34cb2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8a3015fd60 0x7f8a301601f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38186/0 (socket says 172.21.15.40:38186) 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a34cb2640 1 -- 172.21.15.40:0/3914763803 learned_addr learned my addr 172.21.15.40:0/3914763803 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2ffff640 1 --2- 172.21.15.40:0/3914763803 >> v2:172.21.15.136:3300/0 conn(0x7f8a30145a30 0x7f8a3015d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/3914763803 >> v2:172.21.15.136:3300/0 conn(0x7f8a30145a30 msgr2=0x7f8a3015d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2f7fe640 1 --2- 172.21.15.40:0/3914763803 >> v2:172.21.15.136:3300/0 conn(0x7f8a30145a30 0x7f8a3015d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/3914763803 >> v1:172.21.15.40:6789/0 conn(0x7f8a3015fd60 legacy=0x7f8a301601f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/3914763803 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a300cdf90 con 0x7f8a3006d230 2024-04-14T09:59:26.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.336+0000 7f8a2effd640 1 -- 172.21.15.40:0/3914763803 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281044929 0 0) 0x7f8a30145e10 con 0x7f8a3015fd60 2024-04-14T09:59:26.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a2f7fe640 1 --2- 172.21.15.40:0/3914763803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3006d230 0x7f8a3006d6c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8a300737c0 tx=0x7f8a2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88136bfec5e2ca30 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a2effd640 1 -- 172.21.15.40:0/3914763803 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a240315a0 con 0x7f8a3006d230 2024-04-14T09:59:26.338 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a2effd640 1 -- 172.21.15.40:0/3914763803 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a24037070 con 0x7f8a3006d230 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a2effd640 1 -- 172.21.15.40:0/3914763803 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24031960 con 0x7f8a3006d230 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a36715640 1 -- 172.21.15.40:0/3914763803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3006d230 msgr2=0x7f8a3006d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.337+0000 7f8a36715640 1 --2- 172.21.15.40:0/3914763803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3006d230 0x7f8a3006d6c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8a300737c0 tx=0x7f8a2402b840 comp rx=0 tx=0).stop 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 -- 172.21.15.40:0/3914763803 shutdown_connections 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 --2- 172.21.15.40:0/3914763803 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a3006d230 0x7f8a3006d6c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 --2- 172.21.15.40:0/3914763803 >> v2:172.21.15.136:3300/0 conn(0x7f8a30145a30 0x7f8a3015d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 -- 172.21.15.40:0/3914763803 >> 172.21.15.40:0/3914763803 conn(0x7f8a3006eb90 msgr2=0x7f8a3006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 -- 172.21.15.40:0/3914763803 shutdown_connections 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.338+0000 7f8a36715640 1 -- 172.21.15.40:0/3914763803 wait complete. 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.339+0000 7f8a36715640 1 Processor -- start 2024-04-14T09:59:26.339 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.339+0000 7f8a36715640 1 -- start start 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.339+0000 7f8a36715640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 0x7f8a301f53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a3015fd60 0x7f8a300c4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300ce550 con 0x7f8a30145a30 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a300afa20 con 0x7f8a3006d230 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8a300cd8f0 con 0x7f8a3015fd60 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.342 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 0x7f8a301f53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:33528/0 (socket says 172.21.15.40:33528) 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/1371009415 learned_addr learned my addr 172.21.15.40:0/1371009415 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 0x7f8a301f53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:38660/0 (socket says 172.21.15.40:38660) 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a34cb2640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a3015fd60 0x7f8a300c4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a3015fd60 msgr2=0x7f8a300c4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a3015fd60 0x7f8a300c4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 msgr2=0x7f8a301f53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 0x7f8a301f53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 -- 172.21.15.40:0/1371009415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a300c54e0 con 0x7f8a30145a30 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2f7fe640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8a24034040 tx=0x7f8a240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24004230 con 0x7f8a30145a30 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a240043d0 con 0x7f8a30145a30 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a300722d0 con 0x7f8a30145a30 2024-04-14T09:59:26.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a24003850 con 0x7f8a30145a30 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.340+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a300b1050 con 0x7f8a30145a30 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.341+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a300731f0 con 0x7f8a30145a30 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.342+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a240039f0 con 0x7f8a30145a30 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.342+0000 7f8a2cff9640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 0x7f8a1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.342+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8a2402f030 con 0x7f8a30145a30 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.342+0000 7f8a2ffff640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 0x7f8a1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.343+0000 7f8a2ffff640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 0x7f8a1c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a300728e0 tx=0x7f8a20009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.347+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8a24041070 con 0x7f8a30145a30 2024-04-14T09:59:26.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.569+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f8a30075760 con 0x7f8a30145a30 2024-04-14T09:59:26.569 INFO:tasks.ceph.mon.a.smithi040.stderr:2024-04-14T09:59:26.570+0000 7fcc133f1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-14T09:59:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.571+0000 7f8a2cff9640 1 -- 172.21.15.40:0/1371009415 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f8a2407b730 con 0x7f8a30145a30 2024-04-14T09:59:26.570 INFO:teuthology.orchestra.run.smithi040.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 msgr2=0x7f8a1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 0x7f8a1c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a300728e0 tx=0x7f8a20009190 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 msgr2=0x7f8a301f71a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8a24034040 tx=0x7f8a240046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 shutdown_connections 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8a1c06c8f0 0x7f8a1c06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a3015fd60 0x7f8a300c4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8a30145a30 0x7f8a301f71a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 --2- 172.21.15.40:0/1371009415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a3006d230 0x7f8a301f53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 >> 172.21.15.40:0/1371009415 conn(0x7f8a3006eb90 msgr2=0x7f8a3015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 shutdown_connections 2024-04-14T09:59:26.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.573+0000 7f8a36715640 1 -- 172.21.15.40:0/1371009415 wait complete. 2024-04-14T09:59:26.577 INFO:tasks.ceph.mds.d.smithi136.stderr: -5503> 2024-04-14T09:58:28.360+0000 7fbc8d1f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T09:59:26.584 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-14T09:59:26.607 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-04-14T09:59:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.687+0000 7f48c511e640 1 Processor -- start 2024-04-14T09:59:26.687 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.687+0000 7f48c511e640 1 -- start start 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48c511e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0071020 0x7f48c009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48c511e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f48c009af80 0x7f48c00cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48c511e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48c006cc40 con 0x7f48c00cd9d0 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48c511e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f48c009b3c0 con 0x7f48c0071020 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48c511e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f48c006c960 con 0x7f48c009af80 2024-04-14T09:59:26.688 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48bed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0071020 0x7f48c009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48bed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f48c0071020 0x7f48c009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57896/0 (socket says 172.21.15.40:57896) 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48bed9d640 1 -- 172.21.15.40:0/2090588613 learned_addr learned my addr 172.21.15.40:0/2090588613 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.688+0000 7f48be59c640 1 --2- 172.21.15.40:0/2090588613 >> v2:172.21.15.136:3300/0 conn(0x7f48c009af80 0x7f48c00cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bed9d640 1 -- 172.21.15.40:0/2090588613 >> v2:172.21.15.136:3300/0 conn(0x7f48c009af80 msgr2=0x7f48c00cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bed9d640 1 --2- 172.21.15.40:0/2090588613 >> v2:172.21.15.136:3300/0 conn(0x7f48c009af80 0x7f48c00cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bed9d640 1 -- 172.21.15.40:0/2090588613 >> v1:172.21.15.136:6789/0 conn(0x7f48c00cd9d0 legacy=0x7f48c00cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.689 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bed9d640 1 -- 172.21.15.40:0/2090588613 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c00cc6d0 con 0x7f48c0071020 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bed9d640 1 --2- 172.21.15.40:0/2090588613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0071020 0x7f48c009aa40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48c0068300 tx=0x7f48b002c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc2aa077748c5e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bdd9b640 1 -- 172.21.15.40:0/2090588613 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b002cbb0 con 0x7f48c0071020 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bdd9b640 1 -- 172.21.15.40:0/2090588613 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b002cd50 con 0x7f48c0071020 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.689+0000 7f48bdd9b640 1 -- 172.21.15.40:0/2090588613 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b0034610 con 0x7f48c0071020 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 -- 172.21.15.40:0/2090588613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0071020 msgr2=0x7f48c009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.690 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 --2- 172.21.15.40:0/2090588613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0071020 0x7f48c009aa40 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f48c0068300 tx=0x7f48b002c010 comp rx=0 tx=0).stop 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 -- 172.21.15.40:0/2090588613 shutdown_connections 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 --2- 172.21.15.40:0/2090588613 >> v2:172.21.15.136:3300/0 conn(0x7f48c009af80 0x7f48c00cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 --2- 172.21.15.40:0/2090588613 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c0071020 0x7f48c009aa40 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 -- 172.21.15.40:0/2090588613 >> 172.21.15.40:0/2090588613 conn(0x7f48c00b3ad0 msgr2=0x7f48c00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 -- 172.21.15.40:0/2090588613 shutdown_connections 2024-04-14T09:59:26.691 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.690+0000 7f48c511e640 1 -- 172.21.15.40:0/2090588613 wait complete. 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.691+0000 7f48c511e640 1 Processor -- start 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 -- start start 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0071020 0x7f48c01e06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 0x7f48c00afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f48c00ccf70 con 0x7f48c009af80 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48c00ccc90 con 0x7f48c0071020 2024-04-14T09:59:26.693 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48c511e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f48c006db50 con 0x7f48c00cd9d0 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48be59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48be59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57898/0 (socket says 172.21.15.40:57898) 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.692+0000 7f48be59c640 1 -- 172.21.15.40:0/4133171840 learned_addr learned my addr 172.21.15.40:0/4133171840 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48bf59e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 0x7f48c00afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48bed9d640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0071020 0x7f48c01e06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 -- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 msgr2=0x7f48c00afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 0x7f48c00afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 -- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0071020 msgr2=0x7f48c01e06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0071020 0x7f48c01e06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 -- 172.21.15.40:0/4133171840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48c01e0c00 con 0x7f48c009af80 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48bf59e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 0x7f48c00afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48be59c640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e8a0 tx=0x7f48b400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.694 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b4017070 con 0x7f48c009af80 2024-04-14T09:59:26.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b400c940 con 0x7f48c009af80 2024-04-14T09:59:26.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b400cd30 con 0x7f48c009af80 2024-04-14T09:59:26.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48c01e67d0 con 0x7f48c009af80 2024-04-14T09:59:26.695 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.693+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48c01e84a0 con 0x7f48c009af80 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.694+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48c0075760 con 0x7f48c009af80 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.694+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48b401a070 con 0x7f48c009af80 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.695+0000 7f48a77fe640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 0x7f48ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.695+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7f48b408bde0 con 0x7f48c009af80 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.695+0000 7f48bed9d640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 0x7f48ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:26.696 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.695+0000 7f48bed9d640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 0x7f48ac06ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48b0035000 tx=0x7f48b0030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:26.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.699+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f48b4059db0 con 0x7f48c009af80 2024-04-14T09:59:26.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:26.926+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f48c01e88a0 con 0x7f48c009af80 2024-04-14T09:59:27.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.591+0000 7f48a77fe640 1 -- 172.21.15.40:0/4133171840 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f48b40596b0 con 0x7f48c009af80 2024-04-14T09:59:27.593 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 msgr2=0x7f48ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 0x7f48ac06ede0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48b0035000 tx=0x7f48b0030000 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 msgr2=0x7f48c01e5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f48b400e8a0 tx=0x7f48b400ed60 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 shutdown_connections 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f48ac06c920 0x7f48ac06ede0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48c00cd9d0 0x7f48c00afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f48c009af80 0x7f48c01e5ed0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 --2- 172.21.15.40:0/4133171840 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48c0071020 0x7f48c01e06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.593+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 >> 172.21.15.40:0/4133171840 conn(0x7f48c00b3ad0 msgr2=0x7f48c01e56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:27.594 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.594+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 shutdown_connections 2024-04-14T09:59:27.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.594+0000 7f48c511e640 1 -- 172.21.15.40:0/4133171840 wait complete. 2024-04-14T09:59:27.607 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-14T09:59:27.717 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.718+0000 7fe3ae5a3640 1 Processor -- start 2024-04-14T09:59:27.718 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.718+0000 7fe3ae5a3640 1 -- start start 2024-04-14T09:59:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3ae5a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.719 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3ae5a3640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3a80b0e70 0x7fe3a80d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3ae5a3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8161f20 con 0x7fe3a80cfea0 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3ae5a3640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe3a80b4890 con 0x7fe3a80b0e70 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3ae5a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a80b3c80 con 0x7fe3a8161b40 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3a80b0e70 0x7fe3a80d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3acb40640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe3a80cfea0 0x7fe3a80d08e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37014/0 (socket says 172.21.15.40:37014) 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe3a80b0e70 0x7fe3a80d2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57904/0 (socket says 172.21.15.40:57904) 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3acb40640 1 -- 172.21.15.40:0/418804231 learned_addr learned my addr 172.21.15.40:0/418804231 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a7fff640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 -- 172.21.15.40:0/418804231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 msgr2=0x7fe3a80cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cf960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 -- 172.21.15.40:0/418804231 >> v1:172.21.15.40:6789/0 conn(0x7fe3a80cfea0 legacy=0x7fe3a80d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a77fe640 1 -- 172.21.15.40:0/418804231 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80b3f60 con 0x7fe3a80b0e70 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a6ffd640 1 -- 172.21.15.40:0/418804231 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008320124 0 0) 0x7fe3a8161f20 con 0x7fe3a80cfea0 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.719+0000 7fe3a7fff640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.720+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a80d2890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3980097a0 tx=0x7fe39802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc92d6fe46b3765 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.720+0000 7fe3a6ffd640 1 -- 172.21.15.40:0/418804231 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398035020 con 0x7fe3a80b0e70 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.720+0000 7fe3a6ffd640 1 -- 172.21.15.40:0/418804231 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe398031830 con 0x7fe3a80b0e70 2024-04-14T09:59:27.721 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.720+0000 7fe3a6ffd640 1 -- 172.21.15.40:0/418804231 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe398031c00 con 0x7fe3a80b0e70 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/418804231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 msgr2=0x7fe3a80d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a80d2890 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe3980097a0 tx=0x7fe39802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/418804231 shutdown_connections 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a80d2890 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/418804231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/418804231 >> 172.21.15.40:0/418804231 conn(0x7fe3a809d580 msgr2=0x7fe3a80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/418804231 shutdown_connections 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.721+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/418804231 wait complete. 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.722+0000 7fe3ae5a3640 1 Processor -- start 2024-04-14T09:59:27.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.722+0000 7fe3ae5a3640 1 -- start start 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 0x7fe3a80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80d2350 con 0x7fe3a80b0e70 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a80b4520 con 0x7fe3a80cfea0 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe3a80d2dd0 con 0x7fe3a8161b40 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57916/0 (socket says 172.21.15.40:57916) 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 -- 172.21.15.40:0/741622533 learned_addr learned my addr 172.21.15.40:0/741622533 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3acb40640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 -- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 msgr2=0x7fe3a80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 0x7fe3a80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 -- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 msgr2=0x7fe3a80cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 0x7fe3a80cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 -- 172.21.15.40:0/741622533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a81563d0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3acb40640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 0x7fe3a80cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a7fff640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00d800 tx=0x7fe39c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c004030 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe39c0041d0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a80cbef0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.723+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39c0096a0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.724+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a80cc4b0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.726 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.725+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3a80757d0 con 0x7fe3a80b0e70 2024-04-14T09:59:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.725+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe39c009840 con 0x7fe3a80b0e70 2024-04-14T09:59:27.727 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.725+0000 7fe3a4ff9640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 0x7fe39406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.725+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6821+0+0 (secure 0 0 0) 0x7fe39c08c310 con 0x7fe3a80b0e70 2024-04-14T09:59:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.726+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 0x7fe39406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:27.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.726+0000 7fe3a77fe640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 0x7fe39406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe398036000 tx=0x7fe398008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:27.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.730+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe39c011340 con 0x7fe3a80b0e70 2024-04-14T09:59:27.913 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:27.914+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe3a806d660 con 0x7fe3a80b0e70 2024-04-14T09:59:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.596+0000 7fe3a4ff9640 1 -- 172.21.15.40:0/741622533 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fe39c05a240 con 0x7fe3a80b0e70 2024-04-14T09:59:28.596 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' removed 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 msgr2=0x7fe39406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 0x7fe39406edb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe398036000 tx=0x7fe398008030 comp rx=0 tx=0).stop 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 msgr2=0x7fe3a814b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe39c00d800 tx=0x7fe39c00dcc0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 shutdown_connections 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe39406c8f0 0x7fe39406edb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe3a8161b40 0x7fe3a80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.600 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe3a80cfea0 0x7fe3a80cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 --2- 172.21.15.40:0/741622533 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe3a80b0e70 0x7fe3a814b490 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 >> 172.21.15.40:0/741622533 conn(0x7fe3a809d580 msgr2=0x7fe3a8160a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 shutdown_connections 2024-04-14T09:59:28.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.600+0000 7fe3ae5a3640 1 -- 172.21.15.40:0/741622533 wait complete. 2024-04-14T09:59:28.614 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-14T09:59:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.727+0000 7fe5e2a60640 1 Processor -- start 2024-04-14T09:59:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.727+0000 7fe5e2a60640 1 -- start start 2024-04-14T09:59:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e2a60640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe5dc09aa40 0x7fe5dc0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e2a60640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0cc6f0 con 0x7fe5dc06d850 2024-04-14T09:59:28.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e2a60640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5dc0d17e0 con 0x7fe5dc0d1350 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e2a60640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe5dc0cc990 con 0x7fe5dc09aa40 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e0ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe5dc06d850 0x7fe5dc0cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37022/0 (socket says 172.21.15.40:37022) 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/3075842915 learned_addr learned my addr 172.21.15.40:0/3075842915 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5dbfff640 1 --2- 172.21.15.40:0/3075842915 >> v2:172.21.15.136:3300/0 conn(0x7fe5dc09aa40 0x7fe5dc0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363584294 0 0) 0x7fe5dc0cc6f0 con 0x7fe5dc06d850 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe5c4003520 con 0x7fe5dc06d850 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2872258752 0 0) 0x7fe5c4003520 con 0x7fe5dc06d850 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 >> v2:172.21.15.136:3300/0 conn(0x7fe5dc09aa40 msgr2=0x7fe5dc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 --2- 172.21.15.40:0/3075842915 >> v2:172.21.15.136:3300/0 conn(0x7fe5dc09aa40 0x7fe5dc0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 >> v1:172.21.15.136:6789/0 conn(0x7fe5dc0d1350 legacy=0x7fe5dc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0ccc70 con 0x7fe5dc06d850 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7fe5d40019f0 con 0x7fe5dc06d850 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 >> v1:172.21.15.40:6789/0 conn(0x7fe5dc06d850 legacy=0x7fe5dc0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.728+0000 7fe5daffd640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c40039b0 0x7fe5c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5daffd640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 0x7fe5c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5daffd640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5c40051c0 0x7fe5c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc0cc990 con 0x7fe5c4004800 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe5c400c060 con 0x7fe5c40051c0 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe5c400c260 con 0x7fe5c40039b0 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 0x7fe5c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5dbfff640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c40039b0 0x7fe5c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5e0ffd640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5c40051c0 0x7fe5c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 -- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c40039b0 msgr2=0x7fe5c4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c40039b0 0x7fe5c4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 -- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5c40051c0 msgr2=0x7fe5c400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5c40051c0 0x7fe5c400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5db7fe640 1 -- 172.21.15.40:0/3075842915 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5c4003520 con 0x7fe5c4004800 2024-04-14T09:59:28.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.729+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/3075842915 reap_dead start 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5db7fe640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 0x7fe5c4004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc001750 tx=0x7fe5c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f544d4a322650b server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc001370 con 0x7fe5c4004800 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5cc0052d0 con 0x7fe5c4004800 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5daffd640 1 -- 172.21.15.40:0/3075842915 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc003830 con 0x7fe5c4004800 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 -- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 msgr2=0x7fe5c4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 0x7fe5c4004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc001750 tx=0x7fe5c4005830 comp rx=0 tx=0).stop 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 -- 172.21.15.40:0/3075842915 shutdown_connections 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/3075842915 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5c4004800 0x7fe5c4004c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 -- 172.21.15.40:0/3075842915 >> 172.21.15.40:0/3075842915 conn(0x7fe5dc0b3af0 msgr2=0x7fe5dc0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.730+0000 7fe5e2a60640 1 -- 172.21.15.40:0/3075842915 shutdown_connections 2024-04-14T09:59:28.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.731+0000 7fe5e2a60640 1 -- 172.21.15.40:0/3075842915 wait complete. 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.732+0000 7fe5e2a60640 1 Processor -- start 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.732+0000 7fe5e2a60640 1 -- start start 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c4004800 0x7fe5dc14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5dc0c76e0 0x7fe5dc0c7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc15e970 con 0x7fe5dc0c8080 2024-04-14T09:59:28.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe5dc15e7f0 con 0x7fe5dc0c76e0 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe5dc0d0370 con 0x7fe5c4004800 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57938/0 (socket says 172.21.15.40:57938) 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/641398729 learned_addr learned my addr 172.21.15.40:0/641398729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5dbfff640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c4004800 0x7fe5dc14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5db7fe640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5dc0c76e0 0x7fe5dc0c7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c4004800 msgr2=0x7fe5dc14d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c4004800 0x7fe5dc14d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5dc0c76e0 msgr2=0x7fe5dc0c7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5dc0c76e0 0x7fe5dc0c7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 -- 172.21.15.40:0/641398729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5dc0c8500 con 0x7fe5dc0c8080 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e0ffd640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cea30 tx=0x7fe5d4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:28.737 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d400ab00 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d4018070 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5dc0c6870 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40133f0 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.733+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5dc0c6e30 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.734+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5dc0757d0 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.735+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe5d4013590 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.735+0000 7fe5d8ff9640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 0x7fe5c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.735+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6383+0+0 (secure 0 0 0) 0x7fe5d408c1e0 con 0x7fe5dc0c8080 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.735+0000 7fe5dbfff640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 0x7fe5c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:28.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.736+0000 7fe5dbfff640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 0x7fe5c806ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009bc0 tx=0x7fe5d0009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:28.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.740+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe5d405a370 con 0x7fe5dc0c8080 2024-04-14T09:59:28.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:28.927+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe5dc09afc0 con 0x7fe5dc0c8080 2024-04-14T09:59:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.603+0000 7fe5d8ff9640 1 -- 172.21.15.40:0/641398729 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fe5d4059c70 con 0x7fe5dc0c8080 2024-04-14T09:59:29.603 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' removed 2024-04-14T09:59:29.605 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 msgr2=0x7fe5c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 0x7fe5c806ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe5d0009bc0 tx=0x7fe5d0009190 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 msgr2=0x7fe5dc1501a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0cea30 tx=0x7fe5d4007a40 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 shutdown_connections 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe5c806c920 0x7fe5c806ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe5dc0c8080 0x7fe5dc1501a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe5dc0c76e0 0x7fe5dc0c7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 --2- 172.21.15.40:0/641398729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe5c4004800 0x7fe5dc14d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 >> 172.21.15.40:0/641398729 conn(0x7fe5dc0b3af0 msgr2=0x7fe5dc15d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 shutdown_connections 2024-04-14T09:59:29.606 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.606+0000 7fe5e2a60640 1 -- 172.21.15.40:0/641398729 wait complete. 2024-04-14T09:59:29.619 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-14T09:59:29.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.732+0000 7f5f20f5e640 1 Processor -- start 2024-04-14T09:59:29.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.732+0000 7f5f20f5e640 1 -- start start 2024-04-14T09:59:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f20f5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c162950 0x7f5f1c15e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f20f5e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d0670 con 0x7f5f1c162570 2024-04-14T09:59:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f20f5e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f1c0d0950 con 0x7f5f1c15e690 2024-04-14T09:59:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f20f5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f5f1c0d0c30 con 0x7f5f1c162950 2024-04-14T09:59:29.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f19d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c162950 0x7f5f1c15e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f19d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f5f1c162950 0x7f5f1c15e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57940/0 (socket says 172.21.15.40:57940) 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f1a59c640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f5f1c162570 0x7f5f1c0cfbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37026/0 (socket says 172.21.15.40:37026) 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.733+0000 7f5f19d9b640 1 -- 172.21.15.40:0/1021880318 learned_addr learned my addr 172.21.15.40:0/1021880318 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.734+0000 7f5f19d9b640 1 -- 172.21.15.40:0/1021880318 >> v1:172.21.15.136:6789/0 conn(0x7f5f1c15e690 legacy=0x7f5f1c0c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.734+0000 7f5f19d9b640 1 -- 172.21.15.40:0/1021880318 >> v1:172.21.15.40:6789/0 conn(0x7f5f1c162570 legacy=0x7f5f1c0cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.734+0000 7f5f1959a640 1 -- 172.21.15.40:0/1021880318 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406835090 0 0) 0x7f5f1c0d0670 con 0x7f5f1c162570 2024-04-14T09:59:29.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.734+0000 7f5f19d9b640 1 -- 172.21.15.40:0/1021880318 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c0d0f10 con 0x7f5f1c162950 2024-04-14T09:59:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.734+0000 7f5f19d9b640 1 --2- 172.21.15.40:0/1021880318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c162950 0x7f5f1c15e150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e032865ca95fe458 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f1959a640 1 -- 172.21.15.40:0/1021880318 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0402f840 con 0x7f5f1c162950 2024-04-14T09:59:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f1959a640 1 -- 172.21.15.40:0/1021880318 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0402f9e0 con 0x7f5f1c162950 2024-04-14T09:59:29.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f1959a640 1 -- 172.21.15.40:0/1021880318 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0402fdb0 con 0x7f5f1c162950 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 -- 172.21.15.40:0/1021880318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c162950 msgr2=0x7f5f1c15e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/1021880318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c162950 0x7f5f1c15e150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009870 tx=0x7f5f0402ba20 comp rx=0 tx=0).stop 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 -- 172.21.15.40:0/1021880318 shutdown_connections 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/1021880318 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c162950 0x7f5f1c15e150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 -- 172.21.15.40:0/1021880318 >> 172.21.15.40:0/1021880318 conn(0x7f5f1c09d5a0 msgr2=0x7f5f1c0d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 -- 172.21.15.40:0/1021880318 shutdown_connections 2024-04-14T09:59:29.736 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.735+0000 7f5f20f5e640 1 -- 172.21.15.40:0/1021880318 wait complete. 2024-04-14T09:59:29.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.736+0000 7f5f20f5e640 1 Processor -- start 2024-04-14T09:59:29.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 -- start start 2024-04-14T09:59:29.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:29.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 0x7f5f1c0b6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f1c162950 0x7f5f1c0b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c0d02e0 con 0x7f5f1c15e690 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f1c15eb20 con 0x7f5f1c162950 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f20f5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5f1c162fe0 con 0x7f5f1c162570 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f1a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f1a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57948/0 (socket says 172.21.15.40:57948) 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f1a59c640 1 -- 172.21.15.40:0/3565546670 learned_addr learned my addr 172.21.15.40:0/3565546670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.737+0000 7f5f1ad9d640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f1c162950 0x7f5f1c0b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f19d9b640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 0x7f5f1c0b6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 -- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 msgr2=0x7f5f1c0b6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 0x7f5f1c0b6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 -- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f1c162950 msgr2=0x7f5f1c0b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f1c162950 0x7f5f1c0b73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:29.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 -- 172.21.15.40:0/3565546670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f1c0b7a20 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f19d9b640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 0x7f5f1c0b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f1a59c640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400c4d0 tx=0x7f5f1400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14018070 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f140074e0 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f1c0b7d00 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f14004a20 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.738+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f1c0b82c0 con 0x7f5f1c15e690 2024-04-14T09:59:29.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.739+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1c0757d0 con 0x7f5f1c15e690 2024-04-14T09:59:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.740+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f1401b070 con 0x7f5f1c15e690 2024-04-14T09:59:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.740+0000 7f5f12ffd640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.740+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f5f1408ae70 con 0x7f5f1c15e690 2024-04-14T09:59:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.740+0000 7f5f19d9b640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:29.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.741+0000 7f5f19d9b640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 0x7f5efc06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036000 tx=0x7f5f04008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:29.744 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.744+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f5f14058bc0 con 0x7f5f1c15e690 2024-04-14T09:59:29.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:29.929+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f1c0d1ac0 con 0x7f5f1c15e690 2024-04-14T09:59:30.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.612+0000 7f5f12ffd640 1 -- 172.21.15.40:0/3565546670 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f5f1405cec0 con 0x7f5f1c15e690 2024-04-14T09:59:30.612 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data_ec' removed 2024-04-14T09:59:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 msgr2=0x7f5efc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 0x7f5efc06edb0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f04036000 tx=0x7f5f04008030 comp rx=0 tx=0).stop 2024-04-14T09:59:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 msgr2=0x7f5f1c0b95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5f1400c4d0 tx=0x7f5f1400c990 comp rx=0 tx=0).stop 2024-04-14T09:59:30.614 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 shutdown_connections 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f5efc06c8f0 0x7f5efc06edb0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f1c162950 0x7f5f1c0b73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f1c162570 0x7f5f1c0b6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.614+0000 7f5f20f5e640 1 --2- 172.21.15.40:0/3565546670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f5f1c15e690 0x7f5f1c0b95c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.615+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 >> 172.21.15.40:0/3565546670 conn(0x7f5f1c09d5a0 msgr2=0x7f5f1c06dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.615+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 shutdown_connections 2024-04-14T09:59:30.615 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.615+0000 7f5f20f5e640 1 -- 172.21.15.40:0/3565546670 wait complete. 2024-04-14T09:59:30.630 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-14T09:59:30.630 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-14T09:59:30.631 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T09:59:30.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T09:59:30.631 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-14T09:59:30.631 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-14T09:59:30.631 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T09:59:30.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T09:59:30.631 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-14T09:59:30.631 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-14T09:59:30.632 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T09:59:30.632 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T09:59:30.632 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-14T09:59:30.632 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-14T09:59:30.632 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-14T09:59:30.632 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T09:59:30.644 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T09:59:30.644 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-14T09:59:30.644 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T09:59:30.644 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-14T09:59:30.645 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T09:59:30.645 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-14T09:59:30.646 INFO:tasks.ceph.mds.d:Stopped 2024-04-14T09:59:30.646 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-14T09:59:30.686 INFO:tasks.ceph.mds.a:Started 2024-04-14T09:59:30.686 DEBUG:teuthology.parallel:result is None 2024-04-14T09:59:30.687 INFO:tasks.ceph.mds.b:Started 2024-04-14T09:59:30.687 INFO:tasks.ceph.mds.c:Started 2024-04-14T09:59:30.687 DEBUG:teuthology.parallel:result is None 2024-04-14T09:59:30.687 DEBUG:teuthology.parallel:result is None 2024-04-14T09:59:30.688 INFO:tasks.ceph.mds.d:Started 2024-04-14T09:59:30.688 DEBUG:teuthology.parallel:result is None 2024-04-14T09:59:30.688 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-14T09:59:30.768 INFO:tasks.ceph.mds.c.smithi040.stdout:starting mds.c at 2024-04-14T09:59:30.769 INFO:tasks.ceph.mds.a.smithi040.stdout:starting mds.a at 2024-04-14T09:59:30.770 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-04-14T09:59:30.771 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-04-14T09:59:30.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.799+0000 7fb15d1bb640 1 Processor -- start 2024-04-14T09:59:30.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.799+0000 7fb15d1bb640 1 -- start start 2024-04-14T09:59:30.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15d1bb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb1580d0cc0 0x7fb1580d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:30.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15759e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb1580b1e60 0x7fb1580b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37028/0 (socket says 172.21.15.40:37028) 2024-04-14T09:59:30.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15759e640 1 -- 172.21.15.40:0/933999766 learned_addr learned my addr 172.21.15.40:0/933999766 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15659c640 1 --2- 172.21.15.40:0/933999766 >> v2:172.21.15.136:3300/0 conn(0x7fb1580d0cc0 0x7fb1580d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580b10e0 con 0x7fb1580b1e60 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1580b1380 con 0x7fb158161c80 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb1580d1660 con 0x7fb1580d0cc0 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564700262 0 0) 0x7fb1580b10e0 con 0x7fb1580b1e60 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb140003520 con 0x7fb1580b1e60 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4270425963 0 0) 0x7fb1580b1380 con 0x7fb158161c80 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.800+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1580b10e0 con 0x7fb158161c80 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.801+0000 7fb15659c640 1 -- 172.21.15.40:0/933999766 >> v1:172.21.15.136:6789/0 conn(0x7fb158161c80 legacy=0x7fb1580d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.801+0000 7fb15659c640 1 -- 172.21.15.40:0/933999766 >> v1:172.21.15.40:6789/0 conn(0x7fb1580b1e60 legacy=0x7fb1580b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.801+0000 7fb15659c640 1 -- 172.21.15.40:0/933999766 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580b1660 con 0x7fb1580d0cc0 2024-04-14T09:59:30.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.801+0000 7fb15659c640 1 --2- 172.21.15.40:0/933999766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580d0cc0 0x7fb1580d1120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1480097a0 tx=0x7fb14802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b605ff202f4c28cc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.801+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148035020 con 0x7fb1580d0cc0 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb148031830 con 0x7fb1580d0cc0 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb155d9b640 1 -- 172.21.15.40:0/933999766 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148031c00 con 0x7fb1580d0cc0 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580d0cc0 msgr2=0x7fb1580d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/933999766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580d0cc0 0x7fb1580d1120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb1480097a0 tx=0x7fb14802b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 shutdown_connections 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/933999766 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580d0cc0 0x7fb1580d1120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 >> 172.21.15.40:0/933999766 conn(0x7fb15809d5e0 msgr2=0x7fb1580d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 shutdown_connections 2024-04-14T09:59:30.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.802+0000 7fb15d1bb640 1 -- 172.21.15.40:0/933999766 wait complete. 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15d1bb640 1 Processor -- start 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15d1bb640 1 -- start start 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15d1bb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580b1e60 0x7fb1580ca730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15d1bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57982/0 (socket says 172.21.15.40:57982) 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15d1bb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb158161c80 0x7fb1580cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.804+0000 7fb15659c640 1 -- 172.21.15.40:0/1304177562 learned_addr learned my addr 172.21.15.40:0/1304177562 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb1580d0180 con 0x7fb1580d0cc0 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb1580d3340 con 0x7fb1580b1e60 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb1580d0300 con 0x7fb158161c80 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb156d9d640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580b1e60 0x7fb1580ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:30.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15759e640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb158161c80 0x7fb1580cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 -- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb158161c80 msgr2=0x7fb1580cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb158161c80 0x7fb1580cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 -- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580b1e60 msgr2=0x7fb1580ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580b1e60 0x7fb1580ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1580c9690 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15659c640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1480098c0 tx=0x7fb1480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148041070 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14803aa00 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1580c9970 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb148035040 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.805+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1580c9f30 con 0x7fb1580d0cc0 2024-04-14T09:59:30.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.806+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb158075760 con 0x7fb1580d0cc0 2024-04-14T09:59:30.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.807+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb14804c060 con 0x7fb1580d0cc0 2024-04-14T09:59:30.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.807+0000 7fb13f7fe640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 0x7fb14406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:30.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.807+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7fb1480ad290 con 0x7fb1580d0cc0 2024-04-14T09:59:30.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.807+0000 7fb156d9d640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 0x7fb14406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:30.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.808+0000 7fb156d9d640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 0x7fb14406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0011e0 tx=0x7fb14c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:30.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:30.812+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb14807b8c0 con 0x7fb1580d0cc0 2024-04-14T09:59:31.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.023+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fb1580d1a40 con 0x7fb1580d0cc0 2024-04-14T09:59:31.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.629+0000 7fb13f7fe640 1 -- 172.21.15.40:0/1304177562 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7fb14807b1c0 con 0x7fb1580d0cc0 2024-04-14T09:59:31.629 INFO:teuthology.orchestra.run.smithi040.stderr: removed all blocklist entries 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 msgr2=0x7fb14406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 0x7fb14406ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0011e0 tx=0x7fb14c009040 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 msgr2=0x7fb1580cb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb1480098c0 tx=0x7fb1480046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 shutdown_connections 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb14406c920 0x7fb14406ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb158161c80 0x7fb1580cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb1580d0cc0 0x7fb1580cb450 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 --2- 172.21.15.40:0/1304177562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb1580b1e60 0x7fb1580ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 >> 172.21.15.40:0/1304177562 conn(0x7fb15809d5e0 msgr2=0x7fb1580b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:31.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 shutdown_connections 2024-04-14T09:59:31.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.632+0000 7fb15d1bb640 1 -- 172.21.15.40:0/1304177562 wait complete. 2024-04-14T09:59:31.646 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-14T09:59:31.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.754+0000 7f2301bdc640 1 Processor -- start 2024-04-14T09:59:31.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.754+0000 7f2301bdc640 1 -- start start 2024-04-14T09:59:31.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f2301bdc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f22fc0b4680 0x7f22fc06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f2301bdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22fc09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f2301bdc640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22fc0d0210 con 0x7f22fc15e670 2024-04-14T09:59:31.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f2301bdc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f22fc06da20 con 0x7f22fc0b4680 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f2301bdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc0d0b00 con 0x7f22fc09aa40 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f22fc15e670 0x7f22fc0d0f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37044/0 (socket says 172.21.15.40:37044) 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fb7fe640 1 -- 172.21.15.40:0/968615599 learned_addr learned my addr 172.21.15.40:0/968615599 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22faffd640 1 --2- 172.21.15.40:0/968615599 >> v2:172.21.15.136:3300/0 conn(0x7f22fc0b4680 0x7f22fc06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fbfff640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22fc09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052408242 0 0) 0x7f22fc0d0210 con 0x7f22fc15e670 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e4003520 con 0x7f22fc15e670 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 956426640 0 0) 0x7f22e4003520 con 0x7f22fc15e670 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 msgr2=0x7f22fc09aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22fc09aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 >> v2:172.21.15.136:3300/0 conn(0x7f22fc0b4680 msgr2=0x7f22fc06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 --2- 172.21.15.40:0/968615599 >> v2:172.21.15.136:3300/0 conn(0x7f22fc0b4680 0x7f22fc06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc06d740 con 0x7f22fc15e670 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f22ec001670 con 0x7f22fc15e670 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 >> v1:172.21.15.40:6789/0 conn(0x7f22fc15e670 legacy=0x7f22fc0d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e4004d40 0x7f22e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc06da20 con 0x7f22e40039b0 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0d0b00 con 0x7f22e4004d40 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f22e400b9c0 con 0x7f22fc09aa40 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.755+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22faffd640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fbfff640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e4004d40 0x7f22e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fb7fe640 1 -- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 msgr2=0x7f22e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc09aa40 0x7f22e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fb7fe640 1 -- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e4004d40 msgr2=0x7f22e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e4004d40 0x7f22e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fb7fe640 1 -- 172.21.15.40:0/968615599 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4003520 con 0x7f22e40039b0 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.756+0000 7f22fbfff640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22e4004d40 0x7f22e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c210 tx=0x7f22e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50acb5dbb335e9a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec007d50 con 0x7f22e40039b0 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec030070 con 0x7f22e40039b0 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f22fa7fc640 1 -- 172.21.15.40:0/968615599 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec02cd60 con 0x7f22e40039b0 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 -- 172.21.15.40:0/968615599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 msgr2=0x7f22e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 --2- 172.21.15.40:0/968615599 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22e4003dd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c210 tx=0x7f22e4005830 comp rx=0 tx=0).stop 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f22fbfff640 1 -- 172.21.15.40:0/968615599 reap_dead start 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 -- 172.21.15.40:0/968615599 shutdown_connections 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 -- 172.21.15.40:0/968615599 >> 172.21.15.40:0/968615599 conn(0x7f22fc0b3b90 msgr2=0x7f22fc0b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 -- 172.21.15.40:0/968615599 shutdown_connections 2024-04-14T09:59:31.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.757+0000 7f2301bdc640 1 -- 172.21.15.40:0/968615599 wait complete. 2024-04-14T09:59:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.758+0000 7f2301bdc640 1 Processor -- start 2024-04-14T09:59:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 -- start start 2024-04-14T09:59:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc159110 0x7f22fc0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc14ce10 0x7f22fc14d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0d0790 con 0x7f22e40039b0 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22fc0d16a0 con 0x7f22fc159110 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f2301bdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f22fc09aed0 con 0x7f22fc14ce10 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f22fb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f22fb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57990/0 (socket says 172.21.15.40:57990) 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.759+0000 7f22fb7fe640 1 -- 172.21.15.40:0/2693630530 learned_addr learned my addr 172.21.15.40:0/2693630530 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fbfff640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc14ce10 0x7f22fc14d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22faffd640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc159110 0x7f22fc0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 -- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc14ce10 msgr2=0x7f22fc14d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc14ce10 0x7f22fc14d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 -- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc159110 msgr2=0x7f22fc0c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc159110 0x7f22fc0c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:31.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 -- 172.21.15.40:0/2693630530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22fc1595a0 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22fb7fe640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c330 tx=0x7f22fc0cffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec045070 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22ec004bf0 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22fc159880 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22ec007d50 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.760+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22fc159e40 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.761+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22fc0756f0 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.762+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22ec007070 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.762+0000 7f22e3fff640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 0x7f22e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.762+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f22ec0ac930 con 0x7f22e40039b0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.762+0000 7f22faffd640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 0x7f22e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:31.765 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.763+0000 7f22faffd640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 0x7f22e806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22fc15b1c0 tx=0x7f22f0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:31.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:31.767+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f22ec07b090 con 0x7f22e40039b0 2024-04-14T09:59:32.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.022+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f22fc0b8020 con 0x7f22e40039b0 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.022+0000 7f22e3fff640 1 -- 172.21.15.40:0/2693630530 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f22ec07a990 con 0x7f22e40039b0 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: "auth_dump": [ 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.a", 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCEqBtmG4UaMRAA3p4Yt+h2Mwk7CWqDPakyNQ==", 2024-04-14T09:59:32.022 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.b", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtm/7jSARAA7LonXwlDMBjCvq1OSsBWDw==", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-04-14T09:59:32.023 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.c", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCEqBtmRm1xOBAAiJy8UnSqT+7L/csCaN2oww==", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.024 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mds.d", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtmovgoCRAAgq/hsRdxcBZGlzh745caDQ==", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.0", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCIqBtmYrr/KRAAzC+iGtUJgILZQ2Vv5zBA4w==", 2024-04-14T09:59:32.025 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.1", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCLqBtmymptKBAA8Ymj8dHNqJx0HTwZn7J6FQ==", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.026 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.2", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCOqBtmg46WJhAAD5GeuPYuPqfIztINUlF5GA==", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.3", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCRqBtmdxiAJRAAalZLMxdpQLKt+nCmrPiVWA==", 2024-04-14T09:59:32.027 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.4", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCXqBtmFtI5MBAAak2wpVF91MQN0uykonYObQ==", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.028 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.5", 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCaqBtmc5XNLhAAbfvwSM8halt8/Ua/FzuWRg==", 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.6", 2024-04-14T09:59:32.029 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCdqBtmup5QLRAA0QaN7UZ31UKcMYu3cWhb1Q==", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "osd.7", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCgqBtmCW7MKxAA8o9X55ng2grI8aSt73iBbA==", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow profile osd", 2024-04-14T09:59:32.030 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile osd", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.0", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtmNaVvDRAArav1w+NRz/ut7W3ZfHpvpg==", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.031 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.1", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtm7eOcFhAAEfqWNmM58FG8qedsC44dIw==", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.2", 2024-04-14T09:59:32.032 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtm5AMzExAAgUJJjtck5x61/XBB2Kxwbg==", 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.033 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.3", 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCFqBtmJ950HBAA2/7etU17Tc67TV57W/4VAg==", 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow", 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow r", 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow rw", 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow rwx" 2024-04-14T09:59:32.034 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.admin", 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCEqBtmnJSfFBAAdSZmQmDJUU5L2LFw3x7ASQ==", 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "mgr": "allow *", 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow *", 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.035 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mds", 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtmkVNyJBAAI6B4UVrHPpC3vErt8ZaHWQ==", 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mds" 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-mgr", 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtmClxyJBAAi0dYYLG4cbq+Ox5s9v42JA==", 2024-04-14T09:59:32.036 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-osd", 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtmt2JyJBAA/7VS+oTxLlZF0cVFBr5xDA==", 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-osd" 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.037 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd", 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtmFmlyJBAAgUSPRqEFIZ8cK1gdTmm1vw==", 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtmGXByJBAAakRZVVnoOkYvJmW+Hvln7w==", 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.038 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "client.bootstrap-rgw", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCmqBtm73ZyJBAA4L9F5XMYNkmRh0INkWhePg==", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.x", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCEqBtmqqmyLRAAkN+LTSBYsEQOJB/vSQGEYg==", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: }, 2024-04-14T09:59:32.039 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "entity": "mgr.y", 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "key": "AQCEqBtmcMiyKRAATa2ZEfhGTyRWffOi9nuEBg==", 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "caps": { 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "mds": "allow *", 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "mon": "allow profile mgr", 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: "osd": "allow *" 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout: ] 2024-04-14T09:59:32.040 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 msgr2=0x7f22e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 0x7f22e806edb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f22fc15b1c0 tx=0x7f22f0008040 comp rx=0 tx=0).stop 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 msgr2=0x7f22fc15a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c330 tx=0x7f22fc0cffc0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 shutdown_connections 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f22e806c8f0 0x7f22e806edb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22fc14ce10 0x7f22fc14d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f22fc159110 0x7f22fc0c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 --2- 172.21.15.40:0/2693630530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f22e40039b0 0x7f22fc15a640 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.024+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 >> 172.21.15.40:0/2693630530 conn(0x7f22fc0b3b90 msgr2=0x7f22fc161090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.025+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 shutdown_connections 2024-04-14T09:59:32.043 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.025+0000 7f2301bdc640 1 -- 172.21.15.40:0/2693630530 wait complete. 2024-04-14T09:59:32.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-14T09:59:32.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.146+0000 7fc6fe688640 1 Processor -- start 2024-04-14T09:59:32.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.146+0000 7fc6fe688640 1 -- start start 2024-04-14T09:59:32.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fe688640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fe688640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6f80d1440 0x7fc6f80cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fe688640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f806cc40 con 0x7fc6f809af80 2024-04-14T09:59:32.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fe688640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc6f809b3c0 con 0x7fc6f80d1440 2024-04-14T09:59:32.147 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fe688640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f806c960 con 0x7fc6f8071020 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6f80d1440 0x7fc6f80cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc6f80d1440 0x7fc6f80cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57992/0 (socket says 172.21.15.40:57992) 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 -- 172.21.15.40:0/3061929819 learned_addr learned my addr 172.21.15.40:0/3061929819 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6f7fff640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 -- 172.21.15.40:0/3061929819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 msgr2=0x7fc6f809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 -- 172.21.15.40:0/3061929819 >> v1:172.21.15.136:6789/0 conn(0x7fc6f809af80 legacy=0x7fc6f80cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:32.148 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.147+0000 7fc6fcc25640 1 -- 172.21.15.40:0/3061929819 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80cc6d0 con 0x7fc6f80d1440 2024-04-14T09:59:32.149 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.148+0000 7fc6fcc25640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f80cdba0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009e50 tx=0x7fc6f002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd231dbe446235d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.148+0000 7fc6f6ffd640 1 -- 172.21.15.40:0/3061929819 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f002cb00 con 0x7fc6f80d1440 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.148+0000 7fc6f6ffd640 1 -- 172.21.15.40:0/3061929819 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f002cca0 con 0x7fc6f80d1440 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.148+0000 7fc6f6ffd640 1 -- 172.21.15.40:0/3061929819 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0034610 con 0x7fc6f80d1440 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 -- 172.21.15.40:0/3061929819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 msgr2=0x7fc6f80cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f80cdba0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0009e50 tx=0x7fc6f002bf60 comp rx=0 tx=0).stop 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 -- 172.21.15.40:0/3061929819 shutdown_connections 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f80cdba0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 --2- 172.21.15.40:0/3061929819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 -- 172.21.15.40:0/3061929819 >> 172.21.15.40:0/3061929819 conn(0x7fc6f80b3ad0 msgr2=0x7fc6f80b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 -- 172.21.15.40:0/3061929819 shutdown_connections 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.149+0000 7fc6fe688640 1 -- 172.21.15.40:0/3061929819 wait complete. 2024-04-14T09:59:32.150 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.150+0000 7fc6fe688640 1 Processor -- start 2024-04-14T09:59:32.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.150+0000 7fc6fe688640 1 -- start start 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 0x7fc6f80cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80ccf70 con 0x7fc6f80d1440 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f80ccc90 con 0x7fc6f809af80 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fe688640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f806db50 con 0x7fc6f8071020 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:57994/0 (socket says 172.21.15.40:57994) 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 -- 172.21.15.40:0/1960360797 learned_addr learned my addr 172.21.15.40:0/1960360797 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6f7fff640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6f77fe640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 0x7fc6f80cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.153 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 -- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 msgr2=0x7fc6f814cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f814cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 -- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 msgr2=0x7fc6f80cb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 0x7fc6f80cb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6fcc25640 1 -- 172.21.15.40:0/1960360797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80ca2a0 con 0x7fc6f80d1440 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.151+0000 7fc6f77fe640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 0x7fc6f80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6fcc25640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0036040 tx=0x7fc6f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0044020 con 0x7fc6f80d1440 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f002ce50 con 0x7fc6f80d1440 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f80ca580 con 0x7fc6f80d1440 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f0009510 con 0x7fc6f80d1440 2024-04-14T09:59:32.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.152+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f80cab40 con 0x7fc6f80d1440 2024-04-14T09:59:32.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.153+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6f8075760 con 0x7fc6f80d1440 2024-04-14T09:59:32.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.153+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc6f0047020 con 0x7fc6f80d1440 2024-04-14T09:59:32.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.154+0000 7fc6f4ff9640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.154+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fc6f00ae250 con 0x7fc6f80d1440 2024-04-14T09:59:32.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.154+0000 7fc6f7fff640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.154+0000 7fc6f7fff640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 0x7fc6d806edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006fd0 tx=0x7fc6e8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.158+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc6f004e030 con 0x7fc6f80d1440 2024-04-14T09:59:32.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.412+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fc6f809b750 con 0x7fc6f80d1440 2024-04-14T09:59:32.414 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.414+0000 7fc6f4ff9640 1 -- 172.21.15.40:0/1960360797 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7fc6f007c840 con 0x7fc6f80d1440 2024-04-14T09:59:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.416+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 msgr2=0x7fc6d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.416 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.416+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 0x7fc6d806edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006fd0 tx=0x7fc6e8008040 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.416+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 msgr2=0x7fc6f8161750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.416+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc6f0036040 tx=0x7fc6f0004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 shutdown_connections 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc6d806c8f0 0x7fc6d806edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc6f80d1440 0x7fc6f8161750 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6f809af80 0x7fc6f80cb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 --2- 172.21.15.40:0/1960360797 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6f8071020 0x7fc6f814cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 >> 172.21.15.40:0/1960360797 conn(0x7fc6f80b3ad0 msgr2=0x7fc6f80b1b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 shutdown_connections 2024-04-14T09:59:32.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.417+0000 7fc6fe688640 1 -- 172.21.15.40:0/1960360797 wait complete. 2024-04-14T09:59:32.427 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-14T09:59:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.530+0000 7fb9d5f7b640 1 Processor -- start 2024-04-14T09:59:32.530 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.530+0000 7fb9d5f7b640 1 -- start start 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9d5f7b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb9d015c720 0x7fb9d00b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9d5f7b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 0x7fb9d00cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9d5f7b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9d00ce110 con 0x7fb9d015c340 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9d5f7b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb9d00d0710 con 0x7fb9d015c720 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9d5f7b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d00cd030 con 0x7fb9d006f630 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 0x7fb9d00cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9ceffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb9d015c720 0x7fb9d00b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9cf7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb9d015c340 0x7fb9d00cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:54574/0 (socket says 172.21.15.40:54574) 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.531+0000 7fb9cf7fe640 1 -- 172.21.15.40:0/1603491083 learned_addr learned my addr 172.21.15.40:0/1603491083 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ce7fc640 1 -- 172.21.15.40:0/1603491083 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 73255084 0 0) 0x7fb9c0001110 con 0x7fb9d015c340 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ce7fc640 1 -- 172.21.15.40:0/1603491083 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9b8003520 con 0x7fb9d015c340 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ceffd640 1 -- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 msgr2=0x7fb9d00cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ceffd640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 0x7fb9d00cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ceffd640 1 -- 172.21.15.40:0/1603491083 >> v1:172.21.15.136:6789/0 conn(0x7fb9d015c340 legacy=0x7fb9d00cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9ceffd640 1 -- 172.21.15.40:0/1603491083 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d00d0960 con 0x7fb9d015c720 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.532+0000 7fb9cffff640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 0x7fb9d00cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9ceffd640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d015c720 0x7fb9d00b4740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097a0 tx=0x7fb9c402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db77649208fd39cf server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9ce7fc640 1 -- 172.21.15.40:0/1603491083 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4035020 con 0x7fb9d015c720 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9ce7fc640 1 -- 172.21.15.40:0/1603491083 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c4031830 con 0x7fb9d015c720 2024-04-14T09:59:32.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9ce7fc640 1 -- 172.21.15.40:0/1603491083 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4031be0 con 0x7fb9d015c720 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d015c720 msgr2=0x7fb9d00b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d015c720 0x7fb9d00b4740 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40097a0 tx=0x7fb9c402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/1603491083 shutdown_connections 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d006f630 0x7fb9d00cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/1603491083 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d015c720 0x7fb9d00b4740 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/1603491083 >> 172.21.15.40:0/1603491083 conn(0x7fb9d00b3c20 msgr2=0x7fb9d00b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/1603491083 shutdown_connections 2024-04-14T09:59:32.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.533+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/1603491083 wait complete. 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 Processor -- start 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 -- start start 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d006f630 0x7fb9d00ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d015c340 0x7fb9d015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d00d0f20 con 0x7fb9d015c720 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d006fae0 con 0x7fb9d006f630 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.535+0000 7fb9d5f7b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d00ccc20 con 0x7fb9d015c340 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58008/0 (socket says 172.21.15.40:58008) 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 -- 172.21.15.40:0/204911225 learned_addr learned my addr 172.21.15.40:0/204911225 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9ceffd640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d015c340 0x7fb9d015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cf7fe640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d006f630 0x7fb9d00ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 -- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d015c340 msgr2=0x7fb9d015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d015c340 0x7fb9d015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 -- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d006f630 msgr2=0x7fb9d00ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d006f630 0x7fb9d00ca850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 -- 172.21.15.40:0/204911225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d00b6ea0 con 0x7fb9d015c720 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9cffff640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009e60 tx=0x7fb9c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8018030 con 0x7fb9d015c720 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9c800cdf0 con 0x7fb9d015c720 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d00b7180 con 0x7fb9d015c720 2024-04-14T09:59:32.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c8003bb0 con 0x7fb9d015c720 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.536+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d00b47c0 con 0x7fb9d015c720 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.537+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d0075760 con 0x7fb9d015c720 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.538+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9c801b070 con 0x7fb9d015c720 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.538+0000 7fb9b7fff640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 0x7fb9bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.538+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fb9c808c340 con 0x7fb9d015c720 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.538+0000 7fb9cf7fe640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 0x7fb9bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.539+0000 7fb9cf7fe640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 0x7fb9bc06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0005880 tx=0x7fb9c0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.542+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb9c8010040 con 0x7fb9d015c720 2024-04-14T09:59:32.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.800+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fb9d00b80b0 con 0x7fb9d015c720 2024-04-14T09:59:32.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.802+0000 7fb9b7fff640 1 -- 172.21.15.40:0/204911225 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7fb9c805a930 con 0x7fb9d015c720 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 msgr2=0x7fb9bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 0x7fb9bc06edb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0005880 tx=0x7fb9c0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 msgr2=0x7fb9d00ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb9c8009e60 tx=0x7fb9c800c490 comp rx=0 tx=0).stop 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 shutdown_connections 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb9bc06c8f0 0x7fb9bc06edb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb9d015c720 0x7fb9d00ceb20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9d015c340 0x7fb9d015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 --2- 172.21.15.40:0/204911225 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9d006f630 0x7fb9d00ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 >> 172.21.15.40:0/204911225 conn(0x7fb9d00b3c20 msgr2=0x7fb9d0070eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 shutdown_connections 2024-04-14T09:59:32.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.804+0000 7fb9d5f7b640 1 -- 172.21.15.40:0/204911225 wait complete. 2024-04-14T09:59:32.814 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-14T09:59:32.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.917+0000 7efdb4e36640 1 Processor -- start 2024-04-14T09:59:32.917 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.917+0000 7efdb4e36640 1 -- start start 2024-04-14T09:59:32.918 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efdb0161c80 0x7efdb00d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdb00d2e50 0x7efdb00d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb00d1200 0x7efdb00cef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7efdb00b10e0 con 0x7efdb00d2e50 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efdb00b1380 con 0x7efdb0161c80 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.918+0000 7efdb4e36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efdb00b1660 con 0x7efdb00d1200 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdb00d2e50 0x7efdb00d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7efdb00d2e50 0x7efdb00d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58018/0 (socket says 172.21.15.40:58018) 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 -- 172.21.15.40:0/2420069531 learned_addr learned my addr 172.21.15.40:0/2420069531 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdae59c640 1 --2- 172.21.15.40:0/2420069531 >> v2:172.21.15.136:3300/0 conn(0x7efdb0161c80 0x7efdb00d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdaed9d640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb00d1200 0x7efdb00cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 -- 172.21.15.40:0/2420069531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb00d1200 msgr2=0x7efdb00cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb00d1200 0x7efdb00cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 -- 172.21.15.40:0/2420069531 >> v2:172.21.15.136:3300/0 conn(0x7efdb0161c80 msgr2=0x7efdb00d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:32.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2420069531 >> v2:172.21.15.136:3300/0 conn(0x7efdb0161c80 0x7efdb00d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.919+0000 7efdadd9b640 1 -- 172.21.15.40:0/2420069531 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb00d3340 con 0x7efdb00d2e50 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb00d0cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efdb008ea10 tx=0x7efd9802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d1624375cf368e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdad59a640 1 -- 172.21.15.40:0/2420069531 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd9802e070 con 0x7efdb00d2e50 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdad59a640 1 -- 172.21.15.40:0/2420069531 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98037070 con 0x7efdb00d2e50 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdad59a640 1 -- 172.21.15.40:0/2420069531 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98031a00 con 0x7efdb00d2e50 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdb4e36640 1 -- 172.21.15.40:0/2420069531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 msgr2=0x7efdb00d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.920+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb00d0cc0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efdb008ea10 tx=0x7efd9802b880 comp rx=0 tx=0).stop 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 -- 172.21.15.40:0/2420069531 shutdown_connections 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb00d1200 0x7efdb00cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.921 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2420069531 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb00d0cc0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2420069531 >> v2:172.21.15.136:3300/0 conn(0x7efdb0161c80 0x7efdb00d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 -- 172.21.15.40:0/2420069531 >> 172.21.15.40:0/2420069531 conn(0x7efdb009d5e0 msgr2=0x7efdb00d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 -- 172.21.15.40:0/2420069531 shutdown_connections 2024-04-14T09:59:32.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.921+0000 7efdb4e36640 1 -- 172.21.15.40:0/2420069531 wait complete. 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.922+0000 7efdb4e36640 1 Processor -- start 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.922+0000 7efdb4e36640 1 -- start start 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efdb00d1200 0x7efdb0154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 0x7efdb00c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00cf460 con 0x7efdb00d2e50 2024-04-14T09:59:32.925 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efdb00d0390 con 0x7efdb00d1200 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efdb00cf5e0 con 0x7efdb0161c80 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58030/0 (socket says 172.21.15.40:58030) 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 -- 172.21.15.40:0/2565013114 learned_addr learned my addr 172.21.15.40:0/2565013114 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdae59c640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efdb00d1200 0x7efdb0154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdaed9d640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 0x7efdb00c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 -- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 msgr2=0x7efdb00c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 0x7efdb00c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 -- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efdb00d1200 msgr2=0x7efdb0154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efdb00d1200 0x7efdb0154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 -- 172.21.15.40:0/2565013114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb00c9310 con 0x7efdb00d2e50 2024-04-14T09:59:32.926 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdaed9d640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 0x7efdb00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdadd9b640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd98000c00 tx=0x7efd980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98032670 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd98032810 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb00cb4f0 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.923+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd98032c00 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.924+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb00cbab0 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.924+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdb0075760 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.925+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd9804c060 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.925+0000 7efda6ffd640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 0x7efd9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.925+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7efd980ad460 con 0x7efdb00d2e50 2024-04-14T09:59:32.927 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.925+0000 7efdae59c640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 0x7efd9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:32.928 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.926+0000 7efdae59c640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 0x7efd9006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efda8006fd0 tx=0x7efda8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:32.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:32.930+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efd98040070 con 0x7efdb00d2e50 2024-04-14T09:59:33.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.192+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7efdb00d1b10 con 0x7efdb00d2e50 2024-04-14T09:59:33.193 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.194+0000 7efda6ffd640 1 -- 172.21.15.40:0/2565013114 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7efd9807bc00 con 0x7efdb00d2e50 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 msgr2=0x7efd9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 0x7efd9006edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efda8006fd0 tx=0x7efda8008040 comp rx=0 tx=0).stop 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 msgr2=0x7efdb01f3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7efd98000c00 tx=0x7efd980046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 shutdown_connections 2024-04-14T09:59:33.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efd9006c8f0 0x7efd9006edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efdb0161c80 0x7efdb00c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efdb00d2e50 0x7efdb01f3690 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 --2- 172.21.15.40:0/2565013114 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efdb00d1200 0x7efdb0154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 >> 172.21.15.40:0/2565013114 conn(0x7efdb009d5e0 msgr2=0x7efdb00b9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 shutdown_connections 2024-04-14T09:59:33.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.196+0000 7efdb4e36640 1 -- 172.21.15.40:0/2565013114 wait complete. 2024-04-14T09:59:33.207 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-14T09:59:33.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 Processor -- start 2024-04-14T09:59:33.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 -- start start 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f135c0b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c0b10e0 con 0x7f135c0d0cc0 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f135c0b1380 con 0x7f135c161c80 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.311+0000 7f1362636640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f135c0b1660 con 0x7f135c0d1120 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135b7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f135c0d0cc0 0x7f135c0b1e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37048/0 (socket says 172.21.15.40:37048) 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135b7fe640 1 -- 172.21.15.40:0/2038219736 learned_addr learned my addr 172.21.15.40:0/2038219736 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f1360bd3640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f135c0b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346178795 0 0) 0x7f135c0b10e0 con 0x7f135c0d0cc0 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1344003520 con 0x7f135c0d0cc0 2024-04-14T09:59:33.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3607387191 0 0) 0x7f1344003520 con 0x7f135c0d0cc0 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 msgr2=0x7f135c0b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f135c0b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 >> v1:172.21.15.136:6789/0 conn(0x7f135c161c80 legacy=0x7f135c0d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c0d15b0 con 0x7f135c0d0cc0 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f1350001670 con 0x7f135c0d0cc0 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 >> v1:172.21.15.40:6789/0 conn(0x7f135c0d0cc0 legacy=0x7f135c0b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f1344003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f1344004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1344004d40 0x7f13440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0b1660 con 0x7f13440039e0 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f134400bb20 con 0x7f1344004d40 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f134400bd20 con 0x7f135c0d1120 2024-04-14T09:59:33.314 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135bfff640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f1344003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f135b7fe640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f1344004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.312+0000 7f1360bd3640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1344004d40 0x7f13440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 -- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 msgr2=0x7f1344004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c0d1120 0x7f1344004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 -- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1344004d40 msgr2=0x7f13440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1344004d40 0x7f13440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 -- 172.21.15.40:0/2038219736 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1344003520 con 0x7f13440039e0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f1360bd3640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1344004d40 0x7f13440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135bfff640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f1344003e00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f134c001750 tx=0x7f1344005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89271ffbaaaf496d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c001370 con 0x7f13440039e0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134c0052d0 con 0x7f13440039e0 2024-04-14T09:59:33.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.313+0000 7f135affd640 1 -- 172.21.15.40:0/2038219736 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c003830 con 0x7f13440039e0 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 -- 172.21.15.40:0/2038219736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 msgr2=0x7f1344003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 --2- 172.21.15.40:0/2038219736 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f1344003e00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f134c001750 tx=0x7f1344005830 comp rx=0 tx=0).stop 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1360bd3640 1 -- 172.21.15.40:0/2038219736 reap_dead start 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 -- 172.21.15.40:0/2038219736 shutdown_connections 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 -- 172.21.15.40:0/2038219736 >> 172.21.15.40:0/2038219736 conn(0x7f135c09d5e0 msgr2=0x7f135c0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 -- 172.21.15.40:0/2038219736 shutdown_connections 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.314+0000 7f1362636640 1 -- 172.21.15.40:0/2038219736 wait complete. 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.315+0000 7f1362636640 1 Processor -- start 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.315+0000 7f1362636640 1 -- start start 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.319 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c15f7f0 0x7f135c0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f135c15fc70 0x7f135c0c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0d0180 con 0x7f13440039e0 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f135c0d3340 con 0x7f135c15fc70 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1362636640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f135c0d0300 con 0x7f135c15f7f0 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58058/0 (socket says 172.21.15.40:58058) 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 -- 172.21.15.40:0/1746644926 learned_addr learned my addr 172.21.15.40:0/1746644926 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135b7fe640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c15f7f0 0x7f135c0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f1360bd3640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f135c15fc70 0x7f135c0c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 -- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c15f7f0 msgr2=0x7f135c0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c15f7f0 0x7f135c0c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 -- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f135c15fc70 msgr2=0x7f135c0c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f135c15fc70 0x7f135c0c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.316+0000 7f135bfff640 1 -- 172.21.15.40:0/1746644926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135c157690 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f135bfff640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f134c008fd0 tx=0x7f134c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c041070 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f134c005480 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134c001370 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135c157970 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.317+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135c157f30 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.318+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f135c075760 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.318+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f134c044070 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.319+0000 7f1358ff9640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 0x7f134806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.319+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f134c0ad5a0 con 0x7f13440039e0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.319+0000 7f135b7fe640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 0x7f134806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.319+0000 7f135b7fe640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 0x7f134806ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f135c0ccfa0 tx=0x7f1350009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.323+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f134c07bb90 con 0x7f13440039e0 2024-04-14T09:59:33.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.578+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f135c0b6cd0 con 0x7f13440039e0 2024-04-14T09:59:33.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.580+0000 7f1358ff9640 1 -- 172.21.15.40:0/1746644926 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f134c07b490 con 0x7f13440039e0 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 msgr2=0x7f134806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 0x7f134806ede0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f135c0ccfa0 tx=0x7f1350009040 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 msgr2=0x7f135c15be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f134c008fd0 tx=0x7f134c001120 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 shutdown_connections 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f134806c920 0x7f134806ede0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f135c15fc70 0x7f135c0c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f135c15f7f0 0x7f135c0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 --2- 172.21.15.40:0/1746644926 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f13440039e0 0x7f135c15be00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 >> 172.21.15.40:0/1746644926 conn(0x7f135c09d5e0 msgr2=0x7f135c0b9bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:33.583 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 shutdown_connections 2024-04-14T09:59:33.584 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.583+0000 7f1362636640 1 -- 172.21.15.40:0/1746644926 wait complete. 2024-04-14T09:59:33.593 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-14T09:59:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.697+0000 7f2cc60d1640 1 Processor -- start 2024-04-14T09:59:33.697 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 -- start start 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc0071020 0x7f2cc009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2cc009af80 0x7f2cc00cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cc00cd9d0 0x7f2cc00cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc009b3c0 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2cc006cc40 con 0x7f2cc009af80 2024-04-14T09:59:33.699 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cc60d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc006c960 con 0x7f2cc0071020 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cbffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cc00cd9d0 0x7f2cc00cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cbffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f2cc00cd9d0 0x7f2cc00cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58066/0 (socket says 172.21.15.40:58066) 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.698+0000 7f2cbffff640 1 -- 172.21.15.40:0/2894206229 learned_addr learned my addr 172.21.15.40:0/2894206229 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbf7fe640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc0071020 0x7f2cc009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbeffd640 1 --2- 172.21.15.40:0/2894206229 >> v2:172.21.15.136:3300/0 conn(0x7f2cc009af80 0x7f2cc00cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbffff640 1 -- 172.21.15.40:0/2894206229 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc0071020 msgr2=0x7f2cc009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbffff640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc0071020 0x7f2cc009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbffff640 1 -- 172.21.15.40:0/2894206229 >> v2:172.21.15.136:3300/0 conn(0x7f2cc009af80 msgr2=0x7f2cc00cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbffff640 1 --2- 172.21.15.40:0/2894206229 >> v2:172.21.15.136:3300/0 conn(0x7f2cc009af80 0x7f2cc00cd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.699+0000 7f2cbffff640 1 -- 172.21.15.40:0/2894206229 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc00cc6d0 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cbffff640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc00cd9d0 0x7f2cc00cde60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0074c20 tx=0x7f2cb802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348ceedf4efa244f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/2894206229 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb802cb00 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.700 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/2894206229 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb802cca0 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.701 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cbe7fc640 1 -- 172.21.15.40:0/2894206229 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb8034610 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 -- 172.21.15.40:0/2894206229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc00cd9d0 msgr2=0x7f2cc00cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc00cd9d0 0x7f2cc00cde60 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0074c20 tx=0x7f2cb802bf60 comp rx=0 tx=0).stop 2024-04-14T09:59:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 -- 172.21.15.40:0/2894206229 shutdown_connections 2024-04-14T09:59:33.703 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc00cd9d0 0x7f2cc00cde60 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/2894206229 >> v2:172.21.15.136:3300/0 conn(0x7f2cc009af80 0x7f2cc00cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/2894206229 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc0071020 0x7f2cc009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 -- 172.21.15.40:0/2894206229 >> 172.21.15.40:0/2894206229 conn(0x7f2cc00b3ad0 msgr2=0x7f2cc00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 -- 172.21.15.40:0/2894206229 shutdown_connections 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.700+0000 7f2cc60d1640 1 -- 172.21.15.40:0/2894206229 wait complete. 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.701+0000 7f2cc60d1640 1 Processor -- start 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 -- start start 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc009af80 0x7f2cc00c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 0x7f2cc00c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00ccf70 con 0x7f2cc0071020 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc00ccc90 con 0x7f2cc009af80 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cc60d1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2cc006db50 con 0x7f2cc00cd9d0 2024-04-14T09:59:33.704 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cbf7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58074/0 (socket says 172.21.15.40:58074) 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.702+0000 7f2cbf7fe640 1 -- 172.21.15.40:0/3497789566 learned_addr learned my addr 172.21.15.40:0/3497789566 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbeffd640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc009af80 0x7f2cc00c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbffff640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 0x7f2cc00c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 -- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 msgr2=0x7f2cc00c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 0x7f2cc00c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 -- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc009af80 msgr2=0x7f2cc00c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc009af80 0x7f2cc00c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 -- 172.21.15.40:0/3497789566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc015f8e0 con 0x7f2cc0071020 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbffff640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 0x7f2cc00c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cbf7fe640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000d800 tx=0x7f2cb000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0018030 con 0x7f2cc0071020 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cb00096a0 con 0x7f2cc0071020 2024-04-14T09:59:33.705 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc015fbc0 con 0x7f2cc0071020 2024-04-14T09:59:33.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0009870 con 0x7f2cc0071020 2024-04-14T09:59:33.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.703+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc0160180 con 0x7f2cc0071020 2024-04-14T09:59:33.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.704+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc0075760 con 0x7f2cc0071020 2024-04-14T09:59:33.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.704+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cb001b070 con 0x7f2cc0071020 2024-04-14T09:59:33.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.705+0000 7f2ca7fff640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 0x7f2cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:33.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.705+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f2cb008bb90 con 0x7f2cc0071020 2024-04-14T09:59:33.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.705+0000 7f2cbeffd640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 0x7f2cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:33.707 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.705+0000 7f2cbeffd640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 0x7f2cac06edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0160cc0 tx=0x7f2cb4008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:33.708 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.709+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2cb005a210 con 0x7f2cc0071020 2024-04-14T09:59:33.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.964+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f2cc009aa40 con 0x7f2cc0071020 2024-04-14T09:59:33.965 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.966+0000 7f2ca7fff640 1 -- 172.21.15.40:0/3497789566 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7f2cb0059b10 con 0x7f2cc0071020 2024-04-14T09:59:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.967+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 msgr2=0x7f2cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.967+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 0x7f2cac06edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2cc0160cc0 tx=0x7f2cb4008040 comp rx=0 tx=0).stop 2024-04-14T09:59:33.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.967+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 msgr2=0x7f2cc015b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.967+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000d800 tx=0x7f2cb000dcc0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 shutdown_connections 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2cac06c8f0 0x7f2cac06edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cc00cd9d0 0x7f2cc00c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cc009af80 0x7f2cc00c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 --2- 172.21.15.40:0/3497789566 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2cc0071020 0x7f2cc015b370 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 >> 172.21.15.40:0/3497789566 conn(0x7f2cc00b3ad0 msgr2=0x7f2cc015e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 shutdown_connections 2024-04-14T09:59:33.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:33.968+0000 7f2cc60d1640 1 -- 172.21.15.40:0/3497789566 wait complete. 2024-04-14T09:59:33.978 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-14T09:59:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.080+0000 7f407882d640 1 Processor -- start 2024-04-14T09:59:34.080 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.080+0000 7f407882d640 1 -- start start 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407882d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4074161c80 0x7f40740d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407882d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f40740d13d0 0x7f40740b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407882d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40740b10e0 con 0x7f40740d2e50 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407882d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f40740b1380 con 0x7f4074161c80 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407882d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f40740b1660 con 0x7f40740d13d0 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f407259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f4074161c80 0x7f40740d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f4071d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f40740d2e50 0x7f40740d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37062/0 (socket says 172.21.15.40:37062) 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.081+0000 7f4071d9b640 1 -- 172.21.15.40:0/1802900782 learned_addr learned my addr 172.21.15.40:0/1802900782 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:34.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407259c640 1 -- 172.21.15.40:0/1802900782 >> v2:172.21.15.136:3300/0 conn(0x7f40740d13d0 msgr2=0x7f40740b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407259c640 1 --2- 172.21.15.40:0/1802900782 >> v2:172.21.15.136:3300/0 conn(0x7f40740d13d0 0x7f40740b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407259c640 1 -- 172.21.15.40:0/1802900782 >> v1:172.21.15.40:6789/0 conn(0x7f40740d2e50 legacy=0x7f40740d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407159a640 1 -- 172.21.15.40:0/1802900782 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2513942157 0 0) 0x7f40740b10e0 con 0x7f40740d2e50 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407259c640 1 -- 172.21.15.40:0/1802900782 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40740d3340 con 0x7f4074161c80 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407259c640 1 --2- 172.21.15.40:0/1802900782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4074161c80 0x7f40740d2910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f40740b6ef0 tx=0x7f406c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc7cf9a3b002d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.082+0000 7f407159a640 1 -- 172.21.15.40:0/1802900782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c0315a0 con 0x7f4074161c80 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407159a640 1 -- 172.21.15.40:0/1802900782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f406c037070 con 0x7f4074161c80 2024-04-14T09:59:34.083 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407159a640 1 -- 172.21.15.40:0/1802900782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f406c031960 con 0x7f4074161c80 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 -- 172.21.15.40:0/1802900782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4074161c80 msgr2=0x7f40740d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 --2- 172.21.15.40:0/1802900782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4074161c80 0x7f40740d2910 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f40740b6ef0 tx=0x7f406c02b840 comp rx=0 tx=0).stop 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 -- 172.21.15.40:0/1802900782 shutdown_connections 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 --2- 172.21.15.40:0/1802900782 >> v2:172.21.15.136:3300/0 conn(0x7f40740d13d0 0x7f40740b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 --2- 172.21.15.40:0/1802900782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f4074161c80 0x7f40740d2910 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 -- 172.21.15.40:0/1802900782 >> 172.21.15.40:0/1802900782 conn(0x7f407409d5e0 msgr2=0x7f40740d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 -- 172.21.15.40:0/1802900782 shutdown_connections 2024-04-14T09:59:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.083+0000 7f407882d640 1 -- 172.21.15.40:0/1802900782 wait complete. 2024-04-14T09:59:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 Processor -- start 2024-04-14T09:59:34.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 -- start start 2024-04-14T09:59:34.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40740d13d0 0x7f40741598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4074161c80 0x7f4074156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f40740b23a0 con 0x7f40740d2e50 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f40740d0390 con 0x7f4074161c80 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f407882d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f40740b2520 con 0x7f40740d13d0 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f4071d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f4071d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58102/0 (socket says 172.21.15.40:58102) 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.085+0000 7f4071d9b640 1 -- 172.21.15.40:0/4202902145 learned_addr learned my addr 172.21.15.40:0/4202902145 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4072d9d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4074161c80 0x7f4074156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 -- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40740d13d0 msgr2=0x7f40741598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40740d13d0 0x7f40741598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 -- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4074161c80 msgr2=0x7f4074156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4074161c80 0x7f4074156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 -- 172.21.15.40:0/4202902145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4074156e80 con 0x7f40740d2e50 2024-04-14T09:59:34.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f4071d9b640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c4e0 tx=0x7f405c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c018070 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405c007500 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40740b91a0 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c004a20 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.086+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4074157d10 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.087+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4074075760 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.087+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f405c01b070 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.088+0000 7f406affd640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 0x7f405406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.088+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f405c08ad00 con 0x7f40740d2e50 2024-04-14T09:59:34.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.088+0000 7f407259c640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 0x7f405406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.089+0000 7f407259c640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 0x7f405406ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f406c036000 tx=0x7f406c030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.092+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f4074156e80 con 0x7f40740d2e50 2024-04-14T09:59:34.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.347+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f40740d1ec0 con 0x7f40740d2e50 2024-04-14T09:59:34.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.349+0000 7f406affd640 1 -- 172.21.15.40:0/4202902145 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f405c059320 con 0x7f40740d2e50 2024-04-14T09:59:34.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 msgr2=0x7f405406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 0x7f405406ede0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f406c036000 tx=0x7f406c030000 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 msgr2=0x7f40740b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f405c00c4e0 tx=0x7f405c00c9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 shutdown_connections 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f405406c920 0x7f405406ede0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4074161c80 0x7f4074156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f40740d2e50 0x7f40740b8a00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 --2- 172.21.15.40:0/4202902145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f40740d13d0 0x7f40741598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 >> 172.21.15.40:0/4202902145 conn(0x7f407409d5e0 msgr2=0x7f40740d23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 shutdown_connections 2024-04-14T09:59:34.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.351+0000 7f407882d640 1 -- 172.21.15.40:0/4202902145 wait complete. 2024-04-14T09:59:34.361 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.463+0000 7fbc8c708640 1 Processor -- start 2024-04-14T09:59:34.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.463+0000 7fbc8c708640 1 -- start start 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8c708640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 0x7fbc840b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8c708640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc840d2e80 0x7fbc840cf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8c708640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc840b4c70 con 0x7fbc840b4760 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8c708640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fbc840b5880 con 0x7fbc840d2e80 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8c708640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fbc840b4f50 con 0x7fbc8415e650 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8aca5640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fbc840d2e80 0x7fbc840cf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc89ca3640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fbc840b4760 0x7fbc840d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37064/0 (socket says 172.21.15.40:37064) 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc89ca3640 1 -- 172.21.15.40:0/2884451435 learned_addr learned my addr 172.21.15.40:0/2884451435 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8a4a4640 1 --2- 172.21.15.40:0/2884451435 >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 0x7fbc840b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8aca5640 1 -- 172.21.15.40:0/2884451435 >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 msgr2=0x7fbc840b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8aca5640 1 --2- 172.21.15.40:0/2884451435 >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 0x7fbc840b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8aca5640 1 -- 172.21.15.40:0/2884451435 >> v1:172.21.15.40:6789/0 conn(0x7fbc840b4760 legacy=0x7fbc840d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8aca5640 1 -- 172.21.15.40:0/2884451435 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc840b5230 con 0x7fbc840d2e80 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc894a2640 1 -- 172.21.15.40:0/2884451435 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372461515 0 0) 0x7fbc840b4c70 con 0x7fbc840b4760 2024-04-14T09:59:34.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.464+0000 7fbc8a4a4640 1 --2- 172.21.15.40:0/2884451435 >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 0x7fbc840b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:34.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.465+0000 7fbc8aca5640 1 --2- 172.21.15.40:0/2884451435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840d2e80 0x7fbc840cf0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbc840b5a00 tx=0x7fbc7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa20429fcf6ef4f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.465+0000 7fbc894a2640 1 -- 172.21.15.40:0/2884451435 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c039070 con 0x7fbc840d2e80 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.465+0000 7fbc894a2640 1 -- 172.21.15.40:0/2884451435 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc7c02cc60 con 0x7fbc840d2e80 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.465+0000 7fbc894a2640 1 -- 172.21.15.40:0/2884451435 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c034660 con 0x7fbc840d2e80 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 -- 172.21.15.40:0/2884451435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840d2e80 msgr2=0x7fbc840cf0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 --2- 172.21.15.40:0/2884451435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840d2e80 0x7fbc840cf0a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbc840b5a00 tx=0x7fbc7c02beb0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 -- 172.21.15.40:0/2884451435 shutdown_connections 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 --2- 172.21.15.40:0/2884451435 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840d2e80 0x7fbc840cf0a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 --2- 172.21.15.40:0/2884451435 >> v2:172.21.15.136:3300/0 conn(0x7fbc8415e650 0x7fbc840b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 -- 172.21.15.40:0/2884451435 >> 172.21.15.40:0/2884451435 conn(0x7fbc8409d580 msgr2=0x7fbc840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 -- 172.21.15.40:0/2884451435 shutdown_connections 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.466+0000 7fbc8c708640 1 -- 172.21.15.40:0/2884451435 wait complete. 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.467+0000 7fbc8c708640 1 Processor -- start 2024-04-14T09:59:34.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.467+0000 7fbc8c708640 1 -- start start 2024-04-14T09:59:34.469 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc840d2e80 0x7fbc8406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbc8415e650 0x7fbc8415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8415ea30 con 0x7fbc840b4760 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbc840d2270 con 0x7fbc840d2e80 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8c708640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8415ebb0 con 0x7fbc8415e650 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58122/0 (socket says 172.21.15.40:58122) 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 -- 172.21.15.40:0/1309672295 learned_addr learned my addr 172.21.15.40:0/1309672295 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8aca5640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbc8415e650 0x7fbc8415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc89ca3640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc840d2e80 0x7fbc8406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 -- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbc8415e650 msgr2=0x7fbc8415edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbc8415e650 0x7fbc8415edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 -- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc840d2e80 msgr2=0x7fbc8406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc840d2e80 0x7fbc8406c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.468+0000 7fbc8a4a4640 1 -- 172.21.15.40:0/1309672295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc84160af0 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc8a4a4640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c7f0 tx=0x7fbc8000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80015070 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc80007a30 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc84160dd0 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc80007e00 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.469+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc84161390 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.470+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc840756f0 con 0x7fbc840b4760 2024-04-14T09:59:34.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.470+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc80018070 con 0x7fbc840b4760 2024-04-14T09:59:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.471+0000 7fbc7affd640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 0x7fbc6806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.471+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbc8008b910 con 0x7fbc840b4760 2024-04-14T09:59:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.471+0000 7fbc89ca3640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 0x7fbc6806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.471+0000 7fbc89ca3640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 0x7fbc6806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc84160210 tx=0x7fbc74007c00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.475+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbc80059f90 con 0x7fbc840b4760 2024-04-14T09:59:34.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.660+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc840d1aa0 con 0x7fbc840b4760 2024-04-14T09:59:34.660 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.661+0000 7fbc7affd640 1 -- 172.21.15.40:0/1309672295 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13140 (secure 0 0 0) 0x7fbc80059890 con 0x7fbc840b4760 2024-04-14T09:59:34.661 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:34.661 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":35,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:31.638557+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 msgr2=0x7fbc6806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 0x7fbc6806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbc84160210 tx=0x7fbc74007c00 comp rx=0 tx=0).stop 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 msgr2=0x7fbc84160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbc8000c7f0 tx=0x7fbc8000cbf0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 shutdown_connections 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbc6806c8f0 0x7fbc6806edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbc8415e650 0x7fbc8415edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbc840d2e80 0x7fbc8406c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 --2- 172.21.15.40:0/1309672295 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbc840b4760 0x7fbc84160280 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 >> 172.21.15.40:0/1309672295 conn(0x7fbc8409d580 msgr2=0x7fbc840b1410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 shutdown_connections 2024-04-14T09:59:34.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.663+0000 7fbc8c708640 1 -- 172.21.15.40:0/1309672295 wait complete. 2024-04-14T09:59:34.674 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T09:59:34.674 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:34.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.779+0000 7f34ae688640 1 Processor -- start 2024-04-14T09:59:34.779 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.779+0000 7f34ae688640 1 -- start start 2024-04-14T09:59:34.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 0x7f34a80d4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34a80c7e30 0x7f34a80d4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e7b0 0x7f34a80d2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f34a80d2f30 con 0x7f34a80c7e30 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f34a80cf000 con 0x7f34a815e3d0 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34ae688640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f34a80cf2e0 con 0x7f34a815e7b0 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34a80c7e30 0x7f34a80d4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f34a80c7e30 0x7f34a80d4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58124/0 (socket says 172.21.15.40:58124) 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 -- 172.21.15.40:0/420060379 learned_addr learned my addr 172.21.15.40:0/420060379 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 -- 172.21.15.40:0/420060379 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e7b0 msgr2=0x7f34a80d2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 --2- 172.21.15.40:0/420060379 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e7b0 0x7f34a80d2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a7fff640 1 --2- 172.21.15.40:0/420060379 >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 0x7f34a80d4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 -- 172.21.15.40:0/420060379 >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 msgr2=0x7f34a80d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 --2- 172.21.15.40:0/420060379 >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 0x7f34a80d4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a77fe640 1 -- 172.21.15.40:0/420060379 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a80cf5c0 con 0x7f34a80c7e30 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.780+0000 7f34a7fff640 1 --2- 172.21.15.40:0/420060379 >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 0x7f34a80d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34a77fe640 1 --2- 172.21.15.40:0/420060379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a80d4570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34a80b6e70 tx=0x7f349802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a9172973be4ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34a6ffd640 1 -- 172.21.15.40:0/420060379 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498035020 con 0x7f34a80c7e30 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34a6ffd640 1 -- 172.21.15.40:0/420060379 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3498031870 con 0x7f34a80c7e30 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34a6ffd640 1 -- 172.21.15.40:0/420060379 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3498031c40 con 0x7f34a80c7e30 2024-04-14T09:59:34.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34ae688640 1 -- 172.21.15.40:0/420060379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 msgr2=0x7f34a80d4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.781+0000 7f34ae688640 1 --2- 172.21.15.40:0/420060379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a80d4570 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f34a80b6e70 tx=0x7f349802b910 comp rx=0 tx=0).stop 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 -- 172.21.15.40:0/420060379 shutdown_connections 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 --2- 172.21.15.40:0/420060379 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e7b0 0x7f34a80d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 --2- 172.21.15.40:0/420060379 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a80d4570 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 --2- 172.21.15.40:0/420060379 >> v2:172.21.15.136:3300/0 conn(0x7f34a815e3d0 0x7f34a80d4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 -- 172.21.15.40:0/420060379 >> 172.21.15.40:0/420060379 conn(0x7f34a808dc90 msgr2=0x7f34a809d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 -- 172.21.15.40:0/420060379 shutdown_connections 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.782+0000 7f34ae688640 1 -- 172.21.15.40:0/420060379 wait complete. 2024-04-14T09:59:34.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.783+0000 7f34ae688640 1 Processor -- start 2024-04-14T09:59:34.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.783+0000 7f34ae688640 1 -- start start 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e3d0 0x7f34a8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 0x7f34a80cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f34a80d2830 con 0x7f34a80c7e30 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f34a80d26b0 con 0x7f34a815e7b0 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f34a80d29b0 con 0x7f34a815e3d0 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58138/0 (socket says 172.21.15.40:58138) 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 -- 172.21.15.40:0/1035153345 learned_addr learned my addr 172.21.15.40:0/1035153345 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a77fe640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e3d0 0x7f34a8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34acc25640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 0x7f34a80cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 -- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e3d0 msgr2=0x7f34a8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e3d0 0x7f34a8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 -- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 msgr2=0x7f34a80cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 0x7f34a80cb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 -- 172.21.15.40:0/1035153345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34a80cc5d0 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34acc25640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 0x7f34a80cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a7fff640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f349000c820 tx=0x7f349000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490015070 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3490007a30 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34a81f96c0 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3490007e00 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.784+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34a80ccb50 con 0x7f34a80c7e30 2024-04-14T09:59:34.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.785+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34a8075760 con 0x7f34a80c7e30 2024-04-14T09:59:34.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.786+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3490018070 con 0x7f34a80c7e30 2024-04-14T09:59:34.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.786+0000 7f34a4ff9640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:34.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.786+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f349008ba00 con 0x7f34a80c7e30 2024-04-14T09:59:34.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.786+0000 7f34a77fe640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:34.792 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.787+0000 7f34a77fe640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 0x7f348806edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3498036000 tx=0x7f349803c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:34.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.791+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3490059f50 con 0x7f34a80c7e30 2024-04-14T09:59:34.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.973+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34a80d51d0 con 0x7f34a80c7e30 2024-04-14T09:59:34.973 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.974+0000 7f34a4ff9640 1 -- 172.21.15.40:0/1035153345 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f3490059850 con 0x7f34a80c7e30 2024-04-14T09:59:34.973 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:34.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 msgr2=0x7f348806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 0x7f348806edb0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3498036000 tx=0x7f349803c040 comp rx=0 tx=0).stop 2024-04-14T09:59:34.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 msgr2=0x7f34a81f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:34.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f349000c820 tx=0x7f349000cc20 comp rx=0 tx=0).stop 2024-04-14T09:59:34.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 shutdown_connections 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f348806c8f0 0x7f348806edb0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f34a815e7b0 0x7f34a80cb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f34a815e3d0 0x7f34a8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 --2- 172.21.15.40:0/1035153345 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f34a80c7e30 0x7f34a81f9180 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 >> 172.21.15.40:0/1035153345 conn(0x7f34a808dc90 msgr2=0x7f34a815c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 shutdown_connections 2024-04-14T09:59:34.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:34.976+0000 7f34ae688640 1 -- 172.21.15.40:0/1035153345 wait complete. 2024-04-14T09:59:34.986 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-14T09:59:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.088+0000 7f35dcf5e640 1 Processor -- start 2024-04-14T09:59:35.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.088+0000 7f35dcf5e640 1 -- start start 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35dcf5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35d815e510 0x7f35d80cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35dcf5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f35d80d2800 0x7f35d80d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35dcf5e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35d80ceda0 con 0x7f35d80d0e90 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35dcf5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f35d80d31c0 con 0x7f35d815e510 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35dcf5e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f35d80d19a0 con 0x7f35d80d2800 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35d815e510 0x7f35d80cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35d815e510 0x7f35d80cfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58142/0 (socket says 172.21.15.40:58142) 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 -- 172.21.15.40:0/556278355 learned_addr learned my addr 172.21.15.40:0/556278355 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35cffff640 1 --2- 172.21.15.40:0/556278355 >> v2:172.21.15.136:3300/0 conn(0x7f35d80d2800 0x7f35d80d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 -- 172.21.15.40:0/556278355 >> v2:172.21.15.136:3300/0 conn(0x7f35d80d2800 msgr2=0x7f35d80d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 --2- 172.21.15.40:0/556278355 >> v2:172.21.15.136:3300/0 conn(0x7f35d80d2800 0x7f35d80d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 -- 172.21.15.40:0/556278355 >> v1:172.21.15.136:6789/0 conn(0x7f35d80d0e90 legacy=0x7f35d80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.089+0000 7f35d659c640 1 -- 172.21.15.40:0/556278355 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d80cf040 con 0x7f35d815e510 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.090+0000 7f35d659c640 1 --2- 172.21.15.40:0/556278355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d815e510 0x7f35d80cfe00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f35d808e0f0 tx=0x7f35c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2c7ebf1fba05fa server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.090+0000 7f35d5d9b640 1 -- 172.21.15.40:0/556278355 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c80315a0 con 0x7f35d815e510 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.090+0000 7f35d5d9b640 1 -- 172.21.15.40:0/556278355 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c8037070 con 0x7f35d815e510 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.090+0000 7f35d5d9b640 1 -- 172.21.15.40:0/556278355 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8031960 con 0x7f35d815e510 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 -- 172.21.15.40:0/556278355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d815e510 msgr2=0x7f35d80cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/556278355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d815e510 0x7f35d80cfe00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f35d808e0f0 tx=0x7f35c802b840 comp rx=0 tx=0).stop 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 -- 172.21.15.40:0/556278355 shutdown_connections 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/556278355 >> v2:172.21.15.136:3300/0 conn(0x7f35d80d2800 0x7f35d80d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/556278355 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d815e510 0x7f35d80cfe00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 -- 172.21.15.40:0/556278355 >> 172.21.15.40:0/556278355 conn(0x7f35d809d570 msgr2=0x7f35d80d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:35.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 -- 172.21.15.40:0/556278355 shutdown_connections 2024-04-14T09:59:35.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.091+0000 7f35dcf5e640 1 -- 172.21.15.40:0/556278355 wait complete. 2024-04-14T09:59:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.092+0000 7f35dcf5e640 1 Processor -- start 2024-04-14T09:59:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.092+0000 7f35dcf5e640 1 -- start start 2024-04-14T09:59:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35d80d2800 0x7f35d80b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35d815e510 0x7f35d81530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35d815e8f0 con 0x7f35d80d0e90 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f35d80cf600 con 0x7f35d815e510 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35d80b3ad0 con 0x7f35d80d2800 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58148/0 (socket says 172.21.15.40:58148) 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 -- 172.21.15.40:0/174855782 learned_addr learned my addr 172.21.15.40:0/174855782 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 -- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35d80d2800 msgr2=0x7f35d80b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35d80d2800 0x7f35d80b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 -- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35d815e510 msgr2=0x7f35d81530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35d815e510 0x7f35d81530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 -- 172.21.15.40:0/174855782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d80b9360 con 0x7f35d80d0e90 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35d659c640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35c80097f0 tx=0x7f35c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8032630 con 0x7f35d80d0e90 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c80327d0 con 0x7f35d80d0e90 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35d80b8da0 con 0x7f35d80d0e90 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c8032bc0 con 0x7f35d80d0e90 2024-04-14T09:59:35.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.093+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35d80c8ad0 con 0x7f35d80d0e90 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.094+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35d80ba090 con 0x7f35d80d0e90 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.095+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35c803b3f0 con 0x7f35d80d0e90 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.095+0000 7f35ceffd640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 0x7f35b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.095+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f35c802f030 con 0x7f35d80d0e90 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.095+0000 7f35cffff640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 0x7f35b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.096+0000 7f35cffff640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 0x7f35b806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ce7e0 tx=0x7f35c0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.100+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f35d80ba090 con 0x7f35d80d0e90 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.284+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f35d80756f0 con 0x7f35d80d0e90 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.285+0000 7f35ceffd640 1 -- 172.21.15.40:0/174855782 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7f35c8040070 con 0x7f35d80d0e90 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stdout:[ 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stdout: { 2024-04-14T09:59:35.284 INFO:teuthology.orchestra.run.smithi040.stdout: "poolnum": 1, 2024-04-14T09:59:35.285 INFO:teuthology.orchestra.run.smithi040.stdout: "poolname": ".mgr" 2024-04-14T09:59:35.285 INFO:teuthology.orchestra.run.smithi040.stdout: } 2024-04-14T09:59:35.285 INFO:teuthology.orchestra.run.smithi040.stdout:] 2024-04-14T09:59:35.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.286+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 msgr2=0x7f35b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.286+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 0x7f35b806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f35d80ce7e0 tx=0x7f35c0008040 comp rx=0 tx=0).stop 2024-04-14T09:59:35.286 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 msgr2=0x7f35d80c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f35c80097f0 tx=0x7f35c80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 shutdown_connections 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f35b806c8f0 0x7f35b806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35d815e510 0x7f35d81530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35d80d2800 0x7f35d80b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 --2- 172.21.15.40:0/174855782 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35d80d0e90 0x7f35d80c8590 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 >> 172.21.15.40:0/174855782 conn(0x7f35d809d570 msgr2=0x7f35d806ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 shutdown_connections 2024-04-14T09:59:35.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.287+0000 7f35dcf5e640 1 -- 172.21.15.40:0/174855782 wait complete. 2024-04-14T09:59:35.297 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-14T09:59:35.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-14T09:59:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.403+0000 7fd0a5020640 1 Processor -- start 2024-04-14T09:59:35.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.403+0000 7fd0a5020640 1 -- start start 2024-04-14T09:59:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.404+0000 7fd0a5020640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 0x7fd0a00cc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.404+0000 7fd0a5020640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd0a00ccbe0 0x7fd0a01620a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.404+0000 7fd0a5020640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00d1630 con 0x7fd0a015e460 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.404+0000 7fd0a5020640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd0a00d01a0 con 0x7fd0a00ccbe0 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.404+0000 7fd0a5020640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00cd070 con 0x7fd0a006c630 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09f59e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd0a00ccbe0 0x7fd0a01620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09e59c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 0x7fd0a00cc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09ed9d640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd0a015e460 0x7fd0a00d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:54594/0 (socket says 172.21.15.40:54594) 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09ed9d640 1 -- 172.21.15.40:0/1328534879 learned_addr learned my addr 172.21.15.40:0/1328534879 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09dd9b640 1 -- 172.21.15.40:0/1328534879 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794764460 0 0) 0x7fd0a00d1630 con 0x7fd0a015e460 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09e59c640 1 -- 172.21.15.40:0/1328534879 >> v2:172.21.15.136:3300/0 conn(0x7fd0a00ccbe0 msgr2=0x7fd0a01620a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09e59c640 1 --2- 172.21.15.40:0/1328534879 >> v2:172.21.15.136:3300/0 conn(0x7fd0a00ccbe0 0x7fd0a01620a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09e59c640 1 -- 172.21.15.40:0/1328534879 >> v1:172.21.15.136:6789/0 conn(0x7fd0a015e460 legacy=0x7fd0a00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.405+0000 7fd09e59c640 1 -- 172.21.15.40:0/1328534879 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a006d680 con 0x7fd0a006c630 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd09e59c640 1 --2- 172.21.15.40:0/1328534879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 0x7fd0a00cc6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0940097a0 tx=0x7fd09402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bd17aefdc77099f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd09dd9b640 1 -- 172.21.15.40:0/1328534879 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094035020 con 0x7fd0a006c630 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd09dd9b640 1 -- 172.21.15.40:0/1328534879 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd094031830 con 0x7fd0a006c630 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd09dd9b640 1 -- 172.21.15.40:0/1328534879 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094031c00 con 0x7fd0a006c630 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 -- 172.21.15.40:0/1328534879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 msgr2=0x7fd0a00cc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1328534879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 0x7fd0a00cc6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd0940097a0 tx=0x7fd09402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 -- 172.21.15.40:0/1328534879 shutdown_connections 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1328534879 >> v2:172.21.15.136:3300/0 conn(0x7fd0a00ccbe0 0x7fd0a01620a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1328534879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a006c630 0x7fd0a00cc6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 -- 172.21.15.40:0/1328534879 >> 172.21.15.40:0/1328534879 conn(0x7fd0a00b3b40 msgr2=0x7fd0a00b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.406+0000 7fd0a5020640 1 -- 172.21.15.40:0/1328534879 shutdown_connections 2024-04-14T09:59:35.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.407+0000 7fd0a5020640 1 -- 172.21.15.40:0/1328534879 wait complete. 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.408+0000 7fd0a5020640 1 Processor -- start 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.408+0000 7fd0a5020640 1 -- start start 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a00ccbe0 0x7fd0a00b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a015e460 0x7fd0a00b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d0720 con 0x7fd0a006c630 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a00d0440 con 0x7fd0a00ccbe0 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0a5020640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd0a00d0a00 con 0x7fd0a015e460 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58152/0 (socket says 172.21.15.40:58152) 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 -- 172.21.15.40:0/1585017448 learned_addr learned my addr 172.21.15.40:0/1585017448 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09e59c640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a00ccbe0 0x7fd0a00b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.410 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09f59e640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a015e460 0x7fd0a00b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 -- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a015e460 msgr2=0x7fd0a00b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a015e460 0x7fd0a00b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 -- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a00ccbe0 msgr2=0x7fd0a00b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a00ccbe0 0x7fd0a00b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 -- 172.21.15.40:0/1585017448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a00b6010 con 0x7fd0a006c630 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd09ed9d640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c4d0 tx=0x7fd09000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.409+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090018070 con 0x7fd0a006c630 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.410+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd090007500 con 0x7fd0a006c630 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.410+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01e5fb0 con 0x7fd0a006c630 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.410+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd090004a20 con 0x7fd0a006c630 2024-04-14T09:59:35.411 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.410+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a01e6570 con 0x7fd0a006c630 2024-04-14T09:59:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.411+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a00757d0 con 0x7fd0a006c630 2024-04-14T09:59:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.411+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd09001b070 con 0x7fd0a006c630 2024-04-14T09:59:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.411+0000 7fd0877fe640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.411+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd09008aca0 con 0x7fd0a006c630 2024-04-14T09:59:35.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.412+0000 7fd09e59c640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.413 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.412+0000 7fd09e59c640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 0x7fd08c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd094008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.415 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.416+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd090058bb0 con 0x7fd0a006c630 2024-04-14T09:59:35.601 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.602+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd0a00d1b30 con 0x7fd0a006c630 2024-04-14T09:59:35.632 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.633+0000 7fd0877fe640 1 -- 172.21.15.40:0/1585017448 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7fd09005ceb0 con 0x7fd0a006c630 2024-04-14T09:59:35.633 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_metadata' created 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 msgr2=0x7fd08c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 0x7fd08c06edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd094036000 tx=0x7fd094008030 comp rx=0 tx=0).stop 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 msgr2=0x7fd0a01567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd09000c4d0 tx=0x7fd09000c990 comp rx=0 tx=0).stop 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 shutdown_connections 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0a015e460 0x7fd0a00b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0a00ccbe0 0x7fd0a00b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 --2- 172.21.15.40:0/1585017448 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0a006c630 0x7fd0a01567e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 >> 172.21.15.40:0/1585017448 conn(0x7fd0a00b3b40 msgr2=0x7fd0a015d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 shutdown_connections 2024-04-14T09:59:35.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.635+0000 7fd0a5020640 1 -- 172.21.15.40:0/1585017448 wait complete. 2024-04-14T09:59:35.649 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-14T09:59:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.757+0000 7f3cbca36640 1 Processor -- start 2024-04-14T09:59:35.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.757+0000 7f3cbca36640 1 -- start start 2024-04-14T09:59:35.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cbca36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3cb8162f30 0x7f3cb80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cbca36640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb809b450 con 0x7f3cb81629e0 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cbca36640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb809b6f0 con 0x7f3cb8162600 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cbca36640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb80d0aa0 con 0x7f3cb8162f30 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cb6d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3cb81629e0 0x7f3cb80cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:37074/0 (socket says 172.21.15.40:37074) 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.758+0000 7f3cb6d9d640 1 -- 172.21.15.40:0/2415681649 learned_addr learned my addr 172.21.15.40:0/2415681649 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2415681649 >> v2:172.21.15.136:3300/0 conn(0x7f3cb8162f30 0x7f3cb80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150609146 0 0) 0x7f3cb809b450 con 0x7f3cb81629e0 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ca0003520 con 0x7f3cb81629e0 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752032863 0 0) 0x7f3cb809b6f0 con 0x7f3cb8162600 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cb809b450 con 0x7f3cb8162600 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1484170559 0 0) 0x7f3ca0003520 con 0x7f3cb81629e0 2024-04-14T09:59:35.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 >> v2:172.21.15.136:3300/0 conn(0x7f3cb8162f30 msgr2=0x7f3cb80b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 --2- 172.21.15.40:0/2415681649 >> v2:172.21.15.136:3300/0 conn(0x7f3cb8162f30 0x7f3cb80b4740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 >> v1:172.21.15.136:6789/0 conn(0x7f3cb8162600 legacy=0x7f3cb80d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb809b9d0 con 0x7f3cb81629e0 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f3ca8001a10 con 0x7f3cb81629e0 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 >> v1:172.21.15.40:6789/0 conn(0x7f3cb81629e0 legacy=0x7f3cb80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 0x7f3ca0003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ca0004800 0x7f3ca0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca00051c0 0x7f3ca000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80d0aa0 con 0x7f3ca0003b70 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ca000c110 con 0x7f3ca00051c0 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3ca000c310 con 0x7f3ca0004800 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2415681649 >> v2:172.21.15.136:3300/0 conn(0x7f3cb8162f30 0x7f3cb80b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:35.762 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 0x7f3ca0003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb6d9d640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca00051c0 0x7f3ca000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ca0004800 0x7f3ca0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 -- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ca0004800 msgr2=0x7f3ca0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ca0004800 0x7f3ca0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 -- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca00051c0 msgr2=0x7f3ca000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca00051c0 0x7f3ca000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb659c640 1 -- 172.21.15.40:0/2415681649 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ca0003520 con 0x7f3ca0003b70 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.759+0000 7f3cb6d9d640 1 -- 172.21.15.40:0/2415681649 reap_dead start 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.760+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 0x7f3ca0003f70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00018c0 tx=0x7f3ca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0ea8205a489fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.760+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0037070 con 0x7f3ca0003b70 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.760+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb00052f0 con 0x7f3ca0003b70 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.760+0000 7f3cb559a640 1 -- 172.21.15.40:0/2415681649 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00014e0 con 0x7f3ca0003b70 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 -- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 msgr2=0x7f3ca0003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.763 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 0x7f3ca0003f70 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00018c0 tx=0x7f3ca0005830 comp rx=0 tx=0).stop 2024-04-14T09:59:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 -- 172.21.15.40:0/2415681649 shutdown_connections 2024-04-14T09:59:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2415681649 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3ca0003b70 0x7f3ca0003f70 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 -- 172.21.15.40:0/2415681649 >> 172.21.15.40:0/2415681649 conn(0x7f3cb80b3c20 msgr2=0x7f3cb80b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 -- 172.21.15.40:0/2415681649 shutdown_connections 2024-04-14T09:59:35.764 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.761+0000 7f3cbca36640 1 -- 172.21.15.40:0/2415681649 wait complete. 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.762+0000 7f3cbca36640 1 Processor -- start 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.762+0000 7f3cbca36640 1 -- start start 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca0003b70 0x7f3cb80ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cb80c9740 0x7f3cb80c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.766 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80d04d0 con 0x7f3cb80c8810 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb80d0350 con 0x7f3ca0003b70 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cbca36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3cb80b4740 con 0x7f3cb80c9740 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:58166/0 (socket says 172.21.15.40:58166) 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 -- 172.21.15.40:0/2533262414 learned_addr learned my addr 172.21.15.40:0/2533262414 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 -- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cb80c9740 msgr2=0x7f3cb80c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cb80c9740 0x7f3cb80c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 -- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca0003b70 msgr2=0x7f3cb80ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.763+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca0003b70 0x7f3cb80ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3cb5d9b640 1 -- 172.21.15.40:0/2533262414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb80cb180 con 0x7f3cb80c8810 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3cb5d9b640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0116f0 tx=0x7f3cac011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac004220 con 0x7f3cb80c8810 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cac0043c0 con 0x7f3cb80c8810 2024-04-14T09:59:35.767 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00f940 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb80cb460 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.764+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb80cba20 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.765+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb8075760 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.766+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cac00fae0 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.766+0000 7f3ca6ffd640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 0x7f3c9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.766+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7f3cac08c290 con 0x7f3cb80c8810 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.767+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 0x7f3c9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:35.768 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.767+0000 7f3cb659c640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 0x7f3c9806ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0034000 tx=0x7f3cb0030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:35.770 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.771+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3cac019030 con 0x7f3cb80c8810 2024-04-14T09:59:35.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:35.954+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3cb80b80b0 con 0x7f3cb80c8810 2024-04-14T09:59:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.636+0000 7f3ca6ffd640 1 -- 172.21.15.40:0/2533262414 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7f3cac05a710 con 0x7f3cb80c8810 2024-04-14T09:59:36.635 INFO:teuthology.orchestra.run.smithi040.stderr:pool 'cephfs_data' created 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 msgr2=0x7f3c9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 0x7f3c9806ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0034000 tx=0x7f3cb0030000 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 msgr2=0x7f3cb80c9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0116f0 tx=0x7f3cac011bb0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 shutdown_connections 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3c9806c920 0x7f3c9806ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cb80c9740 0x7f3cb80c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cb80c8810 0x7f3cb80c9200 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 --2- 172.21.15.40:0/2533262414 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ca0003b70 0x7f3cb80ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 >> 172.21.15.40:0/2533262414 conn(0x7f3cb80b3c20 msgr2=0x7f3cb80aee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 shutdown_connections 2024-04-14T09:59:36.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.639+0000 7f3cbca36640 1 -- 172.21.15.40:0/2533262414 wait complete. 2024-04-14T09:59:36.664 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-14T09:59:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.773+0000 7f9df4888640 1 Processor -- start 2024-04-14T09:59:36.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.773+0000 7f9df4888640 1 -- start start 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9df4888640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9df00d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9df4888640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df00b10e0 con 0x7f9df00d13d0 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9df4888640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9df00b1380 con 0x7f9df00d2e50 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9df4888640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9df00b1660 con 0x7f9df0161c80 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9deed9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9df00d13d0 0x7f9df00b1e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52164/0 (socket says 172.21.15.40:52164) 2024-04-14T09:59:36.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.774+0000 7f9deed9d640 1 -- 172.21.15.40:0/2740524328 learned_addr learned my addr 172.21.15.40:0/2740524328 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9dee59c640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9df00d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1052016224 0 0) 0x7f9df00b10e0 con 0x7f9df00d13d0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dd8003520 con 0x7f9df00d13d0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v1:172.21.15.40:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1948322231 0 0) 0x7f9dd8003520 con 0x7f9df00d13d0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 msgr2=0x7f9df00d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9df00d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 >> v1:172.21.15.136:6789/0 conn(0x7f9df00d2e50 legacy=0x7f9df00d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 --> v1:172.21.15.40:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df00d3340 con 0x7f9df00d13d0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v1:172.21.15.40:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4131437219 0 0) 0x7f9de00019f0 con 0x7f9df00d13d0 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 >> v1:172.21.15.40:6789/0 conn(0x7f9df00d13d0 legacy=0x7f9df00b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9dd80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd8003f20 0x7f9dd8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9dd8004d40 0x7f9dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9df00b1660 con 0x7f9dd8003f20 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd800bad0 con 0x7f9dd8004d40 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd800bcd0 con 0x7f9df0161c80 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd8003f20 0x7f9dd8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9dee59c640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9dd80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9deed9d640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9dd8004d40 0x7f9dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.775+0000 7f9dedd9b640 1 -- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 msgr2=0x7f9dd80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9df0161c80 0x7f9dd80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9dedd9b640 1 -- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9dd8004d40 msgr2=0x7f9dd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9dd8004d40 0x7f9dd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9dedd9b640 1 -- 172.21.15.40:0/2740524328 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd8003520 con 0x7f9dd8003f20 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd8003f20 0x7f9dd8004800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001830 tx=0x7f9dd8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=463cd1ad6ce1f50 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4001430 con 0x7f9dd8003f20 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4033610 con 0x7f9dd8003f20 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.776+0000 7f9ded59a640 1 -- 172.21.15.40:0/2740524328 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4033a00 con 0x7f9dd8003f20 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 -- 172.21.15.40:0/2740524328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd8003f20 msgr2=0x7f9dd8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 --2- 172.21.15.40:0/2740524328 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9dd8003f20 0x7f9dd8004800 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001830 tx=0x7f9dd8005830 comp rx=0 tx=0).stop 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9deed9d640 1 -- 172.21.15.40:0/2740524328 reap_dead start 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 -- 172.21.15.40:0/2740524328 shutdown_connections 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 -- 172.21.15.40:0/2740524328 >> 172.21.15.40:0/2740524328 conn(0x7f9df009d5e0 msgr2=0x7f9df00d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 -- 172.21.15.40:0/2740524328 shutdown_connections 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.777+0000 7f9df4888640 1 -- 172.21.15.40:0/2740524328 wait complete. 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.778+0000 7f9df4888640 1 Processor -- start 2024-04-14T09:59:36.780 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 -- start start 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9dd8003f20 0x7f9df00c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df00b95f0 0x7f9df00b9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9df00d2910 con 0x7f9df015bb70 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9df00d0390 con 0x7f9df00b95f0 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9df4888640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9df00d2a90 con 0x7f9dd8003f20 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9dedd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9dedd9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40414/0 (socket says 172.21.15.40:40414) 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.779+0000 7f9dedd9b640 1 -- 172.21.15.40:0/3762566949 learned_addr learned my addr 172.21.15.40:0/3762566949 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9deed9d640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df00b95f0 0x7f9df00b9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 -- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9dd8003f20 msgr2=0x7f9df00c7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dee59c640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9dd8003f20 0x7f9df00c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9dd8003f20 0x7f9df00c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 -- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df00b95f0 msgr2=0x7f9df00b9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df00b95f0 0x7f9df00b9aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 -- 172.21.15.40:0/3762566949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9df00b8550 con 0x7f9df015bb70 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9dedd9b640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001950 tx=0x7f9de4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de40035f0 con 0x7f9df015bb70 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de4003790 con 0x7f9df015bb70 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9df00b8830 con 0x7f9df015bb70 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9de4003b80 con 0x7f9df015bb70 2024-04-14T09:59:36.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.780+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9df00b8df0 con 0x7f9df015bb70 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.781+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9df0075760 con 0x7f9df015bb70 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.782+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9de403c400 con 0x7f9df015bb70 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.782+0000 7f9ddeffd640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 0x7f9dd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.782+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7f9de40ad5b0 con 0x7f9df015bb70 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.782+0000 7f9dee59c640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 0x7f9dd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:36.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.783+0000 7f9dee59c640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 0x7f9dd006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9de80099e0 tx=0x7f9de8008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:36.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:36.787+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9de4040070 con 0x7f9df015bb70 2024-04-14T09:59:37.011 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.011+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9df00d4570 con 0x7f9df015bb70 2024-04-14T09:59:37.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.657+0000 7f9ddeffd640 1 -- 172.21.15.40:0/3762566949 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f9de4030070 con 0x7f9df015bb70 2024-04-14T09:59:37.658 INFO:teuthology.orchestra.run.smithi040.stderr:new fs with metadata pool 5 and data pool 6 2024-04-14T09:59:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.667+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 msgr2=0x7f9dd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.667+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 0x7f9dd006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9de80099e0 tx=0x7f9de8008040 comp rx=0 tx=0).stop 2024-04-14T09:59:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.667+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 msgr2=0x7f9df0152790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.667 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.667+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9de4001950 tx=0x7f9de4001230 comp rx=0 tx=0).stop 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.669+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 shutdown_connections 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.670+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9dd006c8f0 0x7f9dd006edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.670+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9df00b95f0 0x7f9df00b9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.670+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9df015bb70 0x7f9df0152790 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.670+0000 7f9df4888640 1 --2- 172.21.15.40:0/3762566949 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9dd8003f20 0x7f9df00c7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.670+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 >> 172.21.15.40:0/3762566949 conn(0x7f9df009d5e0 msgr2=0x7f9df0160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:37.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.673+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 shutdown_connections 2024-04-14T09:59:37.673 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.673+0000 7f9df4888640 1 -- 172.21.15.40:0/3762566949 wait complete. 2024-04-14T09:59:37.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:37.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.794+0000 7f962f35e640 1 Processor -- start 2024-04-14T09:59:37.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.794+0000 7f962f35e640 1 -- start start 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f962815e590 0x7f96280b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280b0790 0x7f96280ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f96280addf0 0x7f962806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f962806c4b0 con 0x7f962815e590 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f962815e970 con 0x7f96280addf0 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962f35e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f96280724c0 con 0x7f96280b0790 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f962815e590 0x7f96280b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f962815e590 0x7f96280b49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40424/0 (socket says 172.21.15.40:40424) 2024-04-14T09:59:37.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 -- 172.21.15.40:0/2285443912 learned_addr learned my addr 172.21.15.40:0/2285443912 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d8fb640 1 --2- 172.21.15.40:0/2285443912 >> v2:172.21.15.136:3300/0 conn(0x7f96280addf0 0x7f962806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962c8f9640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280b0790 0x7f96280ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 -- 172.21.15.40:0/2285443912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280b0790 msgr2=0x7f96280ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280b0790 0x7f96280ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 -- 172.21.15.40:0/2285443912 >> v2:172.21.15.136:3300/0 conn(0x7f96280addf0 msgr2=0x7f962806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 --2- 172.21.15.40:0/2285443912 >> v2:172.21.15.136:3300/0 conn(0x7f96280addf0 0x7f962806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.795+0000 7f962d0fa640 1 -- 172.21.15.40:0/2285443912 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962806c1d0 con 0x7f962815e590 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f962d0fa640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f96280b49e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96280d0dd0 tx=0x7f962402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c55e040c2958b83 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f961ffff640 1 -- 172.21.15.40:0/2285443912 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96240317c0 con 0x7f962815e590 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f961ffff640 1 -- 172.21.15.40:0/2285443912 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9624037070 con 0x7f962815e590 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f961ffff640 1 -- 172.21.15.40:0/2285443912 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9624031b80 con 0x7f962815e590 2024-04-14T09:59:37.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f962f35e640 1 -- 172.21.15.40:0/2285443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 msgr2=0x7f96280b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.796+0000 7f962f35e640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f96280b49e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f96280d0dd0 tx=0x7f962402b860 comp rx=0 tx=0).stop 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 -- 172.21.15.40:0/2285443912 shutdown_connections 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 --2- 172.21.15.40:0/2285443912 >> v2:172.21.15.136:3300/0 conn(0x7f96280addf0 0x7f962806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280b0790 0x7f96280ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 --2- 172.21.15.40:0/2285443912 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f96280b49e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 -- 172.21.15.40:0/2285443912 >> 172.21.15.40:0/2285443912 conn(0x7f96280b6540 msgr2=0x7f96280b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 -- 172.21.15.40:0/2285443912 shutdown_connections 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.797+0000 7f962f35e640 1 -- 172.21.15.40:0/2285443912 wait complete. 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.798+0000 7f962f35e640 1 Processor -- start 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.798+0000 7f962f35e640 1 -- start start 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 0x7f9628157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 0x7f9628146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f962806bcf0 con 0x7f962815e590 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9628072a40 con 0x7f96280b0790 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f962806be70 con 0x7f96280addf0 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40438/0 (socket says 172.21.15.40:40438) 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 -- 172.21.15.40:0/569495954 learned_addr learned my addr 172.21.15.40:0/569495954 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d0fa640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 0x7f9628157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962c8f9640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 0x7f9628146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 -- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 msgr2=0x7f9628157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 0x7f9628157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 -- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 msgr2=0x7f9628146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 0x7f9628146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 -- 172.21.15.40:0/569495954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9628155540 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d0fa640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 0x7f9628157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962c8f9640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 0x7f9628146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962d8fb640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9620007d40 tx=0x7f962000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620014420 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9620019070 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962815f0c0 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.799+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620014800 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.800+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96281574f0 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.800+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96280756f0 con 0x7f962815e590 2024-04-14T09:59:37.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.801+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96200149a0 con 0x7f962815e590 2024-04-14T09:59:37.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.801+0000 7f961dffb640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 0x7f960c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:37.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.801+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f962008c640 con 0x7f962815e590 2024-04-14T09:59:37.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.802+0000 7f962d0fa640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 0x7f960c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:37.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.802+0000 7f962d0fa640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 0x7f960c06edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9624036000 tx=0x7f962403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:37.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.806+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9620011260 con 0x7f962815e590 2024-04-14T09:59:37.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.991+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96280b6ac0 con 0x7f962815e590 2024-04-14T09:59:37.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.992+0000 7f961dffb640 1 -- 172.21.15.40:0/569495954 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f962005a7b0 con 0x7f962815e590 2024-04-14T09:59:37.992 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:37.992 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:37.013002+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:59:35.606234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T09:59:35.958434+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 msgr2=0x7f960c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 0x7f960c06edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9624036000 tx=0x7f962403d040 comp rx=0 tx=0).stop 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 msgr2=0x7f962815eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9620007d40 tx=0x7f962000e4b0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 shutdown_connections 2024-04-14T09:59:37.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f960c06c8f0 0x7f960c06edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f962815e590 0x7f962815eb80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96280b0790 0x7f9628146980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 --2- 172.21.15.40:0/569495954 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96280addf0 0x7f9628157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 >> 172.21.15.40:0/569495954 conn(0x7f96280b6540 msgr2=0x7f9628072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 shutdown_connections 2024-04-14T09:59:37.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:37.994+0000 7f962f35e640 1 -- 172.21.15.40:0/569495954 wait complete. 2024-04-14T09:59:38.005 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.106+0000 7f1b2dcde640 1 Processor -- start 2024-04-14T09:59:38.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 -- start start 2024-04-14T09:59:38.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b2815e510 0x7f1b280cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b280d2800 0x7f1b280d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b280ceda0 con 0x7f1b280d0e90 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1b280d31c0 con 0x7f1b280d2800 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.107+0000 7f1b2dcde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280cf040 con 0x7f1b2815e510 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b26ffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1b280d2800 0x7f1b280d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b27fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1b280d0e90 0x7f1b280d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:57736/0 (socket says 172.21.15.40:57736) 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b27fff640 1 -- 172.21.15.40:0/388561303 learned_addr learned my addr 172.21.15.40:0/388561303 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b277fe640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b2815e510 0x7f1b280cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b26ffd640 1 -- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b2815e510 msgr2=0x7f1b280cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b26ffd640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b2815e510 0x7f1b280cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b26ffd640 1 -- 172.21.15.40:0/388561303 >> v1:172.21.15.136:6789/0 conn(0x7f1b280d0e90 legacy=0x7f1b280d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b26ffd640 1 -- 172.21.15.40:0/388561303 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b280cf320 con 0x7f1b280d2800 2024-04-14T09:59:38.108 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.108+0000 7f1b267fc640 1 -- 172.21.15.40:0/388561303 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806886299 0 0) 0x7f1b280ceda0 con 0x7f1b280d0e90 2024-04-14T09:59:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b26ffd640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d2800 0x7f1b280d2c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097a0 tx=0x7f1b1c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=609d271ad8718881 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b267fc640 1 -- 172.21.15.40:0/388561303 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c0315a0 con 0x7f1b280d2800 2024-04-14T09:59:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b267fc640 1 -- 172.21.15.40:0/388561303 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1c037070 con 0x7f1b280d2800 2024-04-14T09:59:38.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b267fc640 1 -- 172.21.15.40:0/388561303 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c031960 con 0x7f1b280d2800 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 -- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d2800 msgr2=0x7f1b280d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d2800 0x7f1b280d2c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c0097a0 tx=0x7f1b1c02b840 comp rx=0 tx=0).stop 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 -- 172.21.15.40:0/388561303 shutdown_connections 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d2800 0x7f1b280d2c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/388561303 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b2815e510 0x7f1b280cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.109+0000 7f1b2dcde640 1 -- 172.21.15.40:0/388561303 >> 172.21.15.40:0/388561303 conn(0x7f1b2809d570 msgr2=0x7f1b280d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.110+0000 7f1b2dcde640 1 -- 172.21.15.40:0/388561303 shutdown_connections 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.110+0000 7f1b2dcde640 1 -- 172.21.15.40:0/388561303 wait complete. 2024-04-14T09:59:38.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.111+0000 7f1b2dcde640 1 Processor -- start 2024-04-14T09:59:38.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.111+0000 7f1b2dcde640 1 -- start start 2024-04-14T09:59:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.111+0000 7f1b2dcde640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d0e90 0x7f1b2814b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b280d2800 0x7f1b28160f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1b280b3ad0 con 0x7f1b2815e510 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2815e8f0 con 0x7f1b280d0e90 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b280b3c50 con 0x7f1b280d2800 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40452/0 (socket says 172.21.15.40:40452) 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 -- 172.21.15.40:0/3700045062 learned_addr learned my addr 172.21.15.40:0/3700045062 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b277fe640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d0e90 0x7f1b2814b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b26ffd640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b280d2800 0x7f1b28160f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 -- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b280d2800 msgr2=0x7f1b28160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b280d2800 0x7f1b28160f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 -- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d0e90 msgr2=0x7f1b2814b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d0e90 0x7f1b2814b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 -- 172.21.15.40:0/3700045062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b2815fea0 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b27fff640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c7a0 tx=0x7f1b2000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b20018070 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2000a640 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b28160180 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b2000aab0 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.112+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b28160740 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.113+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b280756f0 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.114+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b2001b070 con 0x7f1b2815e510 2024-04-14T09:59:38.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.114+0000 7f1b0ffff640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.115+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f1b2008b2f0 con 0x7f1b2815e510 2024-04-14T09:59:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.115+0000 7f1b277fe640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.115+0000 7f1b277fe640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 0x7f1b1406edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009aa0 tx=0x7f1b18009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.118 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.119+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1b20058eb0 con 0x7f1b2815e510 2024-04-14T09:59:38.303 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.304+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b280b4b70 con 0x7f1b2815e510 2024-04-14T09:59:38.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.305+0000 7f1b0ffff640 1 -- 172.21.15.40:0/3700045062 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16931 (secure 0 0 0) 0x7f1b2005d1b0 con 0x7f1b2815e510 2024-04-14T09:59:38.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:38.305 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":38,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:37.013002+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:59:35.606234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T09:59:35.958434+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 msgr2=0x7f1b1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 0x7f1b1406edb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009aa0 tx=0x7f1b18009190 comp rx=0 tx=0).stop 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 msgr2=0x7f1b280cde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1b2000c7a0 tx=0x7f1b2000cc60 comp rx=0 tx=0).stop 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 shutdown_connections 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f1b1406c8f0 0x7f1b1406edb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1b2815e510 0x7f1b280cde40 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.307 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b280d2800 0x7f1b28160f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 --2- 172.21.15.40:0/3700045062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b280d0e90 0x7f1b2814b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 >> 172.21.15.40:0/3700045062 conn(0x7f1b2809d570 msgr2=0x7f1b280b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 shutdown_connections 2024-04-14T09:59:38.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.307+0000 7f1b2dcde640 1 -- 172.21.15.40:0/3700045062 wait complete. 2024-04-14T09:59:38.318 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-14T09:59:38.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.423+0000 7f6b135aa640 1 Processor -- start 2024-04-14T09:59:38.423 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.423+0000 7f6b135aa640 1 -- start start 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b135aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 0x7f6b0c06b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b135aa640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b0c070590 0x7f6b0c06ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b135aa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b0c0b5840 con 0x7f6b0c0b4ca0 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b135aa640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6b0c0b5db0 con 0x7f6b0c070590 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b135aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0b5ad0 con 0x7f6b0c15e390 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b10b45640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6b0c070590 0x7f6b0c06ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.424 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b11b47640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6b0c0b4ca0 0x7f6b0c0b5130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52170/0 (socket says 172.21.15.40:52170) 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b11b47640 1 -- 172.21.15.40:0/2662557470 learned_addr learned my addr 172.21.15.40:0/2662557470 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.424+0000 7f6b11346640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 0x7f6b0c06b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b10b45640 1 -- 172.21.15.40:0/2662557470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 msgr2=0x7f6b0c06b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b10b45640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 0x7f6b0c06b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b10b45640 1 -- 172.21.15.40:0/2662557470 >> v1:172.21.15.40:6789/0 conn(0x7f6b0c0b4ca0 legacy=0x7f6b0c0b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b10b45640 1 -- 172.21.15.40:0/2662557470 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c0b41c0 con 0x7f6b0c070590 2024-04-14T09:59:38.425 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b11346640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 0x7f6b0c06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b10b45640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c070590 0x7f6b0c06ba60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6b000097a0 tx=0x7f6b0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522db0ea22be3c88 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.425+0000 7f6b0bfff640 1 -- 172.21.15.40:0/2662557470 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00035020 con 0x7f6b0c070590 2024-04-14T09:59:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b0bfff640 1 -- 172.21.15.40:0/2662557470 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b00031830 con 0x7f6b0c070590 2024-04-14T09:59:38.426 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b0bfff640 1 -- 172.21.15.40:0/2662557470 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b00031c00 con 0x7f6b0c070590 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 -- 172.21.15.40:0/2662557470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c070590 msgr2=0x7f6b0c06ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c070590 0x7f6b0c06ba60 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6b000097a0 tx=0x7f6b0002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 -- 172.21.15.40:0/2662557470 shutdown_connections 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c070590 0x7f6b0c06ba60 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 --2- 172.21.15.40:0/2662557470 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c15e390 0x7f6b0c06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 -- 172.21.15.40:0/2662557470 >> 172.21.15.40:0/2662557470 conn(0x7f6b0c06e680 msgr2=0x7f6b0c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 -- 172.21.15.40:0/2662557470 shutdown_connections 2024-04-14T09:59:38.427 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.426+0000 7f6b135aa640 1 -- 172.21.15.40:0/2662557470 wait complete. 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.427+0000 7f6b135aa640 1 Processor -- start 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.427+0000 7f6b135aa640 1 -- start start 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0c070590 0x7f6b0c148920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c0b4ca0 0x7f6b0c15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.429 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0ae5d0 con 0x7f6b0c15e390 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6b0c0b4780 con 0x7f6b0c070590 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b135aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6b0c0ae750 con 0x7f6b0c0b4ca0 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40462/0 (socket says 172.21.15.40:40462) 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 -- 172.21.15.40:0/1536152081 learned_addr learned my addr 172.21.15.40:0/1536152081 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b10b45640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c0b4ca0 0x7f6b0c15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11346640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0c070590 0x7f6b0c148920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 -- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c0b4ca0 msgr2=0x7f6b0c15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c0b4ca0 0x7f6b0c15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 -- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0c070590 msgr2=0x7f6b0c148920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0c070590 0x7f6b0c148920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.428+0000 7f6b11b47640 1 -- 172.21.15.40:0/1536152081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b0c1615d0 con 0x7f6b0c15e390 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b11b47640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c420 tx=0x7f6b0400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.430 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b04017070 con 0x7f6b0c15e390 2024-04-14T09:59:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b04005ce0 con 0x7f6b0c15e390 2024-04-14T09:59:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b0c160530 con 0x7f6b0c15e390 2024-04-14T09:59:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b040072d0 con 0x7f6b0c15e390 2024-04-14T09:59:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.429+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b0c160af0 con 0x7f6b0c15e390 2024-04-14T09:59:38.431 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.430+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0c0756f0 con 0x7f6b0c15e390 2024-04-14T09:59:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.430+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b0401a070 con 0x7f6b0c15e390 2024-04-14T09:59:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.431+0000 7f6b09ffb640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 0x7f6af806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.431+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f6b0408af60 con 0x7f6b0c15e390 2024-04-14T09:59:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.431+0000 7f6b11346640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 0x7f6af806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:38.432 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.431+0000 7f6b11346640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 0x7f6af806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c072680 tx=0x7f6afc009870 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:38.434 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.435+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f6b04058bb0 con 0x7f6b0c15e390 2024-04-14T09:59:38.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:38.658+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6b0c15c750 con 0x7f6b0c15e390 2024-04-14T09:59:39.658 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.659+0000 7f6b09ffb640 1 -- 172.21.15.40:0/1536152081 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f6b0405ceb0 con 0x7f6b0c15e390 2024-04-14T09:59:39.661 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 msgr2=0x7f6af806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 0x7f6af806edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c072680 tx=0x7f6afc009870 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 msgr2=0x7f6b0c1e7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6b0400c420 tx=0x7f6b0400c8e0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 shutdown_connections 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6af806c8f0 0x7f6af806edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6b0c15e390 0x7f6b0c1e7790 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0c0b4ca0 0x7f6b0c15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 --2- 172.21.15.40:0/1536152081 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b0c070590 0x7f6b0c148920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 >> 172.21.15.40:0/1536152081 conn(0x7f6b0c06e680 msgr2=0x7f6b0c072ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 shutdown_connections 2024-04-14T09:59:39.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.662+0000 7f6b135aa640 1 -- 172.21.15.40:0/1536152081 wait complete. 2024-04-14T09:59:39.675 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-14T09:59:39.675 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-14T09:59:39.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.787+0000 7ff0a0808640 1 Processor -- start 2024-04-14T09:59:39.787 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.787+0000 7ff0a0808640 1 -- start start 2024-04-14T09:59:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff0a0808640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff09c15ad30 0x7ff09c0b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:39.788 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff0a0808640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0b3a80 con 0x7ff09c0b4fa0 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff0a0808640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09c0b3d60 con 0x7ff09c0727d0 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff0a0808640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ff09c0afa10 con 0x7ff09c15ad30 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff09a59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ff09c15ad30 0x7ff09c0b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff093fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff09c0b4fa0 0x7ff09c15b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52182/0 (socket says 172.21.15.40:52182) 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff093fff640 1 -- 172.21.15.40:0/3102146821 learned_addr learned my addr 172.21.15.40:0/3102146821 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff09a59c640 1 -- 172.21.15.40:0/3102146821 >> v1:172.21.15.136:6789/0 conn(0x7ff09c0727d0 legacy=0x7ff09c1642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff09a59c640 1 -- 172.21.15.40:0/3102146821 >> v1:172.21.15.40:6789/0 conn(0x7ff09c0b4fa0 legacy=0x7ff09c15b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff09a59c640 1 -- 172.21.15.40:0/3102146821 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c0b4040 con 0x7ff09c15ad30 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.788+0000 7ff099d9b640 1 -- 172.21.15.40:0/3102146821 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 259185767 0 0) 0x7ff09c0b3a80 con 0x7ff09c0b4fa0 2024-04-14T09:59:39.789 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff09a59c640 1 --2- 172.21.15.40:0/3102146821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c15ad30 0x7ff09c0b3380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097a0 tx=0x7ff08c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aaaabd40b438449 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff099d9b640 1 -- 172.21.15.40:0/3102146821 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c034070 con 0x7ff09c15ad30 2024-04-14T09:59:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff099d9b640 1 -- 172.21.15.40:0/3102146821 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c030610 con 0x7ff09c15ad30 2024-04-14T09:59:39.790 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff099d9b640 1 -- 172.21.15.40:0/3102146821 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c0309e0 con 0x7ff09c15ad30 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff0a0808640 1 -- 172.21.15.40:0/3102146821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c15ad30 msgr2=0x7ff09c0b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.789+0000 7ff0a0808640 1 --2- 172.21.15.40:0/3102146821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c15ad30 0x7ff09c0b3380 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0097a0 tx=0x7ff08c02b960 comp rx=0 tx=0).stop 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.790+0000 7ff0a0808640 1 -- 172.21.15.40:0/3102146821 shutdown_connections 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.790+0000 7ff0a0808640 1 --2- 172.21.15.40:0/3102146821 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c15ad30 0x7ff09c0b3380 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.790+0000 7ff0a0808640 1 -- 172.21.15.40:0/3102146821 >> 172.21.15.40:0/3102146821 conn(0x7ff09c06b700 msgr2=0x7ff09c06bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.790+0000 7ff0a0808640 1 -- 172.21.15.40:0/3102146821 shutdown_connections 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.790+0000 7ff0a0808640 1 -- 172.21.15.40:0/3102146821 wait complete. 2024-04-14T09:59:39.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.791+0000 7ff0a0808640 1 Processor -- start 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.791+0000 7ff0a0808640 1 -- start start 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff09c0b4fa0 0x7ff09c152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09c15ad30 0x7ff09c152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c15b820 con 0x7ff09c0727d0 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff09c0cfbb0 con 0x7ff09c15ad30 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff0a0808640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff09c15b9a0 con 0x7ff09c0b4fa0 2024-04-14T09:59:39.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40486/0 (socket says 172.21.15.40:40486) 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 -- 172.21.15.40:0/1026295682 learned_addr learned my addr 172.21.15.40:0/1026295682 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09ad9d640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09c15ad30 0x7ff09c152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff093fff640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff09c0b4fa0 0x7ff09c152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 -- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff09c0b4fa0 msgr2=0x7ff09c152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff09c0b4fa0 0x7ff09c152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 -- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09c15ad30 msgr2=0x7ff09c152d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:39.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09c15ad30 0x7ff09c152d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 -- 172.21.15.40:0/1026295682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff09c14ebb0 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff09a59c640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0098c0 tx=0x7ff08c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.792+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c034040 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.793+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08c039a10 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.793+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff09c1535f0 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.793+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08c039de0 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.793+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff09c15a000 con 0x7ff09c0727d0 2024-04-14T09:59:39.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.793+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09c0756f0 con 0x7ff09c0727d0 2024-04-14T09:59:39.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.794+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff08c037070 con 0x7ff09c0727d0 2024-04-14T09:59:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.794+0000 7ff092ffd640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 0x7ff07c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.794+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff08c0add80 con 0x7ff09c0727d0 2024-04-14T09:59:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.795+0000 7ff093fff640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 0x7ff07c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:39.798 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.795+0000 7ff093fff640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 0x7ff07c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b1b50 tx=0x7ff084007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:39.799 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:39.799+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff08c07b940 con 0x7ff09c0727d0 2024-04-14T09:59:40.021 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.022+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff09c0b5db0 con 0x7ff09c0727d0 2024-04-14T09:59:40.680 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.680+0000 7ff092ffd640 1 -- 172.21.15.40:0/1026295682 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7ff08c07fc40 con 0x7ff09c0727d0 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 msgr2=0x7ff07c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 0x7ff07c06edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff09c0b1b50 tx=0x7ff084007e40 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 msgr2=0x7ff09c14e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0098c0 tx=0x7ff08c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 shutdown_connections 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff07c06c8f0 0x7ff07c06edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff09c15ad30 0x7ff09c152d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff09c0b4fa0 0x7ff09c152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 --2- 172.21.15.40:0/1026295682 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff09c0727d0 0x7ff09c14e670 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 >> 172.21.15.40:0/1026295682 conn(0x7ff09c06b700 msgr2=0x7ff09c0694d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 shutdown_connections 2024-04-14T09:59:40.683 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.683+0000 7ff0a0808640 1 -- 172.21.15.40:0/1026295682 wait complete. 2024-04-14T09:59:40.694 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-14T09:59:40.695 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:40.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.800+0000 7f3cd7755640 1 Processor -- start 2024-04-14T09:59:40.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 -- start start 2024-04-14T09:59:40.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cd015e570 0x7f3cd00b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3cd006e8b0 0x7f3cd006ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00adfc0 con 0x7f3cd00b0700 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd0072a10 con 0x7f3cd015e570 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd7755640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd015e950 con 0x7f3cd006e8b0 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd54f1640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f3cd015e570 0x7f3cd00b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd4cf0640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3cd00b0700 0x7f3cd00ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52186/0 (socket says 172.21.15.40:52186) 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.801+0000 7f3cd4cf0640 1 -- 172.21.15.40:0/4001255981 learned_addr learned my addr 172.21.15.40:0/4001255981 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3cd5cf2640 1 --2- 172.21.15.40:0/4001255981 >> v2:172.21.15.136:3300/0 conn(0x7f3cd006e8b0 0x7f3cd006ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3cd54f1640 1 -- 172.21.15.40:0/4001255981 >> v2:172.21.15.136:3300/0 conn(0x7f3cd006e8b0 msgr2=0x7f3cd006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3cd54f1640 1 --2- 172.21.15.40:0/4001255981 >> v2:172.21.15.136:3300/0 conn(0x7f3cd006e8b0 0x7f3cd006ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3cd54f1640 1 -- 172.21.15.40:0/4001255981 >> v1:172.21.15.40:6789/0 conn(0x7f3cd00b0700 legacy=0x7f3cd00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3ccffff640 1 -- 172.21.15.40:0/4001255981 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319265287 0 0) 0x7f3cd00adfc0 con 0x7f3cd00b0700 2024-04-14T09:59:40.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.802+0000 7f3cd54f1640 1 -- 172.21.15.40:0/4001255981 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd006c0b0 con 0x7f3cd015e570 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd54f1640 1 --2- 172.21.15.40:0/4001255981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd015e570 0x7f3cd00b49e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0072980 tx=0x7f3cc802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acfbddaee364c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3ccffff640 1 -- 172.21.15.40:0/4001255981 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80315a0 con 0x7f3cd015e570 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3ccffff640 1 -- 172.21.15.40:0/4001255981 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8037070 con 0x7f3cd015e570 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3ccffff640 1 -- 172.21.15.40:0/4001255981 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8031960 con 0x7f3cd015e570 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 -- 172.21.15.40:0/4001255981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd015e570 msgr2=0x7f3cd00b49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 --2- 172.21.15.40:0/4001255981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd015e570 0x7f3cd00b49e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0072980 tx=0x7f3cc802b840 comp rx=0 tx=0).stop 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 -- 172.21.15.40:0/4001255981 shutdown_connections 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 --2- 172.21.15.40:0/4001255981 >> v2:172.21.15.136:3300/0 conn(0x7f3cd006e8b0 0x7f3cd006ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 --2- 172.21.15.40:0/4001255981 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd015e570 0x7f3cd00b49e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 -- 172.21.15.40:0/4001255981 >> 172.21.15.40:0/4001255981 conn(0x7f3cd00b6540 msgr2=0x7f3cd00b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 -- 172.21.15.40:0/4001255981 shutdown_connections 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.803+0000 7f3cd7755640 1 -- 172.21.15.40:0/4001255981 wait complete. 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.804+0000 7f3cd7755640 1 Processor -- start 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.804+0000 7f3cd7755640 1 -- start start 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd006e8b0 0x7f3cd014b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cd015e570 0x7f3cd0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd006c390 con 0x7f3cd00b0700 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00726a0 con 0x7f3cd015e570 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd7755640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd006bcf0 con 0x7f3cd006e8b0 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd4cf0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd4cf0640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40510/0 (socket says 172.21.15.40:40510) 2024-04-14T09:59:40.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd4cf0640 1 -- 172.21.15.40:0/2825765178 learned_addr learned my addr 172.21.15.40:0/2825765178 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd54f1640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd006e8b0 0x7f3cd014b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.805+0000 7f3cd5cf2640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cd015e570 0x7f3cd0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 -- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd006e8b0 msgr2=0x7f3cd014b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd006e8b0 0x7f3cd014b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 -- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cd015e570 msgr2=0x7f3cd0160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cd015e570 0x7f3cd0160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 -- 172.21.15.40:0/2825765178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd015f4f0 con 0x7f3cd00b0700 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd4cf0640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c490 tx=0x7f3cc400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4018070 con 0x7f3cd00b0700 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc40074e0 con 0x7f3cd00b0700 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd015f7d0 con 0x7f3cd00b0700 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc4004a20 con 0x7f3cd00b0700 2024-04-14T09:59:40.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.806+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd0160070 con 0x7f3cd00b0700 2024-04-14T09:59:40.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.807+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd015f9a0 con 0x7f3cd00b0700 2024-04-14T09:59:40.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.807+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cc401b070 con 0x7f3cd00b0700 2024-04-14T09:59:40.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.808+0000 7f3ccdffb640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 0x7f3cbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.808+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3cc408aeb0 con 0x7f3cd00b0700 2024-04-14T09:59:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.808+0000 7f3cd54f1640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 0x7f3cbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:40.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.808+0000 7f3cd54f1640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 0x7f3cbc06edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8036000 tx=0x7f3cc8008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:40.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:40.812+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3cc4058b90 con 0x7f3cd00b0700 2024-04-14T09:59:41.035 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.036+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd00756f0 con 0x7f3cd00b0700 2024-04-14T09:59:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.036+0000 7f3ccdffb640 1 -- 172.21.15.40:0/2825765178 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f3cc405ce90 con 0x7f3cd00b0700 2024-04-14T09:59:41.036 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:41.036 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/430592988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":430592988},{"type":"v1","addr":"172.21.15.136:6837","nonce":430592988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1065065307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1065065307},{"type":"v1","addr":"172.21.15.40:6833","nonce":1065065307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5313,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2180057223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2180057223},{"type":"v1","addr":"172.21.15.40:6835","nonce":2180057223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:59:37.013311+0000","modified":"2024-04-14T09:59:40.023578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5329":{"gid":5329,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6836/2048712446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2048712446},{"type":"v1","addr":"172.21.15.136:6836","nonce":2048712446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5329,"qdb_cluster":[5329]},"id":2}]} 2024-04-14T09:59:41.036 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-04-14T09:59:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.038+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 msgr2=0x7f3cbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.038+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 0x7f3cbc06edb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8036000 tx=0x7f3cc8008030 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.038+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 msgr2=0x7f3cd015eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.038+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3cc400c490 tx=0x7f3cc400c950 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 shutdown_connections 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3cbc06c8f0 0x7f3cbc06edb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3cd015e570 0x7f3cd0160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3cd00b0700 0x7f3cd015eb10 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 --2- 172.21.15.40:0/2825765178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd006e8b0 0x7f3cd014b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 >> 172.21.15.40:0/2825765178 conn(0x7f3cd00b6540 msgr2=0x7f3cd00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 shutdown_connections 2024-04-14T09:59:41.039 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.039+0000 7f3cd7755640 1 -- 172.21.15.40:0/2825765178 wait complete. 2024-04-14T09:59:41.049 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:41.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.151+0000 7f3e98e0f640 1 Processor -- start 2024-04-14T09:59:41.151 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.151+0000 7f3e98e0f640 1 -- start start 2024-04-14T09:59:41.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e98e0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e98e0f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940d0210 con 0x7f3e9409aa40 2024-04-14T09:59:41.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e98e0f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e9406d740 con 0x7f3e9415e670 2024-04-14T09:59:41.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e98e0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9406da20 con 0x7f3e940b4680 2024-04-14T09:59:41.154 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e92d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3e9409aa40 0x7f3e9406f5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52190/0 (socket says 172.21.15.40:52190) 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e92d9d640 1 -- 172.21.15.40:0/2440721367 learned_addr learned my addr 172.21.15.40:0/2440721367 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e91d9b640 1 --2- 172.21.15.40:0/2440721367 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982712457 0 0) 0x7f3e940d0210 con 0x7f3e9409aa40 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e80003520 con 0x7f3e9409aa40 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192411044 0 0) 0x7f3e9406d740 con 0x7f3e9415e670 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.152+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e940d0210 con 0x7f3e9415e670 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.153+0000 7f3e91d9b640 1 -- 172.21.15.40:0/2440721367 >> v1:172.21.15.136:6789/0 conn(0x7f3e9415e670 legacy=0x7f3e940d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.153+0000 7f3e91d9b640 1 -- 172.21.15.40:0/2440721367 >> v1:172.21.15.40:6789/0 conn(0x7f3e9409aa40 legacy=0x7f3e9406f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.155 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.153+0000 7f3e91d9b640 1 -- 172.21.15.40:0/2440721367 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940d04b0 con 0x7f3e940b4680 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.153+0000 7f3e91d9b640 1 --2- 172.21.15.40:0/2440721367 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9406cff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097d0 tx=0x7f3e7c02b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b8c26788e58c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.153+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c034070 con 0x7f3e940b4680 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c030880 con 0x7f3e940b4680 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e9159a640 1 -- 172.21.15.40:0/2440721367 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c030c50 con 0x7f3e940b4680 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 -- 172.21.15.40:0/2440721367 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 msgr2=0x7f3e9406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/2440721367 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9406cff0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c0097d0 tx=0x7f3e7c02b9c0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 -- 172.21.15.40:0/2440721367 shutdown_connections 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/2440721367 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9406cff0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 -- 172.21.15.40:0/2440721367 >> 172.21.15.40:0/2440721367 conn(0x7f3e940b3b90 msgr2=0x7f3e940b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 -- 172.21.15.40:0/2440721367 shutdown_connections 2024-04-14T09:59:41.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.154+0000 7f3e98e0f640 1 -- 172.21.15.40:0/2440721367 wait complete. 2024-04-14T09:59:41.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.155+0000 7f3e98e0f640 1 Processor -- start 2024-04-14T09:59:41.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 -- start start 2024-04-14T09:59:41.160 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9409aa40 0x7f3e94161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9414f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940d16a0 con 0x7f3e9415e670 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940d0b00 con 0x7f3e9409aa40 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e98e0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9406fcb0 con 0x7f3e940b4680 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e92d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e92d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40516/0 (socket says 172.21.15.40:40516) 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e92d9d640 1 -- 172.21.15.40:0/3363511537 learned_addr learned my addr 172.21.15.40:0/3363511537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:41.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e9259c640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9409aa40 0x7f3e94161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.156+0000 7f3e91d9b640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9414f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 -- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 msgr2=0x7f3e9414f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9414f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 -- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9409aa40 msgr2=0x7f3e94161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.162 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9409aa40 0x7f3e94161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 -- 172.21.15.40:0/3363511537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b64b0 con 0x7f3e9415e670 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e92d9d640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400cb70 tx=0x7f3e8400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84017070 con 0x7f3e9415e670 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8400ad60 con 0x7f3e9415e670 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e84012640 con 0x7f3e9415e670 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e940b6790 con 0x7f3e9415e670 2024-04-14T09:59:41.163 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.157+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e940b6d50 con 0x7f3e9415e670 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.158+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e940756f0 con 0x7f3e9415e670 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.159+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e8401a070 con 0x7f3e9415e670 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.159+0000 7f3e8affd640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 0x7f3e7406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.159+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3e8408ba10 con 0x7f3e9415e670 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.159+0000 7f3e9259c640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 0x7f3e7406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.160+0000 7f3e9259c640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 0x7f3e7406ede0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c007fd0 tx=0x7f3e8c009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.164 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.163+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3e84059660 con 0x7f3e9415e670 2024-04-14T09:59:41.351 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.352+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e940b8020 con 0x7f3e9415e670 2024-04-14T09:59:41.352 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.353+0000 7f3e8affd640 1 -- 172.21.15.40:0/3363511537 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f3e8405d960 con 0x7f3e9415e670 2024-04-14T09:59:41.353 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:41.353 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:38.657511+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:59:35.606234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T09:59:35.958434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:41.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 msgr2=0x7f3e7406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 0x7f3e7406ede0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c007fd0 tx=0x7f3e8c009040 comp rx=0 tx=0).stop 2024-04-14T09:59:41.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 msgr2=0x7f3e940b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.355 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400cb70 tx=0x7f3e8400a430 comp rx=0 tx=0).stop 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 shutdown_connections 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3e7406c920 0x7f3e7406ede0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3e9415e670 0x7f3e940b7550 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e940b4680 0x7f3e9414f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 --2- 172.21.15.40:0/3363511537 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e9409aa40 0x7f3e94161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 >> 172.21.15.40:0/3363511537 conn(0x7f3e940b3b90 msgr2=0x7f3e9406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 shutdown_connections 2024-04-14T09:59:41.356 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.355+0000 7f3e98e0f640 1 -- 172.21.15.40:0/3363511537 wait complete. 2024-04-14T09:59:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-14T09:59:41.366 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:41.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 Processor -- start 2024-04-14T09:59:41.468 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 -- start start 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba9415e510 0x7fba940cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba940ceda0 con 0x7fba940d0e90 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fba940d31c0 con 0x7fba9415e510 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9918c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fba940cf040 con 0x7fba940d2800 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba92d9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fba9415e510 0x7fba940cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9359e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fba940d0e90 0x7fba940d1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52196/0 (socket says 172.21.15.40:52196) 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.469+0000 7fba9359e640 1 -- 172.21.15.40:0/2510131711 learned_addr learned my addr 172.21.15.40:0/2510131711 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:41.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba9259c640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba92d9d640 1 -- 172.21.15.40:0/2510131711 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 msgr2=0x7fba940d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba92d9d640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba92d9d640 1 -- 172.21.15.40:0/2510131711 >> v1:172.21.15.40:6789/0 conn(0x7fba940d0e90 legacy=0x7fba940d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba92d9d640 1 -- 172.21.15.40:0/2510131711 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940cf320 con 0x7fba9415e510 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.470+0000 7fba91d9b640 1 -- 172.21.15.40:0/2510131711 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995314226 0 0) 0x7fba940ceda0 con 0x7fba940d0e90 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba92d9d640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba940cfe00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f8abf8a1e53efe server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba91d9b640 1 -- 172.21.15.40:0/2510131711 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0315a0 con 0x7fba9415e510 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba91d9b640 1 -- 172.21.15.40:0/2510131711 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c037070 con 0x7fba9415e510 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba91d9b640 1 -- 172.21.15.40:0/2510131711 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c031960 con 0x7fba9415e510 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 -- 172.21.15.40:0/2510131711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 msgr2=0x7fba940cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba940cfe00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c02b840 comp rx=0 tx=0).stop 2024-04-14T09:59:41.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 -- 172.21.15.40:0/2510131711 shutdown_connections 2024-04-14T09:59:41.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 --2- 172.21.15.40:0/2510131711 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba940cfe00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 -- 172.21.15.40:0/2510131711 >> 172.21.15.40:0/2510131711 conn(0x7fba9409d570 msgr2=0x7fba940d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 -- 172.21.15.40:0/2510131711 shutdown_connections 2024-04-14T09:59:41.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.471+0000 7fba9918c640 1 -- 172.21.15.40:0/2510131711 wait complete. 2024-04-14T09:59:41.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 Processor -- start 2024-04-14T09:59:41.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 -- start start 2024-04-14T09:59:41.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba940d0e90 0x7fba9414a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940b9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fba940b3ad0 con 0x7fba9415e510 2024-04-14T09:59:41.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fba9415e8f0 con 0x7fba940d0e90 2024-04-14T09:59:41.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.473+0000 7fba9918c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fba940b3c50 con 0x7fba940d2800 2024-04-14T09:59:41.477 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40542/0 (socket says 172.21.15.40:40542) 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 -- 172.21.15.40:0/1950012222 learned_addr learned my addr 172.21.15.40:0/1950012222 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9259c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940b9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba92d9d640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba940d0e90 0x7fba9414a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 -- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 msgr2=0x7fba940b9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940b9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 -- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba940d0e90 msgr2=0x7fba9414a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba940d0e90 0x7fba9414a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 -- 172.21.15.40:0/1950012222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba94160070 con 0x7fba9415e510 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9359e640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c7a0 tx=0x7fba8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba84018070 con 0x7fba9415e510 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8400a640 con 0x7fba9415e510 2024-04-14T09:59:41.478 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba94160350 con 0x7fba9415e510 2024-04-14T09:59:41.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8400aab0 con 0x7fba9415e510 2024-04-14T09:59:41.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.474+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba94160910 con 0x7fba9415e510 2024-04-14T09:59:41.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.475+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba940756f0 con 0x7fba9415e510 2024-04-14T09:59:41.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.476+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba8401b070 con 0x7fba9415e510 2024-04-14T09:59:41.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.476+0000 7fba8b7fe640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 0x7fba7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.476+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fba8408b260 con 0x7fba9415e510 2024-04-14T09:59:41.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.476+0000 7fba92d9d640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 0x7fba7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.477+0000 7fba92d9d640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 0x7fba7406edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fba8c036000 tx=0x7fba8c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.481+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fba84058eb0 con 0x7fba9415e510 2024-04-14T09:59:41.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.663+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba940d24d0 con 0x7fba7406c8f0 2024-04-14T09:59:41.669 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.670+0000 7fba8b7fe640 1 -- 172.21.15.40:0/1950012222 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7fba940d24d0 con 0x7fba7406c8f0 2024-04-14T09:59:41.672 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:41.673 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 msgr2=0x7fba7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 0x7fba7406edb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fba8c036000 tx=0x7fba8c008030 comp rx=0 tx=0).stop 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 msgr2=0x7fba94161110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fba8400c7a0 tx=0x7fba8400cc60 comp rx=0 tx=0).stop 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 shutdown_connections 2024-04-14T09:59:41.675 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fba7406c8f0 0x7fba7406edb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fba9415e510 0x7fba94161110 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fba940d2800 0x7fba940b9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 --2- 172.21.15.40:0/1950012222 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fba940d0e90 0x7fba9414a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.672+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 >> 172.21.15.40:0/1950012222 conn(0x7fba9409d570 msgr2=0x7fba940b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.673+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 shutdown_connections 2024-04-14T09:59:41.676 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.673+0000 7fba9918c640 1 -- 172.21.15.40:0/1950012222 wait complete. 2024-04-14T09:59:41.683 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-14T09:59:40.824537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4720,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4833280,"data_stored":2729764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.189494"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671141+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:38.671141+0000","last_peered":"2024-04-14T09:59:38.671141+0000","last_clean":"2024-04-14T09:59:38.671141+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:38.671141+0000","last_undegraded":"2024-04-14T09:59:38.671141+0000","last_fullsized":"2024-04-14T09:59:38.671141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":780057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":188097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:41.687 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:41.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.825+0000 7fd10095e640 1 Processor -- start 2024-04-14T09:59:41.825 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.825+0000 7fd10095e640 1 -- start start 2024-04-14T09:59:41.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd10095e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd0fc0d2bd0 0x7fd0fc0cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd10095e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc0b4c70 con 0x7fd0fc0d2770 2024-04-14T09:59:41.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd10095e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0fc0b4f50 con 0x7fd0fc15e650 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd10095e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd0fc0b5880 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd0f9d9b640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fd0fc0d2770 0x7fd0fc0cf0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52208/0 (socket says 172.21.15.40:52208) 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd0f9d9b640 1 -- 172.21.15.40:0/1757033168 learned_addr learned my addr 172.21.15.40:0/1757033168 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.826+0000 7fd0fad9d640 1 --2- 172.21.15.40:0/1757033168 >> v2:172.21.15.136:3300/0 conn(0x7fd0fc0d2bd0 0x7fd0fc0cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245643355 0 0) 0x7fd0fc0b4f50 con 0x7fd0fc15e650 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e4003520 con 0x7fd0fc15e650 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214587407 0 0) 0x7fd0fc0b4c70 con 0x7fd0fc0d2770 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0fc0b4f50 con 0x7fd0fc0d2770 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0fad9d640 1 -- 172.21.15.40:0/1757033168 >> v1:172.21.15.136:6789/0 conn(0x7fd0fc15e650 legacy=0x7fd0fc0b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0fad9d640 1 -- 172.21.15.40:0/1757033168 >> v1:172.21.15.40:6789/0 conn(0x7fd0fc0d2770 legacy=0x7fd0fc0cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.827+0000 7fd0fad9d640 1 -- 172.21.15.40:0/1757033168 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc0b5230 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd0fad9d640 1 --2- 172.21.15.40:0/1757033168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc0cf7b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097a0 tx=0x7fd0f402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e3d92ecbffe2d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4034070 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f4030610 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd0f959a640 1 -- 172.21.15.40:0/1757033168 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f40309e0 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 -- 172.21.15.40:0/1757033168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc0d2bd0 msgr2=0x7fd0fc0cf7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 --2- 172.21.15.40:0/1757033168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc0cf7b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40097a0 tx=0x7fd0f402b960 comp rx=0 tx=0).stop 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 -- 172.21.15.40:0/1757033168 shutdown_connections 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 --2- 172.21.15.40:0/1757033168 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc0cf7b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 -- 172.21.15.40:0/1757033168 >> 172.21.15.40:0/1757033168 conn(0x7fd0fc09d580 msgr2=0x7fd0fc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 -- 172.21.15.40:0/1757033168 shutdown_connections 2024-04-14T09:59:41.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.828+0000 7fd10095e640 1 -- 172.21.15.40:0/1757033168 wait complete. 2024-04-14T09:59:41.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 Processor -- start 2024-04-14T09:59:41.831 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 -- start start 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0fc0d2770 0x7fd0fc14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc15e650 0x7fd0fc06d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0b4930 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc0d3040 con 0x7fd0fc15e650 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.830+0000 7fd10095e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd0fc0d2270 con 0x7fd0fc0d2770 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40558/0 (socket says 172.21.15.40:40558) 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 -- 172.21.15.40:0/983433106 learned_addr learned my addr 172.21.15.40:0/983433106 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0fad9d640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc15e650 0x7fd0fc06d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0fa59c640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0fc0d2770 0x7fd0fc14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 -- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0fc0d2770 msgr2=0x7fd0fc14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0fc0d2770 0x7fd0fc14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 -- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc15e650 msgr2=0x7fd0fc06d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc15e650 0x7fd0fc06d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 -- 172.21.15.40:0/983433106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc15ead0 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0f9d9b640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c410 tx=0x7fd0f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0017070 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f0005ce0 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc15ed40 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f00072f0 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.831+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc0b9780 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.832+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc0756f0 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.833+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd0f001a070 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.833+0000 7fd0eaffd640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 0x7fd0dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:41.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.833+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd0f008b040 con 0x7fd0fc0d2bd0 2024-04-14T09:59:41.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.833+0000 7fd0fa59c640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 0x7fd0dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:41.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.834+0000 7fd0fa59c640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 0x7fd0dc06ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec001ea0 tx=0x7fd0ec009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:41.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:41.838+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd0f0058d50 con 0x7fd0fc0d2bd0 2024-04-14T09:59:42.020 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.020+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd0fc0cae10 con 0x7fd0dc06c920 2024-04-14T09:59:42.026 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.026+0000 7fd0eaffd640 1 -- 172.21.15.40:0/983433106 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251957 (secure 0 0 0) 0x7fd0fc0cae10 con 0x7fd0dc06c920 2024-04-14T09:59:42.028 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:42.030 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 msgr2=0x7fd0dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.031 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 0x7fd0dc06ede0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec001ea0 tx=0x7fd0ec009040 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 msgr2=0x7fd0fc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c410 tx=0x7fd0f000c8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 shutdown_connections 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd0dc06c920 0x7fd0dc06ede0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd0fc15e650 0x7fd0fc06d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd0fc0d2bd0 0x7fd0fc06d380 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 --2- 172.21.15.40:0/983433106 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd0fc0d2770 0x7fd0fc14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 >> 172.21.15.40:0/983433106 conn(0x7fd0fc09d580 msgr2=0x7fd0fc0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 shutdown_connections 2024-04-14T09:59:42.032 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.029+0000 7fd10095e640 1 -- 172.21.15.40:0/983433106 wait complete. 2024-04-14T09:59:42.039 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2024-04-14T09:59:40.824537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220896,"kb_used_data":4720,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753824,"statfs":{"total":773094113280,"available":772867915776,"internally_reserved":0,"allocated":4833280,"data_stored":2729764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.189494"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671141+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:38.671141+0000","last_peered":"2024-04-14T09:59:38.671141+0000","last_clean":"2024-04-14T09:59:38.671141+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:38.671141+0000","last_undegraded":"2024-04-14T09:59:38.671141+0000","last_fullsized":"2024-04-14T09:59:38.671141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1048576,"data_stored":780057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":188097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:42.043 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-14T09:59:42.043 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-14T09:59:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.189+0000 7fde0e4de640 1 Processor -- start 2024-04-14T09:59:42.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.189+0000 7fde0e4de640 1 -- start start 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde0e4de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde08161ca0 0x7fde080d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde0e4de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 0x7fde080cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde0e4de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde08163040 con 0x7fde080d0c80 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde0e4de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fde080d5000 con 0x7fde08161ca0 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde0e4de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fde080cf0d0 con 0x7fde08162bb0 2024-04-14T09:59:42.191 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde08161ca0 0x7fde080d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fde08161ca0 0x7fde080d4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40574/0 (socket says 172.21.15.40:40574) 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde077fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 0x7fde080cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 -- 172.21.15.40:0/2501699176 learned_addr learned my addr 172.21.15.40:0/2501699176 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 -- 172.21.15.40:0/2501699176 >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 msgr2=0x7fde080cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 --2- 172.21.15.40:0/2501699176 >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 0x7fde080cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.190+0000 7fde07fff640 1 -- 172.21.15.40:0/2501699176 >> v1:172.21.15.136:6789/0 conn(0x7fde080d0c80 legacy=0x7fde080d1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde07fff640 1 -- 172.21.15.40:0/2501699176 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde080cf3b0 con 0x7fde08161ca0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde06ffd640 1 -- 172.21.15.40:0/2501699176 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130142483 0 0) 0x7fde08163040 con 0x7fde080d0c80 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde077fe640 1 --2- 172.21.15.40:0/2501699176 >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 0x7fde080cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde07fff640 1 --2- 172.21.15.40:0/2501699176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08161ca0 0x7fde080d4980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fde0806bd50 tx=0x7fddf802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c48ce174e8643a server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde06ffd640 1 -- 172.21.15.40:0/2501699176 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8035020 con 0x7fde08161ca0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde06ffd640 1 -- 172.21.15.40:0/2501699176 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf8031870 con 0x7fde08161ca0 2024-04-14T09:59:42.192 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.191+0000 7fde06ffd640 1 -- 172.21.15.40:0/2501699176 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf8031c40 con 0x7fde08161ca0 2024-04-14T09:59:42.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 -- 172.21.15.40:0/2501699176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08161ca0 msgr2=0x7fde080d4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2501699176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08161ca0 0x7fde080d4980 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fde0806bd50 tx=0x7fddf802b910 comp rx=0 tx=0).stop 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 -- 172.21.15.40:0/2501699176 shutdown_connections 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2501699176 >> v2:172.21.15.136:3300/0 conn(0x7fde08162bb0 0x7fde080cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2501699176 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08161ca0 0x7fde080d4980 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 -- 172.21.15.40:0/2501699176 >> 172.21.15.40:0/2501699176 conn(0x7fde0809d5c0 msgr2=0x7fde080d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 -- 172.21.15.40:0/2501699176 shutdown_connections 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.192+0000 7fde0e4de640 1 -- 172.21.15.40:0/2501699176 wait complete. 2024-04-14T09:59:42.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.193+0000 7fde0e4de640 1 Processor -- start 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.193+0000 7fde0e4de640 1 -- start start 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde080d0c80 0x7fde080c7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 0x7fde0809df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fde080ced80 con 0x7fde08162bb0 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde080d00f0 con 0x7fde080d0c80 2024-04-14T09:59:42.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0e4de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fde080b70c0 con 0x7fde08161ca0 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0ca7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde077fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 0x7fde0809df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0ca7b640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40576/0 (socket says 172.21.15.40:40576) 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde0ca7b640 1 -- 172.21.15.40:0/2969749138 learned_addr learned my addr 172.21.15.40:0/2969749138 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.194+0000 7fde07fff640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde080d0c80 0x7fde080c7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 -- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 msgr2=0x7fde0809df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 0x7fde0809df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 -- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde080d0c80 msgr2=0x7fde080c7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde080d0c80 0x7fde080c7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 -- 172.21.15.40:0/2969749138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0815d810 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde077fe640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 0x7fde0809df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0ca7b640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c730 tx=0x7fde0000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde00003b90 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde00003d50 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde080ca760 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0000aa90 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.195+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0815d2b0 con 0x7fde08162bb0 2024-04-14T09:59:42.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.196+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde08075760 con 0x7fde08162bb0 2024-04-14T09:59:42.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.196+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde0000ac30 con 0x7fde08162bb0 2024-04-14T09:59:42.200 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.197+0000 7fde04ff9640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 0x7fddf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.197+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fde0008ba20 con 0x7fde08162bb0 2024-04-14T09:59:42.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.197+0000 7fde07fff640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 0x7fddf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.197+0000 7fde07fff640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 0x7fddf406edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fddf8036000 tx=0x7fddf803c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.201 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.201+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fde0815d810 con 0x7fde08162bb0 2024-04-14T09:59:42.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.454+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fde080d0a60 con 0x7fde08162bb0 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.456+0000 7fde04ff9640 1 -- 172.21.15.40:0/2969749138 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fde00059700 con 0x7fde08162bb0 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stdout:[client.0] 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stdout: key = AQCFqBtmNaVvDRAArav1w+NRz/ut7W3ZfHpvpg== 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stdout: caps mds = "allow" 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stdout: caps mon = "allow r" 2024-04-14T09:59:42.456 INFO:teuthology.orchestra.run.smithi040.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-04-14T09:59:42.457 INFO:teuthology.orchestra.run.smithi040.stderr:updated caps for client.0 2024-04-14T09:59:42.458 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 msgr2=0x7fddf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 0x7fddf406edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fddf8036000 tx=0x7fddf803c040 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 msgr2=0x7fde0815cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c730 tx=0x7fde0000cbf0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 shutdown_connections 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fddf406c8f0 0x7fddf406edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fde08162bb0 0x7fde0815cd70 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde08161ca0 0x7fde0809df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 --2- 172.21.15.40:0/2969749138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde080d0c80 0x7fde080c7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.458+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 >> 172.21.15.40:0/2969749138 conn(0x7fde0809d5c0 msgr2=0x7fde0806d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.459+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 shutdown_connections 2024-04-14T09:59:42.459 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.459+0000 7fde0e4de640 1 -- 172.21.15.40:0/2969749138 wait complete. 2024-04-14T09:59:42.469 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T09:59:42.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.571+0000 7f940542d640 1 Processor -- start 2024-04-14T09:59:42.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.571+0000 7f940542d640 1 -- start start 2024-04-14T09:59:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.571+0000 7f940542d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f940015c2b0 0x7f94000cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.571+0000 7f940542d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f940015c690 0x7f94000cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.571+0000 7f940542d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94000ccce0 con 0x7f94000b4680 2024-04-14T09:59:42.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f940542d640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f94000d01b0 con 0x7f940015c690 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f940542d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f94000cdfa0 con 0x7f940015c2b0 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f940015c690 0x7f94000cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f940015c690 0x7f94000cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40590/0 (socket says 172.21.15.40:40590) 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 -- 172.21.15.40:0/1254145537 learned_addr learned my addr 172.21.15.40:0/1254145537 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93feffd640 1 --2- 172.21.15.40:0/1254145537 >> v2:172.21.15.136:3300/0 conn(0x7f940015c2b0 0x7f94000cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 -- 172.21.15.40:0/1254145537 >> v2:172.21.15.136:3300/0 conn(0x7f940015c2b0 msgr2=0x7f94000cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 --2- 172.21.15.40:0/1254145537 >> v2:172.21.15.136:3300/0 conn(0x7f940015c2b0 0x7f94000cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 -- 172.21.15.40:0/1254145537 >> v1:172.21.15.136:6789/0 conn(0x7f94000b4680 legacy=0x7f940009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.572+0000 7f93f7fff640 1 -- 172.21.15.40:0/1254145537 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94000ccf80 con 0x7f940015c690 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f93f7fff640 1 --2- 172.21.15.40:0/1254145537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c690 0x7f94000cda60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f94000727a0 tx=0x7f93e802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd746fcdf8e4af5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f93fe7fc640 1 -- 172.21.15.40:0/1254145537 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8034070 con 0x7f940015c690 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f93fe7fc640 1 -- 172.21.15.40:0/1254145537 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e8030860 con 0x7f940015c690 2024-04-14T09:59:42.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f93fe7fc640 1 -- 172.21.15.40:0/1254145537 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8030c30 con 0x7f940015c690 2024-04-14T09:59:42.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 -- 172.21.15.40:0/1254145537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c690 msgr2=0x7f94000cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 --2- 172.21.15.40:0/1254145537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c690 0x7f94000cda60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f94000727a0 tx=0x7f93e802b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 -- 172.21.15.40:0/1254145537 shutdown_connections 2024-04-14T09:59:42.576 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 --2- 172.21.15.40:0/1254145537 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c690 0x7f94000cda60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 --2- 172.21.15.40:0/1254145537 >> v2:172.21.15.136:3300/0 conn(0x7f940015c2b0 0x7f94000cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.573+0000 7f940542d640 1 -- 172.21.15.40:0/1254145537 >> 172.21.15.40:0/1254145537 conn(0x7f94000b3b90 msgr2=0x7f94000b3f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.574+0000 7f940542d640 1 -- 172.21.15.40:0/1254145537 shutdown_connections 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.574+0000 7f940542d640 1 -- 172.21.15.40:0/1254145537 wait complete. 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 Processor -- start 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 -- start start 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 0x7f94000c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 0x7f94000b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f94000d03e0 con 0x7f940015c2b0 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f94000cd540 con 0x7f9400158360 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f940542d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f940009b150 con 0x7f94000b4680 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f93f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.577 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f93f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40594/0 (socket says 172.21.15.40:40594) 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.575+0000 7f93f7fff640 1 -- 172.21.15.40:0/114111529 learned_addr learned my addr 172.21.15.40:0/114111529 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93feffd640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 0x7f94000c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93ff7fe640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 0x7f94000b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 -- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 msgr2=0x7f94000c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 0x7f94000c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 -- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 msgr2=0x7f94000b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 0x7f94000b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 -- 172.21.15.40:0/114111529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9400158870 con 0x7f940015c2b0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93feffd640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 0x7f94000c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93ff7fe640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 0x7f94000b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f7fff640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f93e802b9e0 tx=0x7f93e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8034040 con 0x7f940015c2b0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e8039d90 con 0x7f940015c2b0 2024-04-14T09:59:42.578 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9400158b50 con 0x7f940015c2b0 2024-04-14T09:59:42.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e8043610 con 0x7f940015c2b0 2024-04-14T09:59:42.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.576+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f940015d860 con 0x7f940015c2b0 2024-04-14T09:59:42.579 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.577+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94000756f0 con 0x7f940015c2b0 2024-04-14T09:59:42.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.578+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93e8037070 con 0x7f940015c2b0 2024-04-14T09:59:42.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.578+0000 7f93f77fe640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:42.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.578+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f93e80ade40 con 0x7f940015c2b0 2024-04-14T09:59:42.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.578+0000 7f93feffd640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:42.580 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.579+0000 7f93feffd640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 0x7f93e006edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009b90 tx=0x7f93f0008040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:42.582 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.582+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f93e803e070 con 0x7f940015c2b0 2024-04-14T09:59:42.631 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-04-14T09:59:42.631+0000 7f78335f1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-14T09:59:42.806 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.807+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94000b8020 con 0x7f940015c2b0 2024-04-14T09:59:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.807+0000 7f93f77fe640 1 -- 172.21.15.40:0/114111529 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7f93e807c050 con 0x7f940015c2b0 2024-04-14T09:59:42.807 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:42.807 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/430592988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":430592988},{"type":"v1","addr":"172.21.15.136:6837","nonce":430592988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1065065307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1065065307},{"type":"v1","addr":"172.21.15.40:6833","nonce":1065065307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5313,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2180057223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2180057223},{"type":"v1","addr":"172.21.15.40:6835","nonce":2180057223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:59:37.013311+0000","modified":"2024-04-14T09:59:40.023578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5329":{"gid":5329,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6836/2048712446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2048712446},{"type":"v1","addr":"172.21.15.136:6836","nonce":2048712446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5329,"qdb_cluster":[5329]},"id":2}]} 2024-04-14T09:59:42.807 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 msgr2=0x7f93e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 0x7f93e006edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009b90 tx=0x7f93f0008040 comp rx=0 tx=0).stop 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 msgr2=0x7f9400157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f93e802b9e0 tx=0x7f93e80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 shutdown_connections 2024-04-14T09:59:42.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f93e006c8f0 0x7f93e006edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9400158360 0x7f94000b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f940015c2b0 0x7f9400157e20 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 --2- 172.21.15.40:0/114111529 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f94000b4680 0x7f94000c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 >> 172.21.15.40:0/114111529 conn(0x7f94000b3b90 msgr2=0x7f94000b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 shutdown_connections 2024-04-14T09:59:42.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:42.809+0000 7f940542d640 1 -- 172.21.15.40:0/114111529 wait complete. 2024-04-14T09:59:43.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-14T09:59:37.013311+0000', 'modified': '2024-04-14T09:59:40.023578+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5329}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5329': {'gid': 5329, 'name': 'd', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6836/2048712446', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6834', 'nonce': 2048712446}, {'type': 'v1', 'addr': '172.21.15.136:6836', 'nonce': 2048712446}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5329, 'qdb_cluster': [5329]} 2024-04-14T09:59:43.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-14T09:59:43.222 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-14T09:59:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 Processor -- start 2024-04-14T09:59:43.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 -- start start 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7500161c80 0x7f75000d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f75000d13d0 0x7f75000b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75000b10e0 con 0x7f75000d2e50 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f75000b1380 con 0x7f7500161c80 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.329+0000 7f750520f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f75000b1660 con 0x7f75000d13d0 2024-04-14T09:59:43.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f7500161c80 0x7f75000d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74f7fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f75000d2e50 0x7f75000d0cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52216/0 (socket says 172.21.15.40:52216) 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74f7fff640 1 -- 172.21.15.40:0/2358545333 learned_addr learned my addr 172.21.15.40:0/2358545333 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74ff59e640 1 --2- 172.21.15.40:0/2358545333 >> v2:172.21.15.136:3300/0 conn(0x7f75000d13d0 0x7f75000b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fed9d640 1 -- 172.21.15.40:0/2358545333 >> v2:172.21.15.136:3300/0 conn(0x7f75000d13d0 msgr2=0x7f75000b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fed9d640 1 --2- 172.21.15.40:0/2358545333 >> v2:172.21.15.136:3300/0 conn(0x7f75000d13d0 0x7f75000b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fed9d640 1 -- 172.21.15.40:0/2358545333 >> v1:172.21.15.40:6789/0 conn(0x7f75000d2e50 legacy=0x7f75000d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fed9d640 1 -- 172.21.15.40:0/2358545333 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75000d3340 con 0x7f7500161c80 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.330+0000 7f74fe59c640 1 -- 172.21.15.40:0/2358545333 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499098819 0 0) 0x7f75000b10e0 con 0x7f75000d2e50 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f74fed9d640 1 --2- 172.21.15.40:0/2358545333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7500161c80 0x7f75000d2910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f75000b6ef0 tx=0x7f74f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2485b4cbfa2b4fbb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f74fe59c640 1 -- 172.21.15.40:0/2358545333 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f00315a0 con 0x7f7500161c80 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f74fe59c640 1 -- 172.21.15.40:0/2358545333 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f0037070 con 0x7f7500161c80 2024-04-14T09:59:43.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f74fe59c640 1 -- 172.21.15.40:0/2358545333 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0031960 con 0x7f7500161c80 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 -- 172.21.15.40:0/2358545333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7500161c80 msgr2=0x7f75000d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 --2- 172.21.15.40:0/2358545333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7500161c80 0x7f75000d2910 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f75000b6ef0 tx=0x7f74f002b840 comp rx=0 tx=0).stop 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 -- 172.21.15.40:0/2358545333 shutdown_connections 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 --2- 172.21.15.40:0/2358545333 >> v2:172.21.15.136:3300/0 conn(0x7f75000d13d0 0x7f75000b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 --2- 172.21.15.40:0/2358545333 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f7500161c80 0x7f75000d2910 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 -- 172.21.15.40:0/2358545333 >> 172.21.15.40:0/2358545333 conn(0x7f750009d5e0 msgr2=0x7f75000d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 -- 172.21.15.40:0/2358545333 shutdown_connections 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.331+0000 7f750520f640 1 -- 172.21.15.40:0/2358545333 wait complete. 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 Processor -- start 2024-04-14T09:59:43.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 -- start start 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75000d2e50 0x7f75000b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7500161c80 0x7f75001f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75000b23a0 con 0x7f75000d13d0 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f75000d0390 con 0x7f75000d2e50 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f750520f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f75000b2520 con 0x7f7500161c80 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.333+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40618/0 (socket says 172.21.15.40:40618) 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 -- 172.21.15.40:0/3812799238 learned_addr learned my addr 172.21.15.40:0/3812799238 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74f7fff640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75000d2e50 0x7f75000b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74ff59e640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7500161c80 0x7f75001f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 -- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7500161c80 msgr2=0x7f75001f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7500161c80 0x7f75001f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 -- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75000d2e50 msgr2=0x7f75000b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75000d2e50 0x7f75000b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 -- 172.21.15.40:0/3812799238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75000b93d0 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74fed9d640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034040 tx=0x7f74f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74f77fe640 1 -- 172.21.15.40:0/3812799238 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0032630 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74f77fe640 1 -- 172.21.15.40:0/3812799238 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f00327d0 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75000b9640 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f74f77fe640 1 -- 172.21.15.40:0/3812799238 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0032bc0 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.334+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75000b9c00 con 0x7f75000d13d0 2024-04-14T09:59:43.337 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.336+0000 7f74f77fe640 1 -- 172.21.15.40:0/3812799238 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74f003b3f0 con 0x7f75000d13d0 2024-04-14T09:59:43.343 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.336+0000 7f74f77fe640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 0x7f74e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.336+0000 7f74f77fe640 1 -- 172.21.15.40:0/3812799238 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f74f002f030 con 0x7f75000d13d0 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.336+0000 7f74f7fff640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 0x7f74e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.337+0000 7f74f7fff640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 0x7f74e006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007f70 tx=0x7f74e8007f00 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.337+0000 7f7507ffc740 1 Processor -- start 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.337+0000 7f7507ffc740 1 -- start start 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x55968250a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596824db040 0x55968250ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x559682444030 con 0x559682507b60 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5596823ec620 con 0x5596824db040 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55968243ffe0 con 0x559682507f40 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.344 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40632/0 (socket says 172.21.15.40:40632) 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 -- 172.21.15.40:0/1345634611 learned_addr learned my addr 172.21.15.40:0/1345634611 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74ff59e640 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596824db040 0x55968250ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74f7fff640 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x55968250a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 -- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 msgr2=0x55968250a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x55968250a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 -- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596824db040 msgr2=0x55968250ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596824db040 0x55968250ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 -- 172.21.15.40:0/1345634611 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596821582d0 con 0x559682507b60 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74fed9d640 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74f0077ad0 tx=0x7f74f007afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0962d6ce4aaaad5 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74f4ff9640 1 -- 172.21.15.40:0/1345634611 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f00aa070 con 0x559682507b60 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74f4ff9640 1 -- 172.21.15.40:0/1345634611 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f0037070 con 0x559682507b60 2024-04-14T09:59:43.345 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.338+0000 7f74f4ff9640 1 -- 172.21.15.40:0/1345634611 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f00841a0 con 0x559682507b60 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 -- 172.21.15.40:0/1345634611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 msgr2=0x5596824dab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74f0077ad0 tx=0x7f74f007afd0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 -- 172.21.15.40:0/1345634611 shutdown_connections 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x5596824db040 0x55968250ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x55968250a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 --2- 172.21.15.40:0/1345634611 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x5596824dab00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 -- 172.21.15.40:0/1345634611 >> 172.21.15.40:0/1345634611 conn(0x5596824dcd70 msgr2=0x5596825258f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 -- 172.21.15.40:0/1345634611 shutdown_connections 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.339+0000 7f7507ffc740 1 -- 172.21.15.40:0/1345634611 wait complete. 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 -- start start 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 Processor -- start 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682503560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.346 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682539cb0 0x559682539060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5596823ec620 con 0x559682507f40 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x5596823ff9e0 con 0x559682507b60 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x559682444030 con 0x559682539cb0 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.340+0000 7f7507ffc740 10 client.0 _ll_register_callbacks cb 0x55968243c080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40640/0 (socket says 172.21.15.40:40640) 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 -- 172.21.15.40:0/735931680 learned_addr learned my addr 172.21.15.40:0/735931680 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74fed9d640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682503560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ff59e640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682539cb0 0x559682539060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 -- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682539cb0 msgr2=0x559682539060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682539cb0 0x559682539060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.347 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 -- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 msgr2=0x559682503560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682503560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 -- 172.21.15.40:0/735931680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596822226b0 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74f7fff640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000c00 tx=0x7f74e8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8ae767d4928196 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e8020580 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f74e801b9d0 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f0037070 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f74e801bbd0 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f7507ffc740 10 client.5487 fetch_fsmap learned FSMap version 17 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x559682502d60 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f0037070 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.341+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f74e8020720 con 0x559682507f40 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 10 client.5487 fetch_fsmap finished waiting for FSMap version 17 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 10 client.5487 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:59:43.348 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 20 client.5487 populate_metadata read hostname 'smithi040' 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x559682508b70 0x559682536410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 4 client.5487 mds_command: new command op to 5329 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 --> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596823ebcc0 con 0x559682508b70 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f74fed9d640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x559682508b70 0x559682536410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f74fed9d640 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x559682508b70 0x559682536410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab5609118d85507f server_cookie=1d210dd2d5a15786 in_seq=0 out_seq=0 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.342+0000 7f74ddffb640 10 client.5487 ms_handle_connect on v2:172.21.15.136:6834/2048712446 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f74ddffb640 1 -- 172.21.15.40:0/735931680 <== mds.0 v2:172.21.15.136:6834/2048712446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5596823ebcc0 con 0x559682508b70 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f74ddffb640 10 client.5487 handle_command_reply: tid=0 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 client.5487 shutdown 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 msgr2=0x559682500760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000c00 tx=0x7f74e8007d10 comp rx=0 tx=0).stop 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 shutdown_connections 2024-04-14T09:59:43.349 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x559682508b70 0x559682536410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682539cb0 0x559682539060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f74ddffb640 0 client.5487 ms_handle_reset on v2:172.21.15.136:6834/2048712446 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507f40 0x559682500760 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 --2- 172.21.15.40:0/735931680 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682503560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 >> 172.21.15.40:0/735931680 conn(0x5596824db040 msgr2=0x5596824dec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 shutdown_connections 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 1 -- 172.21.15.40:0/735931680 wait complete. 2024-04-14T09:59:43.350 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.343+0000 7f7507ffc740 20 client.5487 trim_cache size 0 max 16384 2024-04-14T09:59:43.360 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.361+0000 7f7507ffc740 1 Processor -- start 2024-04-14T09:59:43.361 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.361+0000 7f7507ffc740 1 -- start start 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682538de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596824de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f75001ffc70 con 0x559682539cb0 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f75001fefd0 con 0x559682507b60 2024-04-14T09:59:43.363 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f75001ff620 con 0x559682507f40 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40644/0 (socket says 172.21.15.40:40644) 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 -- 172.21.15.40:0/2962419751 learned_addr learned my addr 172.21.15.40:0/2962419751 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74f7fff640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596824de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74fed9d640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682538de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 -- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 msgr2=0x5596824de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596824de9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 -- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 msgr2=0x559682538de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682538de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74ff59e640 1 -- 172.21.15.40:0/2962419751 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596824e1ab0 con 0x559682539cb0 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.362+0000 7f74f7fff640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596824de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f74ff59e640 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f750008e6f0 tx=0x7f74f8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad033b712a5cc052 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.364 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f74dffff640 1 -- 172.21.15.40:0/2962419751 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f8024070 con 0x559682539cb0 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f74dffff640 1 -- 172.21.15.40:0/2962419751 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f8017d80 con 0x559682539cb0 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f74dffff640 1 -- 172.21.15.40:0/2962419751 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f801f670 con 0x559682539cb0 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 -- 172.21.15.40:0/2962419751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 msgr2=0x5596825484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f750008e6f0 tx=0x7f74f8009750 comp rx=0 tx=0).stop 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 -- 172.21.15.40:0/2962419751 shutdown_connections 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682539cb0 0x5596825484f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596824de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 --2- 172.21.15.40:0/2962419751 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682507b60 0x559682538de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 -- 172.21.15.40:0/2962419751 >> 172.21.15.40:0/2962419751 conn(0x5596824db040 msgr2=0x5596824d5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 -- 172.21.15.40:0/2962419751 shutdown_connections 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.363+0000 7f7507ffc740 1 -- 172.21.15.40:0/2962419751 wait complete. 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.364+0000 7f7507ffc740 1 -- start start 2024-04-14T09:59:43.365 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.364+0000 7f7507ffc740 1 Processor -- start 2024-04-14T09:59:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596825484f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682539cb0 0x559682548a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x5596825089f0 con 0x559682507b60 2024-04-14T09:59:43.369 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559682502520 con 0x559682539cb0 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x559682509040 con 0x559682507f40 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 10 client.0 _ll_register_callbacks cb 0x7f74e8004c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40652/0 (socket says 172.21.15.40:40652) 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 -- 172.21.15.40:0/4027029809 learned_addr learned my addr 172.21.15.40:0/4027029809 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74f7fff640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596825484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74ff59e640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682539cb0 0x559682548a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 -- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 msgr2=0x5596825484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596825484f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 -- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682539cb0 msgr2=0x559682548a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682539cb0 0x559682548a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 -- 172.21.15.40:0/4027029809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596825390e0 con 0x559682507b60 2024-04-14T09:59:43.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74fed9d640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f74f007b010 tx=0x7f74f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffb25d0e2f49c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.40:3300/0 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f009f060 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mon.0 v2:172.21.15.40:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f74f0079710 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74f8017d80 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f74f00a5050 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 10 client.5493 fetch_fsmap learned FSMap version 17 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.365+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x559682507410 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mon.0 v2:172.21.15.40:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f8017d80 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mon.0 v2:172.21.15.40:3300/0 5 ==== fsmap(e 17) ==== 3494+0+0 (secure 0 0 0) 0x7f74f004c070 con 0x559682507b60 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 10 client.5493 fetch_fsmap finished waiting for FSMap version 17 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 10 client.5493 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 20 client.5493 populate_metadata read hostname 'smithi040' 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x5596825850e0 0x5596825854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 4 client.5493 mds_command: new command op to 5329 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-14T09:59:43.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 --> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] -- command(tid 0: {"prefix": "status"}) -- 0x559682451570 con 0x5596825850e0 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74f7fff640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x5596825850e0 0x5596825854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74ddffb640 10 client.5493 ms_handle_connect on v2:172.21.15.136:6834/2048712446 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74f7fff640 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x5596825850e0 0x5596825854c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928304f6e56c363a server_cookie=4eab95a70b2f0e91 in_seq=0 out_seq=0 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74ddffb640 1 -- 172.21.15.40:0/4027029809 <== mds.0 v2:172.21.15.136:6834/2048712446 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559682451570 con 0x5596825850e0 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f74ddffb640 10 client.5493 handle_command_reply: tid=0 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 1 client.5493 shutdown 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.366+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 msgr2=0x559682582680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f74f007b010 tx=0x7f74f0000bc0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 shutdown_connections 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:6834/2048712446,v1:172.21.15.136:6836/2048712446] conn(0x5596825850e0 0x5596825854c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559682539cb0 0x559682548a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559682507f40 0x5596825484f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f74ddffb640 0 client.5493 ms_handle_reset on v2:172.21.15.136:6834/2048712446 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 --2- 172.21.15.40:0/4027029809 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x559682507b60 0x559682582680 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.372 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 >> 172.21.15.40:0/4027029809 conn(0x5596824db040 msgr2=0x559682505330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 shutdown_connections 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 1 -- 172.21.15.40:0/4027029809 wait complete. 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f7507ffc740 20 client.5493 trim_cache size 0 max 16384 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "cluster_fsid": "131eb2ba-6185-454c-b8ac-0bdd05152d4d", 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "whoami": 0, 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "id": 5329, 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "want_state": "up:active", 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "state": "up:active", 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "fs_name": "cephfs", 2024-04-14T09:59:43.373 INFO:teuthology.orchestra.run.smithi040.stdout: "rank_uptime": 5.7083337250000001, 2024-04-14T09:59:43.374 INFO:teuthology.orchestra.run.smithi040.stdout: "mdsmap_epoch": 17, 2024-04-14T09:59:43.374 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch": 39, 2024-04-14T09:59:43.374 INFO:teuthology.orchestra.run.smithi040.stdout: "osdmap_epoch_barrier": 39, 2024-04-14T09:59:43.374 INFO:teuthology.orchestra.run.smithi040.stdout: "uptime": 12.593738075999999 2024-04-14T09:59:43.374 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 msgr2=0x7f74e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 0x7f74e006edb0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74e8007f70 tx=0x7f74e8007f00 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 msgr2=0x7f75000cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034040 tx=0x7f74f00046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 shutdown_connections 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f74e006c8f0 0x7f74e006edb0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7500161c80 0x7f75001f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f75000d2e50 0x7f75000b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 --2- 172.21.15.40:0/3812799238 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f75000d13d0 0x7f75000cc980 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 >> 172.21.15.40:0/3812799238 conn(0x7f750009d5e0 msgr2=0x7f75000b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 shutdown_connections 2024-04-14T09:59:43.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.367+0000 7f750520f640 1 -- 172.21.15.40:0/3812799238 wait complete. 2024-04-14T09:59:43.377 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-14T09:59:43.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.479+0000 7f05961e9640 1 Processor -- start 2024-04-14T09:59:43.479 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.479+0000 7f05961e9640 1 -- start start 2024-04-14T09:59:43.480 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f05961e9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f05961e9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f05900cf0a0 0x7f05900cf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f05961e9640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05900b4c70 con 0x7f059015e650 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f05961e9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f05900d3110 con 0x7f05900cf0a0 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f05961e9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f05900b5880 con 0x7f05900d2770 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f058f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f059015e650 0x7f05900b4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:52232/0 (socket says 172.21.15.40:52232) 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f058f7fe640 1 -- 172.21.15.40:0/2477506177 learned_addr learned my addr 172.21.15.40:0/2477506177 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f058effd640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.480+0000 7f058ffff640 1 --2- 172.21.15.40:0/2477506177 >> v2:172.21.15.136:3300/0 conn(0x7f05900cf0a0 0x7f05900cf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058e7fc640 1 -- 172.21.15.40:0/2477506177 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405527282 0 0) 0x7f05900b4c70 con 0x7f059015e650 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058e7fc640 1 -- 172.21.15.40:0/2477506177 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0578003520 con 0x7f059015e650 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058ffff640 1 -- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 msgr2=0x7f05900d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:43.481 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058ffff640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058ffff640 1 -- 172.21.15.40:0/2477506177 >> v1:172.21.15.40:6789/0 conn(0x7f059015e650 legacy=0x7f05900b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058ffff640 1 -- 172.21.15.40:0/2477506177 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05900b4f50 con 0x7f05900cf0a0 2024-04-14T09:59:43.482 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.481+0000 7f058effd640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f058ffff640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f05900cf530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f058802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f576fad5d6c3d1c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f058e7fc640 1 -- 172.21.15.40:0/2477506177 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588039070 con 0x7f05900cf0a0 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f058e7fc640 1 -- 172.21.15.40:0/2477506177 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058802cc50 con 0x7f05900cf0a0 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f058e7fc640 1 -- 172.21.15.40:0/2477506177 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588034440 con 0x7f05900cf0a0 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 -- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 msgr2=0x7f05900cf530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.483 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f05900cf530 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f058802bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 -- 172.21.15.40:0/2477506177 shutdown_connections 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 --2- 172.21.15.40:0/2477506177 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f05900cf530 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 -- 172.21.15.40:0/2477506177 >> 172.21.15.40:0/2477506177 conn(0x7f059009d580 msgr2=0x7f05900d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 -- 172.21.15.40:0/2477506177 shutdown_connections 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.482+0000 7f05961e9640 1 -- 172.21.15.40:0/2477506177 wait complete. 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.483+0000 7f05961e9640 1 Processor -- start 2024-04-14T09:59:43.484 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 -- start start 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f0590160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b4930 con 0x7f059015e650 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f05900b5510 con 0x7f05900cf0a0 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f05961e9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f05900d2270 con 0x7f05900d2770 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f058ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f058ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:40666/0 (socket says 172.21.15.40:40666) 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f058ffff640 1 -- 172.21.15.40:0/1146317131 learned_addr learned my addr 172.21.15.40:0/1146317131 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f058f7fe640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f0590160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.484+0000 7f058effd640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.487 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 -- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 msgr2=0x7f05900cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 -- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 msgr2=0x7f0590160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f0590160060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 -- 172.21.15.40:0/1146317131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05901605a0 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058f7fe640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f0590160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f058ffff640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f0588004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588044020 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f058802ca50 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05901f3ec0 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588039040 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.485+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05900cb700 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.486+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05900756f0 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.487+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0588047020 con 0x7f059015e650 2024-04-14T09:59:43.488 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.487+0000 7f0577fff640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 0x7f057c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:43.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.487+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f05880ae3b0 con 0x7f059015e650 2024-04-14T09:59:43.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.487+0000 7f058f7fe640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 0x7f057c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:43.489 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.488+0000 7f058f7fe640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 0x7f057c06edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0580005880 tx=0x7f0580009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:43.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.491+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f058804e030 con 0x7f059015e650 2024-04-14T09:59:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.720+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f05900b2930 con 0x7f059015e650 2024-04-14T09:59:43.720 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.721+0000 7f0577fff640 1 -- 172.21.15.40:0/1146317131 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f058802cc20 con 0x7f059015e650 2024-04-14T09:59:43.720 INFO:teuthology.orchestra.run.smithi040.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 msgr2=0x7f057c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 0x7f057c06edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0580005880 tx=0x7f0580009040 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 msgr2=0x7f05900cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f0588009d90 tx=0x7f0588004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 shutdown_connections 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f057c06c8f0 0x7f057c06edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f059015e650 0x7f05900cc4c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f05900d2770 0x7f05900cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 --2- 172.21.15.40:0/1146317131 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f05900cf0a0 0x7f0590160060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 >> 172.21.15.40:0/1146317131 conn(0x7f059009d580 msgr2=0x7f05900d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:43.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 shutdown_connections 2024-04-14T09:59:43.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43.723+0000 7f05961e9640 1 -- 172.21.15.40:0/1146317131 wait complete. 2024-04-14T09:59:43.733 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-14T09:59:43.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-14T09:59:43.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi040.front.sepia.ceph.com 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-14T09:59:43.734 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T09:59:43.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:43.738 DEBUG:teuthology.orchestra.run.smithi040:> ip addr 2024-04-14T09:59:43.753 INFO:teuthology.orchestra.run.smithi040.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-14T09:59:43.753 INFO:teuthology.orchestra.run.smithi040.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-14T09:59:43.753 INFO:teuthology.orchestra.run.smithi040.stdout: inet 127.0.0.1/8 scope host lo 2024-04-14T09:59:43.753 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 ::1/128 scope host 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:16 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f0 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:6b:fd:17 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp7s0f1 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cc brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f0 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: inet 172.21.15.40/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft 42607sec preferred_lft 42607sec 2024-04-14T09:59:43.754 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::ec4:7aff:febd:12cc/64 scope link noprefixroute 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0c:c4:7a:bd:12:cd brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: altname enp1s0f1 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0a:1e:c4:40:9a:89 brd ff:ff:ff:ff:ff:ff 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::b4b2:99ff:fea2:3b81/64 scope link 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether 0a:1e:c4:40:9a:89 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T09:59:43.755 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::81e:c4ff:fe40:9a89/64 scope link 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run.smithi040.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run.smithi040.stdout: link/ether ea:81:87:77:11:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run.smithi040.stdout: inet6 fe80::e881:87ff:fe77:11cd/64 scope link 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run.smithi040.stdout: valid_lft forever preferred_lft forever 2024-04-14T09:59:43.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:43.756 DEBUG:teuthology.orchestra.run.smithi040:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-14T09:59:43.819 INFO:teuthology.orchestra.run.smithi040.stdout:1 2024-04-14T09:59:43.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:43.820 DEBUG:teuthology.orchestra.run.smithi040:> route 2024-04-14T09:59:43.875 INFO:teuthology.orchestra.run.smithi040.stdout:Kernel IP routing table 2024-04-14T09:59:43.875 INFO:teuthology.orchestra.run.smithi040.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-14T09:59:43.875 INFO:teuthology.orchestra.run.smithi040.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-04-14T09:59:43.875 INFO:teuthology.orchestra.run.smithi040.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-04-14T09:59:43.875 INFO:teuthology.orchestra.run.smithi040.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-14T09:59:43.875 DEBUG:teuthology.orchestra.run.smithi040:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-14T09:59:43.876 DEBUG:teuthology.orchestra.run.smithi040:> set -e 2024-04-14T09:59:43.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-14T09:59:43.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-14T09:59:43.876 DEBUG:teuthology.orchestra.run.smithi040:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-14T09:59:43.876 DEBUG:teuthology.orchestra.run.smithi040:> ') 2024-04-14T09:59:43.963 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-14T09:59:44.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:44.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.010 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:59:44.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-14T09:59:44.024 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T09:59:44.024 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-14T09:59:44.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.025 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link set brx.0 up 2024-04-14T09:59:44.091 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:44.091 DEBUG:teuthology.orchestra.run.smithi040:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-14T09:59:44.146 INFO:teuthology.orchestra.run.smithi040.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-14T09:59:44.146 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-14T09:59:44.146 DEBUG:teuthology.orchestra.run.smithi040:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-14T09:59:44.200 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-14T09:59:44.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.201 DEBUG:teuthology.orchestra.run.smithi040:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:44.284 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-14T09:59:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-14T09:59:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: resolved to: "172.21.15.40:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-04-14T09:59:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: trying mount with new device syntax: 0@131eb2ba-6185-454c-b8ac-0bdd05152d4d.cephfs=/ 2024-04-14T09:59:44.294 INFO:teuthology.orchestra.run.smithi040.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.40:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-04-14T09:59:44.295 INFO:teuthology.orchestra.run.smithi040.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-14T09:59:44.295 INFO:teuthology.orchestra.run.smithi040.stdout: You just mounted a file system that supports labels which does not 2024-04-14T09:59:44.295 INFO:teuthology.orchestra.run.smithi040.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-14T09:59:44.295 INFO:teuthology.orchestra.run.smithi040.stdout: applications will generate AVC messages and not be allowed access to 2024-04-14T09:59:44.295 INFO:teuthology.orchestra.run.smithi040.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-14T09:59:44.296 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-14T09:59:44.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.297 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-14T09:59:44.323 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-14T09:59:44.412 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-14T09:59:44.417 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-14T09:59:44.423 INFO:teuthology.orchestra.run.smithi040.stdout:client5491 2024-04-14T09:59:44.423 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:44.423 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:44.438 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=xfstests-dev 2024-04-14T09:59:44.492 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.evUzddTs4hxfstests-dev 2024-04-14T09:59:44.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.493 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.evUzddTs4hxfstests-dev) 2024-04-14T09:59:44.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:44.561 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.evUzddTs4hxfstests-dev) 2024-04-14T09:59:44.617 INFO:teuthology.orchestra.run.smithi040.stderr:Cloning into '/tmp/tmp.evUzddTs4hxfstests-dev'... 2024-04-14T09:59:45.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:45.287 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-04-14T09:59:45.346 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=test 2024-04-14T09:59:45.401 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.ULtXjI1T28test 2024-04-14T09:59:45.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:45.402 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-04-14T09:59:45.459 DEBUG:teuthology.orchestra.run.smithi040:> mktemp -d --suffix=scratch 2024-04-14T09:59:45.513 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.eLFQ8I5RWIscratch 2024-04-14T09:59:45.514 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-04-14T09:59:45.514 DEBUG:teuthology.orchestra.run.smithi040:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-04-14T09:59:46.171 INFO:teuthology.orchestra.run.smithi040.stdout:Last metadata expiration check: 0:03:49 ago on Sun 14 Apr 2024 09:55:57 AM UTC. 2024-04-14T09:59:46.479 INFO:teuthology.orchestra.run.smithi040.stderr:Modular dependency problems: 2024-04-14T09:59:46.479 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T09:59:46.479 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 1: conflicting requests 2024-04-14T09:59:46.479 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 2: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 3: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 4: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 5: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 6: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 7: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 8: conflicting requests 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.480 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 9: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 10: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 11: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 12: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 13: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 14: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 15: conflicting requests 2024-04-14T09:59:46.481 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 16: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 17: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 18: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 19: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 20: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 21: conflicting requests 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.482 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 22: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 23: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 24: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 25: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 26: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 27: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 28: conflicting requests 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.483 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 29: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 30: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 31: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 32: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 33: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 34: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 35: conflicting requests 2024-04-14T09:59:46.484 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 36: conflicting requests 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 37: conflicting requests 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 38: cannot install the best candidate for the job 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 39: conflicting requests 2024-04-14T09:59:46.485 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 40: cannot install the best candidate for the job 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 41: cannot install the best candidate for the job 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.486 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 42: cannot install the best candidate for the job 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 43: cannot install the best candidate for the job 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.487 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 44: cannot install the best candidate for the job 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: Problem 45: cannot install the best candidate for the job 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.488 INFO:teuthology.orchestra.run.smithi040.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-04-14T09:59:46.489 INFO:teuthology.orchestra.run.smithi040.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-04-14T09:59:46.491 INFO:teuthology.orchestra.run.smithi040.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-04-14T09:59:46.492 INFO:teuthology.orchestra.run.smithi040.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-04-14T09:59:46.494 INFO:teuthology.orchestra.run.smithi040.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-04-14T09:59:46.497 INFO:teuthology.orchestra.run.smithi040.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-14T09:59:46.498 INFO:teuthology.orchestra.run.smithi040.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2024-04-14T09:59:46.500 INFO:teuthology.orchestra.run.smithi040.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-04-14T09:59:46.501 INFO:teuthology.orchestra.run.smithi040.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-04-14T09:59:46.502 INFO:teuthology.orchestra.run.smithi040.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-04-14T09:59:46.503 INFO:teuthology.orchestra.run.smithi040.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-04-14T09:59:46.504 INFO:teuthology.orchestra.run.smithi040.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-04-14T09:59:46.505 INFO:teuthology.orchestra.run.smithi040.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-04-14T09:59:46.506 INFO:teuthology.orchestra.run.smithi040.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-04-14T09:59:46.507 INFO:teuthology.orchestra.run.smithi040.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-04-14T09:59:46.510 INFO:teuthology.orchestra.run.smithi040.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr:Error: 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr: Problem: package python3-libs-3.9.18-3.el9.x86_64 from baseos requires libreadline.so.8()(64bit), but none of the providers can be installed 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr: - cannot install both readline-7.0-10.el8.x86_64 from CentOS-BaseOS and readline-8.1-4.el9.x86_64 from @System 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr: - cannot install both readline-8.1-4.el9.x86_64 from baseos and readline-7.0-10.el8.x86_64 from CentOS-BaseOS 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr: - package udftools-2.3-2.el8.x86_64 from CentOS-AppStream requires libreadline.so.7()(64bit), but none of the providers can be installed 2024-04-14T09:59:46.597 INFO:teuthology.orchestra.run.smithi040.stderr: - package python3-3.9.18-3.el9.x86_64 from baseos requires python3-libs(x86-64) = 3.9.18-3.el9, but none of the providers can be installed 2024-04-14T09:59:46.598 INFO:teuthology.orchestra.run.smithi040.stderr: - cannot install the best candidate for the job 2024-04-14T09:59:46.598 INFO:teuthology.orchestra.run.smithi040.stdout:(try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) 2024-04-14T09:59:46.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:59:46.636 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ERROR 2024-04-14T09:59:46.636 INFO:tasks.cephfs_test_runner: 2024-04-14T09:59:46.636 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 455, in run 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T09:59:46.637 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:Ran 1 test in 35.774s 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner: 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:====================================================================== 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-14T09:59:46.638 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 29, in setUp 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: self.prepare_xfstests_devs() 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 44, in prepare_xfstests_devs 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: self.install_deps() 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs/xfstests_dev.py", line 252, in install_deps 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: self.mount_a.client_remote.run(args=args, omit_sudo=False) 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/remote.py", line 523, in run 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 455, in run 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: r.wait() 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 161, in wait 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi040 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs' 2024-04-14T09:59:46.639 INFO:tasks.cephfs_test_runner: 2024-04-14T09:59:46.640 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-04-14T09:59:46.880 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=dd0d1c3404634add85e647eca7c45f00 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_d7d6e60867cadf19fbfd7655a551ae7d58060757/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_b3cf8ca51f5d8edaa7cbce710f0de3a66b6f6be9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs) 2024-04-14T09:59:46.882 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-14T09:59:46.993 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-14T09:59:47.024 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-14T09:59:47.025 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:47.025 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:47.044 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:47.044 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:47.100 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.244+0000 7f803ec88640 1 Processor -- start 2024-04-14T09:59:47.244 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.244+0000 7f803ec88640 1 -- start start 2024-04-14T09:59:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f803ec88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 0x7f80380b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f803ec88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380b4c70 con 0x7f80380b4760 2024-04-14T09:59:47.247 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f803ec88640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80380b4f50 con 0x7f80380d2e80 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f803ec88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f80380b5880 con 0x7f803815e650 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f8037fff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f80380b4760 0x7f80380d2770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39562/0 (socket says 172.21.15.40:39562) 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f8037fff640 1 -- 172.21.15.40:0/3664031781 learned_addr learned my addr 172.21.15.40:0/3664031781 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.245+0000 7f803ca24640 1 --2- 172.21.15.40:0/3664031781 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 0x7f80380b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267559923 0 0) 0x7f80380b4c70 con 0x7f80380b4760 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8020003520 con 0x7f80380b4760 2024-04-14T09:59:47.248 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571422439 0 0) 0x7f80380b4f50 con 0x7f80380d2e80 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80380b4c70 con 0x7f80380d2e80 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f803ca24640 1 -- 172.21.15.40:0/3664031781 >> v1:172.21.15.136:6789/0 conn(0x7f80380d2e80 legacy=0x7f80380cf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f803ca24640 1 -- 172.21.15.40:0/3664031781 >> v1:172.21.15.40:6789/0 conn(0x7f80380b4760 legacy=0x7f80380d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.246+0000 7f803ca24640 1 -- 172.21.15.40:0/3664031781 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80380b5230 con 0x7f803815e650 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ca24640 1 --2- 172.21.15.40:0/3664031781 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 0x7f80380b4220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8030009dc0 tx=0x7f803002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e34cf89c177fc87 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030039070 con 0x7f803815e650 2024-04-14T09:59:47.249 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803002ccd0 con 0x7f803815e650 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f80377fe640 1 -- 172.21.15.40:0/3664031781 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8030034640 con 0x7f803815e650 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 -- 172.21.15.40:0/3664031781 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 msgr2=0x7f80380b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 --2- 172.21.15.40:0/3664031781 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 0x7f80380b4220 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8030009dc0 tx=0x7f803002bf20 comp rx=0 tx=0).stop 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 -- 172.21.15.40:0/3664031781 shutdown_connections 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 --2- 172.21.15.40:0/3664031781 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f803815e650 0x7f80380b4220 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 -- 172.21.15.40:0/3664031781 >> 172.21.15.40:0/3664031781 conn(0x7f803809d580 msgr2=0x7f80380d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:47.250 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 -- 172.21.15.40:0/3664031781 shutdown_connections 2024-04-14T09:59:47.251 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.247+0000 7f803ec88640 1 -- 172.21.15.40:0/3664031781 wait complete. 2024-04-14T09:59:47.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.248+0000 7f803ec88640 1 Processor -- start 2024-04-14T09:59:47.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.248+0000 7f803ec88640 1 -- start start 2024-04-14T09:59:47.253 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80380b4760 0x7f80381f79a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803815e650 0x7f80380cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f803815ea30 con 0x7f80380d2e80 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f80380d2270 con 0x7f803815e650 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f803ec88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f803815ebb0 con 0x7f80380b4760 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f8037fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f8037fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34418/0 (socket says 172.21.15.40:34418) 2024-04-14T09:59:47.254 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.249+0000 7f8037fff640 1 -- 172.21.15.40:0/222668033 learned_addr learned my addr 172.21.15.40:0/222668033 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f803d225640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803815e650 0x7f80380cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f803ca24640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80380b4760 0x7f80381f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 -- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80380b4760 msgr2=0x7f80381f79a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80380b4760 0x7f80381f79a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 -- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803815e650 msgr2=0x7f80380cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803815e650 0x7f80380cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.255 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 -- 172.21.15.40:0/222668033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80381f4db0 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f8037fff640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c410 tx=0x7f802c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c017070 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f802c005ce0 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80381f5090 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0072d0 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.250+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80381f4aa0 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.251+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80380756f0 con 0x7f80380d2e80 2024-04-14T09:59:47.256 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.252+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f802c01a070 con 0x7f80380d2e80 2024-04-14T09:59:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.252+0000 7f80357fa640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 0x7f802406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.252+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f802c08af90 con 0x7f80380d2e80 2024-04-14T09:59:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.252+0000 7f803ca24640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 0x7f802406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.253+0000 7f803ca24640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 0x7f802406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8030036000 tx=0x7f8030030000 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.257 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.256+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f802c058be0 con 0x7f80380d2e80 2024-04-14T09:59:47.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.442+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80380ba130 con 0x7f80380d2e80 2024-04-14T09:59:47.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.443+0000 7f80357fa640 1 -- 172.21.15.40:0/222668033 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7f802c05cee0 con 0x7f80380d2e80 2024-04-14T09:59:47.443 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:47.444 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:38.657511+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:59:35.606234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T09:59:35.958434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:47.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 msgr2=0x7f802406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 0x7f802406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8030036000 tx=0x7f8030030000 comp rx=0 tx=0).stop 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 msgr2=0x7f80380cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f802c00c410 tx=0x7f802c00c8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 shutdown_connections 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f802406c8f0 0x7f802406edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f803815e650 0x7f80380cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f80380d2e80 0x7f80380cd300 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 --2- 172.21.15.40:0/222668033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f80380b4760 0x7f80381f79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.445+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 >> 172.21.15.40:0/222668033 conn(0x7f803809d580 msgr2=0x7f803806d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:47.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.446+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 shutdown_connections 2024-04-14T09:59:47.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.446+0000 7f803ec88640 1 -- 172.21.15.40:0/222668033 wait complete. 2024-04-14T09:59:47.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-14T09:58:10.819824+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-14T09:59:35.606234+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-04-14T09:59:35.958434+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-14T09:59:47.456 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-14T09:59:47.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.561+0000 7f3804836640 1 Processor -- start 2024-04-14T09:59:47.561 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.561+0000 7f3804836640 1 -- start start 2024-04-14T09:59:47.562 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f3804836640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 0x7f38000d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f3804836640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f3804836640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38000b10e0 con 0x7f3800161c80 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f3804836640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f38000d1660 con 0x7f38000b1e60 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f3804836640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f38000b1380 con 0x7f38000d0cc0 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f37fed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f37fed9d640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34430/0 (socket says 172.21.15.40:34430) 2024-04-14T09:59:47.563 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f37fed9d640 1 -- 172.21.15.40:0/2400075831 learned_addr learned my addr 172.21.15.40:0/2400075831 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f37fe59c640 1 --1- 172.21.15.40:0/2400075831 >> v1:172.21.15.136:6789/0 conn(0x7f3800161c80 0x7f38000d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41214/0 (socket says 172.21.15.40:41214) 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.562+0000 7f37fdd9b640 1 --2- 172.21.15.40:0/2400075831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 0x7f38000d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fdd9b640 1 -- 172.21.15.40:0/2400075831 >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 msgr2=0x7f38000b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fd59a640 1 -- 172.21.15.40:0/2400075831 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454816016 0 0) 0x7f38000b10e0 con 0x7f3800161c80 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fdd9b640 1 --2- 172.21.15.40:0/2400075831 >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fdd9b640 1 -- 172.21.15.40:0/2400075831 >> v1:172.21.15.136:6789/0 conn(0x7f3800161c80 legacy=0x7f38000d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fdd9b640 1 -- 172.21.15.40:0/2400075831 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38000b1660 con 0x7f38000d0cc0 2024-04-14T09:59:47.564 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fed9d640 1 --2- 172.21.15.40:0/2400075831 >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:47.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.563+0000 7f37fdd9b640 1 --2- 172.21.15.40:0/2400075831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 0x7f38000d1120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37e80097d0 tx=0x7f37e802b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=513ddb71a32ddd3d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.567 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f37fd59a640 1 -- 172.21.15.40:0/2400075831 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8031770 con 0x7f38000d0cc0 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f37fd59a640 1 -- 172.21.15.40:0/2400075831 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e8037070 con 0x7f38000d0cc0 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f37fd59a640 1 -- 172.21.15.40:0/2400075831 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37e8031b30 con 0x7f38000d0cc0 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 -- 172.21.15.40:0/2400075831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 msgr2=0x7f38000d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 --2- 172.21.15.40:0/2400075831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 0x7f38000d1120 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37e80097d0 tx=0x7f37e802b810 comp rx=0 tx=0).stop 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 -- 172.21.15.40:0/2400075831 shutdown_connections 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 --2- 172.21.15.40:0/2400075831 >> v2:172.21.15.40:3300/0 conn(0x7f38000b1e60 0x7f38000b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.568 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 --2- 172.21.15.40:0/2400075831 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000d0cc0 0x7f38000d1120 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 -- 172.21.15.40:0/2400075831 >> 172.21.15.40:0/2400075831 conn(0x7f380009d5e0 msgr2=0x7f38000d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 -- 172.21.15.40:0/2400075831 shutdown_connections 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.564+0000 7f3804836640 1 -- 172.21.15.40:0/2400075831 wait complete. 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 Processor -- start 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 -- start start 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000b1e60 0x7f380014d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38000d0cc0 0x7f3800150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.569 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f38000d0180 con 0x7f3800161c80 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f38000d3340 con 0x7f38000d0cc0 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f3804836640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f38000d0300 con 0x7f38000b1e60 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f37fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f37fed9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34444/0 (socket says 172.21.15.40:34444) 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f37fed9d640 1 -- 172.21.15.40:0/89410878 learned_addr learned my addr 172.21.15.40:0/89410878 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:47.570 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f37fdd9b640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38000d0cc0 0x7f3800150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.566+0000 7f37fe59c640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000b1e60 0x7f380014d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 -- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000b1e60 msgr2=0x7f380014d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000b1e60 0x7f380014d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 -- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38000d0cc0 msgr2=0x7f3800150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38000d0cc0 0x7f3800150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 -- 172.21.15.40:0/89410878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3800150a40 con 0x7f3800161c80 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37fed9d640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f37f000efc0 tx=0x7f37f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f000cbe0 con 0x7f3800161c80 2024-04-14T09:59:47.571 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f000cd80 con 0x7f3800161c80 2024-04-14T09:59:47.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3800150d20 con 0x7f3800161c80 2024-04-14T09:59:47.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f0003bb0 con 0x7f3800161c80 2024-04-14T09:59:47.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.567+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f380014e400 con 0x7f3800161c80 2024-04-14T09:59:47.572 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.568+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3800075760 con 0x7f3800161c80 2024-04-14T09:59:47.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.569+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37f001b030 con 0x7f3800161c80 2024-04-14T09:59:47.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.569+0000 7f37f6ffd640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 0x7f37e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.569+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f37f008bec0 con 0x7f3800161c80 2024-04-14T09:59:47.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.569+0000 7f37fe59c640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 0x7f37e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.573 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.570+0000 7f37fe59c640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 0x7f37e006ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37f8000f60 tx=0x7f37f8007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.574 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.573+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f37f0022020 con 0x7f3800161c80 2024-04-14T09:59:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.756+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f38000d2b80 con 0x7f3800161c80 2024-04-14T09:59:47.755 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.756+0000 7f37f6ffd640 1 -- 172.21.15.40:0/89410878 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f37f0010040 con 0x7f3800161c80 2024-04-14T09:59:47.756 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 1 2024-04-14T09:59:47.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 msgr2=0x7f37e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 0x7f37e006ede0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f37f8000f60 tx=0x7f37f8007d50 comp rx=0 tx=0).stop 2024-04-14T09:59:47.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 msgr2=0x7f380006d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f37f000efc0 tx=0x7f37f000c490 comp rx=0 tx=0).stop 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 shutdown_connections 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f37e006c920 0x7f37e006ede0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3800161c80 0x7f380006d440 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f38000d0cc0 0x7f3800150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 --2- 172.21.15.40:0/89410878 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f38000b1e60 0x7f380014d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 >> 172.21.15.40:0/89410878 conn(0x7f380009d5e0 msgr2=0x7f38000b9380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 shutdown_connections 2024-04-14T09:59:47.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.758+0000 7f3804836640 1 -- 172.21.15.40:0/89410878 wait complete. 2024-04-14T09:59:47.768 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-14T09:59:47.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.873+0000 7f8758e84640 1 Processor -- start 2024-04-14T09:59:47.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.873+0000 7f8758e84640 1 -- start start 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f875409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f875409af80 0x7f87540cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f87540cd9d0 0x7f87540cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f875409b3c0 con 0x7f875409af80 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f875406cc40 con 0x7f87540cd9d0 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8758e84640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f875406c960 con 0x7f8754071020 2024-04-14T09:59:47.875 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8751d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f875409af80 0x7f87540cd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8751d9b640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f875409af80 0x7f87540cd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34450/0 (socket says 172.21.15.40:34450) 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8751d9b640 1 -- 172.21.15.40:0/4162093842 learned_addr learned my addr 172.21.15.40:0/4162093842 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f875259c640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f875409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.874+0000 7f8752d9d640 1 --2- 172.21.15.40:0/4162093842 >> v2:172.21.15.136:3300/0 conn(0x7f87540cd9d0 0x7f87540cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 -- 172.21.15.40:0/4162093842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 msgr2=0x7f875409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f875409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 -- 172.21.15.40:0/4162093842 >> v2:172.21.15.136:3300/0 conn(0x7f87540cd9d0 msgr2=0x7f87540cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:47.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 --2- 172.21.15.40:0/4162093842 >> v2:172.21.15.136:3300/0 conn(0x7f87540cd9d0 0x7f87540cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 -- 172.21.15.40:0/4162093842 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540cc6d0 con 0x7f875409af80 2024-04-14T09:59:47.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f8751d9b640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f875409af80 0x7f87540cd490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f87540b3a60 tx=0x7f874802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6f81d2a5acef14 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f875159a640 1 -- 172.21.15.40:0/4162093842 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748034070 con 0x7f875409af80 2024-04-14T09:59:47.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f875159a640 1 -- 172.21.15.40:0/4162093842 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8748030860 con 0x7f875409af80 2024-04-14T09:59:47.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.875+0000 7f875159a640 1 -- 172.21.15.40:0/4162093842 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748030c30 con 0x7f875409af80 2024-04-14T09:59:47.879 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 -- 172.21.15.40:0/4162093842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f875409af80 msgr2=0x7f87540cd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f875409af80 0x7f87540cd490 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f87540b3a60 tx=0x7f874802b9a0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 -- 172.21.15.40:0/4162093842 shutdown_connections 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 --2- 172.21.15.40:0/4162093842 >> v2:172.21.15.136:3300/0 conn(0x7f87540cd9d0 0x7f87540cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f875409af80 0x7f87540cd490 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 --2- 172.21.15.40:0/4162093842 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f875409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 -- 172.21.15.40:0/4162093842 >> 172.21.15.40:0/4162093842 conn(0x7f87540b3ad0 msgr2=0x7f87540b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 -- 172.21.15.40:0/4162093842 shutdown_connections 2024-04-14T09:59:47.880 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.876+0000 7f8758e84640 1 -- 172.21.15.40:0/4162093842 wait complete. 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.877+0000 7f8758e84640 1 Processor -- start 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.877+0000 7f8758e84640 1 -- start start 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f87541522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f875409af80 0x7f875415c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f87540ccf70 con 0x7f87540cd9d0 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87540ccc90 con 0x7f875409af80 2024-04-14T09:59:47.881 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8758e84640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f875406db50 con 0x7f8754071020 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8752d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8752d9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34460/0 (socket says 172.21.15.40:34460) 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8752d9d640 1 -- 172.21.15.40:0/480086620 learned_addr learned my addr 172.21.15.40:0/480086620 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f875259c640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f87541522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.878+0000 7f8751d9b640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f875409af80 0x7f875415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 -- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 msgr2=0x7f87541522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f87541522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.882 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 -- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f875409af80 msgr2=0x7f875415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f875409af80 0x7f875415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 -- 172.21.15.40:0/480086620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87540b4c80 con 0x7f87540cd9d0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.879+0000 7f8752d9d640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f874400efc0 tx=0x7f874400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.880+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744018020 con 0x7f87540cd9d0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.880+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8744014480 con 0x7f87540cd9d0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.880+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87540b4f60 con 0x7f87540cd9d0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.880+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8744014870 con 0x7f87540cd9d0 2024-04-14T09:59:47.883 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.880+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87540b5520 con 0x7f87540cd9d0 2024-04-14T09:59:47.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.881+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8754075760 con 0x7f87540cd9d0 2024-04-14T09:59:47.884 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.881+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8744005d10 con 0x7f87540cd9d0 2024-04-14T09:59:47.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.882+0000 7f8742ffd640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:47.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.882+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f874408c9a0 con 0x7f87540cd9d0 2024-04-14T09:59:47.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.882+0000 7f875259c640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:47.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.882+0000 7f875259c640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 0x7f873406edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f874c009a20 tx=0x7f874c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:47.885 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:47.886+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8744022030 con 0x7f87540cd9d0 2024-04-14T09:59:48.068 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.069+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8754161ec0 con 0x7f87540cd9d0 2024-04-14T09:59:48.069 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.069+0000 7f8742ffd640 1 -- 172.21.15.40:0/480086620 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) ==== 104+0+11 (secure 0 0 0) 0x7f8744010040 con 0x7f87540cd9d0 2024-04-14T09:59:48.069 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 32 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 msgr2=0x7f873406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 0x7f873406edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f874c009a20 tx=0x7f874c009190 comp rx=0 tx=0).stop 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 msgr2=0x7f875415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f874400efc0 tx=0x7f874400c490 comp rx=0 tx=0).stop 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 shutdown_connections 2024-04-14T09:59:48.071 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f873406c8f0 0x7f873406edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f87540cd9d0 0x7f875415cd80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f875409af80 0x7f875415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 --2- 172.21.15.40:0/480086620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8754071020 0x7f87541522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 >> 172.21.15.40:0/480086620 conn(0x7f87540b3ad0 msgr2=0x7f875406f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 shutdown_connections 2024-04-14T09:59:48.072 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.071+0000 7f8758e84640 1 -- 172.21.15.40:0/480086620 wait complete. 2024-04-14T09:59:48.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-14T09:59:48.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.186+0000 7f9ad555e640 1 Processor -- start 2024-04-14T09:59:48.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.186+0000 7f9ad555e640 1 -- start start 2024-04-14T09:59:48.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ad555e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ad00b00c0 0x7f9ad00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ad555e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad006b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ad555e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ad015e9a0 con 0x7f9ad015e5c0 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ad555e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9ad006fa80 con 0x7f9ad00b00c0 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ad555e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad006fd60 con 0x7f9ad006b520 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9aceffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9ad015e5c0 0x7f9ad0070840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39574/0 (socket says 172.21.15.40:39574) 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9aceffd640 1 -- 172.21.15.40:0/1866975396 learned_addr learned my addr 172.21.15.40:0/1866975396 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:48.188 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/1866975396 >> v2:172.21.15.136:3300/0 conn(0x7f9ad00b00c0 0x7f9ad00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9acf7fe640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad006b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ace7fc640 1 -- 172.21.15.40:0/1866975396 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479163696 0 0) 0x7f9ad015e9a0 con 0x7f9ad015e5c0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ace7fc640 1 -- 172.21.15.40:0/1866975396 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9abc003520 con 0x7f9ad015e5c0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ac7fff640 1 -- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 msgr2=0x7f9ad006b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad006b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ac7fff640 1 -- 172.21.15.40:0/1866975396 >> v1:172.21.15.40:6789/0 conn(0x7f9ad015e5c0 legacy=0x7f9ad0070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.187+0000 7f9ac7fff640 1 -- 172.21.15.40:0/1866975396 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad0070040 con 0x7f9ad00b00c0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.188+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00b4dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80097a0 tx=0x7f9ab802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5a3d6d5f84ef714 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.189 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.188+0000 7f9ace7fc640 1 -- 172.21.15.40:0/1866975396 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80315a0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.188+0000 7f9ace7fc640 1 -- 172.21.15.40:0/1866975396 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab8037070 con 0x7f9ad00b00c0 2024-04-14T09:59:48.190 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.188+0000 7f9ace7fc640 1 -- 172.21.15.40:0/1866975396 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8031960 con 0x7f9ad00b00c0 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 -- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad00b00c0 msgr2=0x7f9ad00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00b4dd0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80097a0 tx=0x7f9ab802b840 comp rx=0 tx=0).stop 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 -- 172.21.15.40:0/1866975396 shutdown_connections 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad006b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 --2- 172.21.15.40:0/1866975396 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00b4dd0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 -- 172.21.15.40:0/1866975396 >> 172.21.15.40:0/1866975396 conn(0x7f9ad00b2db0 msgr2=0x7f9ad00b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:48.194 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 -- 172.21.15.40:0/1866975396 shutdown_connections 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.189+0000 7f9ad555e640 1 -- 172.21.15.40:0/1866975396 wait complete. 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.190+0000 7f9ad555e640 1 Processor -- start 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.190+0000 7f9ad555e640 1 -- start start 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad01560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad015e5c0 0x7f9ad00ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad00ad8b0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.195 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ad00b09d0 con 0x7f9ad015e5c0 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9ad00ada30 con 0x7f9ad006b520 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34474/0 (socket says 172.21.15.40:34474) 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9aceffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad01560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 -- 172.21.15.40:0/3965872174 learned_addr learned my addr 172.21.15.40:0/3965872174 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9acf7fe640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad015e5c0 0x7f9ad00ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 -- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 msgr2=0x7f9ad01560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.196 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad01560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 -- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad015e5c0 msgr2=0x7f9ad00ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad015e5c0 0x7f9ad00ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 -- 172.21.15.40:0/3965872174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ad00d05e0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac7fff640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034040 tx=0x7f9ab80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8032630 con 0x7f9ad00b00c0 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ab80327f0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ad00d08c0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.197 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.191+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ab8032be0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.192+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ad00d0e80 con 0x7f9ad00b00c0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.192+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ad0075760 con 0x7f9ad00b00c0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.193+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ab804e430 con 0x7f9ad00b00c0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.193+0000 7f9ac77fe640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 0x7f9ab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.194+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9ab802f030 con 0x7f9ad00b00c0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.194+0000 7f9aceffd640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 0x7f9ab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.198 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.194+0000 7f9aceffd640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 0x7f9ab006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005880 tx=0x7f9ac0009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.199 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.198+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9ab8040070 con 0x7f9ad00b00c0 2024-04-14T09:59:48.382 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.382+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9ad0158dc0 con 0x7f9ad00b00c0 2024-04-14T09:59:48.383 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.383+0000 7f9ac77fe640 1 -- 172.21.15.40:0/3965872174 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) ==== 100+0+11 (secure 0 0 0) 0x7f9ab807b610 con 0x7f9ad00b00c0 2024-04-14T09:59:48.383 INFO:teuthology.orchestra.run.smithi040.stdout:pg_num: 64 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 msgr2=0x7f9ab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 0x7f9ab006edb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0005880 tx=0x7f9ac0009040 comp rx=0 tx=0).stop 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 msgr2=0x7f9ad00addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8034040 tx=0x7f9ab80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 shutdown_connections 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9ab006c8f0 0x7f9ab006edb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ad015e5c0 0x7f9ad00ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.385 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ad00b00c0 0x7f9ad00addc0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 --2- 172.21.15.40:0/3965872174 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ad006b520 0x7f9ad01560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 >> 172.21.15.40:0/3965872174 conn(0x7f9ad00b2db0 msgr2=0x7f9ad00b1060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 shutdown_connections 2024-04-14T09:59:48.386 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.385+0000 7f9ad555e640 1 -- 172.21.15.40:0/3965872174 wait complete. 2024-04-14T09:59:48.395 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-14T09:59:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.498+0000 7f2a1fc88640 1 Processor -- start 2024-04-14T09:59:48.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.498+0000 7f2a1fc88640 1 -- start start 2024-04-14T09:59:48.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1fc88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 0x7f2a180b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1fc88640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1809b450 con 0x7f2a18162600 2024-04-14T09:59:48.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1fc88640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1809b6f0 con 0x7f2a181629e0 2024-04-14T09:59:48.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1fc88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180d0aa0 con 0x7f2a18162f30 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1da24640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2a18162600 0x7f2a180d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39588/0 (socket says 172.21.15.40:39588) 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1da24640 1 -- 172.21.15.40:0/1138407080 learned_addr learned my addr 172.21.15.40:0/1138407080 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.499+0000 7f2a1d223640 1 --2- 172.21.15.40:0/1138407080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 0x7f2a180b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1982789362 0 0) 0x7f2a1809b450 con 0x7f2a18162600 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a00003520 con 0x7f2a18162600 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251185120 0 0) 0x7f2a1809b6f0 con 0x7f2a181629e0 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a1809b450 con 0x7f2a181629e0 2024-04-14T09:59:48.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1d223640 1 -- 172.21.15.40:0/1138407080 >> v1:172.21.15.136:6789/0 conn(0x7f2a181629e0 legacy=0x7f2a180cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1d223640 1 -- 172.21.15.40:0/1138407080 >> v1:172.21.15.40:6789/0 conn(0x7f2a18162600 legacy=0x7f2a180d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1d223640 1 -- 172.21.15.40:0/1138407080 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1809b9d0 con 0x7f2a18162f30 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.500+0000 7f2a1d223640 1 --2- 172.21.15.40:0/1138407080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 0x7f2a180b4740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097d0 tx=0x7f2a0c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c23d414e7e2363ec server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c035020 con 0x7f2a18162f30 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0c031890 con 0x7f2a18162f30 2024-04-14T09:59:48.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1ca22640 1 -- 172.21.15.40:0/1138407080 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c031c60 con 0x7f2a18162f30 2024-04-14T09:59:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 -- 172.21.15.40:0/1138407080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 msgr2=0x7f2a180b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/1138407080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 0x7f2a180b4740 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0097d0 tx=0x7f2a0c02b930 comp rx=0 tx=0).stop 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 -- 172.21.15.40:0/1138407080 shutdown_connections 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/1138407080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a18162f30 0x7f2a180b4740 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 -- 172.21.15.40:0/1138407080 >> 172.21.15.40:0/1138407080 conn(0x7f2a180b3c20 msgr2=0x7f2a180b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 -- 172.21.15.40:0/1138407080 shutdown_connections 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.501+0000 7f2a1fc88640 1 -- 172.21.15.40:0/1138407080 wait complete. 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.502+0000 7f2a1fc88640 1 Processor -- start 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.502+0000 7f2a1fc88640 1 -- start start 2024-04-14T09:59:48.506 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18162600 0x7f2a18155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a181629e0 0x7f2a1815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2a180d0350 con 0x7f2a18162f30 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2a180d1640 con 0x7f2a18162600 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1fc88640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2a180d04d0 con 0x7f2a181629e0 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1e225640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1e225640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34478/0 (socket says 172.21.15.40:34478) 2024-04-14T09:59:48.507 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1e225640 1 -- 172.21.15.40:0/855166940 learned_addr learned my addr 172.21.15.40:0/855166940 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1da24640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18162600 0x7f2a18155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.503+0000 7f2a1d223640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a181629e0 0x7f2a1815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 -- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a181629e0 msgr2=0x7f2a1815a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a181629e0 0x7f2a1815a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 -- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18162600 msgr2=0x7f2a18155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18162600 0x7f2a18155770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 -- 172.21.15.40:0/855166940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a180ca9b0 con 0x7f2a18162f30 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1e225640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c7c0 tx=0x7f2a0800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.508 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a08003b70 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a08003d10 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a180cac90 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0800aa50 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.504+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a180cb250 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.505+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a18075760 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.505+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a0800abf0 con 0x7f2a18162f30 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.506+0000 7f2a167fc640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 0x7f2a0406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:48.509 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.506+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2a0808bb20 con 0x7f2a18162f30 2024-04-14T09:59:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.506+0000 7f2a1da24640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 0x7f2a0406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.506+0000 7f2a1da24640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 0x7f2a0406edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a100011e0 tx=0x7f2a10007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:48.510 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.510+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f2a08059780 con 0x7f2a18162f30 2024-04-14T09:59:48.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.706+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2a1815ccf0 con 0x7f2a18162f30 2024-04-14T09:59:48.706 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.707+0000 7f2a167fc640 1 -- 172.21.15.40:0/855166940 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v39) ==== 80+0+0 (secure 0 0 0) 0x7f2a0805da80 con 0x7f2a18162f30 2024-04-14T09:59:48.707 INFO:teuthology.orchestra.run.smithi040.stderr:listed 0 entries 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 msgr2=0x7f2a0406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 0x7f2a0406edb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2a100011e0 tx=0x7f2a10007d30 comp rx=0 tx=0).stop 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 msgr2=0x7f2a1815aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2a0800c7c0 tx=0x7f2a0800cc80 comp rx=0 tx=0).stop 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 shutdown_connections 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2a0406c8f0 0x7f2a0406edb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.709 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2a18162f30 0x7f2a1815aa50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a181629e0 0x7f2a1815a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 --2- 172.21.15.40:0/855166940 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a18162600 0x7f2a18155770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 >> 172.21.15.40:0/855166940 conn(0x7f2a180b3c20 msgr2=0x7f2a180cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 shutdown_connections 2024-04-14T09:59:48.710 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:48.709+0000 7f2a1fc88640 1 -- 172.21.15.40:0/855166940 wait complete. 2024-04-14T09:59:48.719 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-14T09:59:48.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:48.719 DEBUG:teuthology.orchestra.run.smithi040:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-14T09:59:48.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T09:59:48.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:48.749 DEBUG:teuthology.orchestra.run.smithi040:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-14T09:59:48.804 DEBUG:teuthology.orchestra.run.smithi040:> set -ex 2024-04-14T09:59:48.804 DEBUG:teuthology.orchestra.run.smithi040:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:48.859 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4057145,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=15519 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249464k,nr_inodes=812366,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498932k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-14T09:59:48.859 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:48.859 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:48.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3480 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-14T09:59:48.876 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-04-14T09:59:48.876 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-14T09:59:48.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056359,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3480 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-14T09:59:48.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:48.931 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:59:48.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-14T09:59:48.946 INFO:teuthology.orchestra.run.smithi040.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-14T09:59:48.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:48.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-14T09:59:49.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-14T09:59:49.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.081 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-14T09:59:49.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.185 DEBUG:teuthology.orchestra.run.smithi040:> ip netns list 2024-04-14T09:59:49.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.199 DEBUG:teuthology.orchestra.run.smithi040:> sudo ip link delete ceph-brx 2024-04-14T09:59:49.269 INFO:teuthology.orchestra.run.smithi040.stderr:Cannot find device "ceph-brx" 2024-04-14T09:59:49.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:59:49.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.270 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:59:49.285 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-14T09:59:49.286 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-14T09:59:49.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.286 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-14T09:59:49.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.354 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-14T09:59:49.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.422 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-04-14T09:59:49.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.527 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-04-14T09:59:49.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-14T09:59:49.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-04-14T09:59:49.612 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-04-14T09:59:49.613 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T09:59:49.614 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-14T09:59:49.624 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-14T09:59:49.624 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.730+0000 7fe686ea2640 1 Processor -- start 2024-04-14T09:59:49.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.730+0000 7fe686ea2640 1 -- start start 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe686ea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 0x7fe6800b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe686ea2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6800b3b40 0x7fe6800b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe686ea2640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6800b5400 con 0x7fe6800b4a50 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe686ea2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800b4ee0 con 0x7fe6800b3b40 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe686ea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe6800b24e0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe684c3e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 0x7fe6800b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe67ffff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe6800b3b40 0x7fe6800b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe68543f640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fe6800b4a50 0x7fe680142fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41228/0 (socket says 172.21.15.40:41228) 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe68543f640 1 -- 172.21.15.40:0/310598240 learned_addr learned my addr 172.21.15.40:0/310598240 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe684c3e640 1 -- 172.21.15.40:0/310598240 >> v2:172.21.15.136:3300/0 conn(0x7fe6800b3b40 msgr2=0x7fe6800b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe684c3e640 1 --2- 172.21.15.40:0/310598240 >> v2:172.21.15.136:3300/0 conn(0x7fe6800b3b40 0x7fe6800b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe684c3e640 1 -- 172.21.15.40:0/310598240 >> v1:172.21.15.136:6789/0 conn(0x7fe6800b4a50 legacy=0x7fe680142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.731+0000 7fe684c3e640 1 -- 172.21.15.40:0/310598240 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6800b5120 con 0x7fe6800b1bc0 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.732+0000 7fe684c3e640 1 --2- 172.21.15.40:0/310598240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 0x7fe6800b1fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097a0 tx=0x7fe67402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc25c48436b8e87 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.732+0000 7fe67f7fe640 1 -- 172.21.15.40:0/310598240 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740315a0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.732+0000 7fe67f7fe640 1 -- 172.21.15.40:0/310598240 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe674037070 con 0x7fe6800b1bc0 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.732+0000 7fe67f7fe640 1 -- 172.21.15.40:0/310598240 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674031960 con 0x7fe6800b1bc0 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 -- 172.21.15.40:0/310598240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 msgr2=0x7fe6800b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 --2- 172.21.15.40:0/310598240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 0x7fe6800b1fa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe6740097a0 tx=0x7fe67402b840 comp rx=0 tx=0).stop 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 -- 172.21.15.40:0/310598240 shutdown_connections 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 --2- 172.21.15.40:0/310598240 >> v2:172.21.15.136:3300/0 conn(0x7fe6800b3b40 0x7fe6800b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 --2- 172.21.15.40:0/310598240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b1bc0 0x7fe6800b1fa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 -- 172.21.15.40:0/310598240 >> 172.21.15.40:0/310598240 conn(0x7fe68006ebf0 msgr2=0x7fe68006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 -- 172.21.15.40:0/310598240 shutdown_connections 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.733+0000 7fe686ea2640 1 -- 172.21.15.40:0/310598240 wait complete. 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.734+0000 7fe686ea2640 1 Processor -- start 2024-04-14T09:59:49.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.734+0000 7fe686ea2640 1 -- start start 2024-04-14T09:59:49.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6800b3b40 0x7fe680156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b4a50 0x7fe680157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.738 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800b3620 con 0x7fe6800b1bc0 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800b3340 con 0x7fe6800b3b40 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe686ea2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe680142b00 con 0x7fe6800b4a50 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34486/0 (socket says 172.21.15.40:34486) 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 -- 172.21.15.40:0/3500260377 learned_addr learned my addr 172.21.15.40:0/3500260377 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe67ffff640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6800b3b40 0x7fe680156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe68543f640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b4a50 0x7fe680157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.739 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 -- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b4a50 msgr2=0x7fe680157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b4a50 0x7fe680157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 -- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6800b3b40 msgr2=0x7fe680156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6800b3b40 0x7fe680156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 -- 172.21.15.40:0/3500260377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe680157a10 con 0x7fe6800b1bc0 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.735+0000 7fe684c3e640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe674034040 tx=0x7fe6740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.736+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674032630 con 0x7fe6800b1bc0 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.736+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6740327f0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.740 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.736+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6801f20a0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.736+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674032be0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.736+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801f2660 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.737+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6801f2860 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.737+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe67404d3f0 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.737+0000 7fe67d7fa640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 0x7fe66406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.738+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe67402f030 con 0x7fe6800b1bc0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.738+0000 7fe67ffff640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 0x7fe66406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:49.741 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.738+0000 7fe67ffff640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 0x7fe66406edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe680160e00 tx=0x7fe66c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:49.742 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.742+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fe674040070 con 0x7fe6800b1bc0 2024-04-14T09:59:49.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.923+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe68006c280 con 0x7fe66406c8f0 2024-04-14T09:59:49.929 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.929+0000 7fe67d7fa640 1 -- 172.21.15.40:0/3500260377 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251848 (secure 0 0 0) 0x7fe68006c280 con 0x7fe66406c8f0 2024-04-14T09:59:49.932 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:49.934 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:49.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 msgr2=0x7fe66406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.936 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 0x7fe66406edb0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe680160e00 tx=0x7fe66c009190 comp rx=0 tx=0).stop 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 msgr2=0x7fe6800b0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe674034040 tx=0x7fe6740046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 shutdown_connections 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe66406c8f0 0x7fe66406edb0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6800b4a50 0x7fe680157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe6800b3b40 0x7fe680156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.937 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 --2- 172.21.15.40:0/3500260377 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe6800b1bc0 0x7fe6800b0e70 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:49.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 >> 172.21.15.40:0/3500260377 conn(0x7fe68006ebf0 msgr2=0x7fe6800cea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:49.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 shutdown_connections 2024-04-14T09:59:49.938 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:49.932+0000 7fe686ea2640 1 -- 172.21.15.40:0/3500260377 wait complete. 2024-04-14T09:59:49.942 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-14T09:59:48.825996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220904,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753816,"statfs":{"total":773094113280,"available":772867907584,"internally_reserved":0,"allocated":4857856,"data_stored":2743404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.166677"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'7","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:39.832774+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:39.832774+0000","last_peered":"2024-04-14T09:59:39.832774+0000","last_clean":"2024-04-14T09:59:39.832774+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:39.832774+0000","last_undegraded":"2024-04-14T09:59:39.832774+0000","last_fullsized":"2024-04-14T09:59:39.832774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671141+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:38.671141+0000","last_peered":"2024-04-14T09:59:38.671141+0000","last_clean":"2024-04-14T09:59:38.671141+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:38.671141+0000","last_undegraded":"2024-04-14T09:59:38.671141+0000","last_fullsized":"2024-04-14T09:59:38.671141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:49.947 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:50.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.085+0000 7f3da75bb640 1 Processor -- start 2024-04-14T09:59:50.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.085+0000 7f3da75bb640 1 -- start start 2024-04-14T09:59:50.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da75bb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 0x7f3da009ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da75bb640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 0x7f3da00cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da75bb640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da009b360 con 0x7f3da00b45b0 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da75bb640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3da006f840 con 0x7f3da00d1320 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da75bb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3da006fb20 con 0x7f3da009aa40 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da4b56640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3da00b45b0 0x7f3da00cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39596/0 (socket says 172.21.15.40:39596) 2024-04-14T09:59:50.089 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da4b56640 1 -- 172.21.15.40:0/1161287825 learned_addr learned my addr 172.21.15.40:0/1161287825 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da5b58640 1 --2- 172.21.15.40:0/1161287825 >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 0x7f3da00cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3da5357640 1 --2- 172.21.15.40:0/1161287825 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 0x7f3da009ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.086+0000 7f3d97fff640 1 -- 172.21.15.40:0/1161287825 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2228022007 0 0) 0x7f3da009b360 con 0x7f3da00b45b0 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3d97fff640 1 -- 172.21.15.40:0/1161287825 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d8c003520 con 0x7f3da00b45b0 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5357640 1 -- 172.21.15.40:0/1161287825 >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 msgr2=0x7f3da00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5357640 1 --2- 172.21.15.40:0/1161287825 >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 0x7f3da00cd7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.090 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5357640 1 -- 172.21.15.40:0/1161287825 >> v1:172.21.15.40:6789/0 conn(0x7f3da00b45b0 legacy=0x7f3da00cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5357640 1 -- 172.21.15.40:0/1161287825 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da00cc5f0 con 0x7f3da009aa40 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5b58640 1 --2- 172.21.15.40:0/1161287825 >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 0x7f3da00cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.087+0000 7f3da5357640 1 --2- 172.21.15.40:0/1161287825 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 0x7f3da009ae20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5be7b37ea1d54495 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3d97fff640 1 -- 172.21.15.40:0/1161287825 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c035020 con 0x7f3da009aa40 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3d97fff640 1 -- 172.21.15.40:0/1161287825 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c031830 con 0x7f3da009aa40 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3d97fff640 1 -- 172.21.15.40:0/1161287825 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c031c00 con 0x7f3da009aa40 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 -- 172.21.15.40:0/1161287825 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 msgr2=0x7f3da009ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 --2- 172.21.15.40:0/1161287825 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 0x7f3da009ae20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 -- 172.21.15.40:0/1161287825 shutdown_connections 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 --2- 172.21.15.40:0/1161287825 >> v2:172.21.15.136:3300/0 conn(0x7f3da00d1320 0x7f3da00cd7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 --2- 172.21.15.40:0/1161287825 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da009aa40 0x7f3da009ae20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 -- 172.21.15.40:0/1161287825 >> 172.21.15.40:0/1161287825 conn(0x7f3da00b3a90 msgr2=0x7f3da00b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 -- 172.21.15.40:0/1161287825 shutdown_connections 2024-04-14T09:59:50.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.088+0000 7f3da75bb640 1 -- 172.21.15.40:0/1161287825 wait complete. 2024-04-14T09:59:50.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 Processor -- start 2024-04-14T09:59:50.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 -- start start 2024-04-14T09:59:50.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da00b45b0 0x7f3da00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da00d1320 0x7f3da00c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3da009b860 con 0x7f3da009aa40 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3da00ccbb0 con 0x7f3da00b45b0 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da75bb640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3da009b9e0 con 0x7f3da00d1320 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da5357640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.096 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da5357640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34500/0 (socket says 172.21.15.40:34500) 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da5357640 1 -- 172.21.15.40:0/3514705817 learned_addr learned my addr 172.21.15.40:0/3514705817 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.090+0000 7f3da4b56640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da00b45b0 0x7f3da00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5b58640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da00d1320 0x7f3da00c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 -- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da00d1320 msgr2=0x7f3da00c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da00d1320 0x7f3da00c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 -- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da00b45b0 msgr2=0x7f3da00ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da00b45b0 0x7f3da00ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.097 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 -- 172.21.15.40:0/3514705817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da01f81a0 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da5357640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c03a830 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d9c03a9d0 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da00c5c70 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d9c03adc0 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.091+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da00b31c0 con 0x7f3da009aa40 2024-04-14T09:59:50.098 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.092+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3da00756f0 con 0x7f3da009aa40 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.093+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d9c04b060 con 0x7f3da009aa40 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.093+0000 7f3d95ffb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 0x7f3d8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.093+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3d9c0ad610 con 0x7f3da009aa40 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.093+0000 7f3da4b56640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 0x7f3d8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.094+0000 7f3da4b56640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 0x7f3d8406edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3da00cc050 tx=0x7f3d90009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.099 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.097+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f3d9c03f070 con 0x7f3da009aa40 2024-04-14T09:59:50.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.279+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3da00b41f0 con 0x7f3d8406c8f0 2024-04-14T09:59:50.287 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.287+0000 7f3d95ffb640 1 -- 172.21.15.40:0/3514705817 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251848 (secure 0 0 0) 0x7f3da00b41f0 con 0x7f3d8406c8f0 2024-04-14T09:59:50.291 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:50.292 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 msgr2=0x7f3d8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 0x7f3d8406edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3da00cc050 tx=0x7f3d90009040 comp rx=0 tx=0).stop 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 msgr2=0x7f3da00b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c0097a0 tx=0x7f3d9c0046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 shutdown_connections 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d8406c8f0 0x7f3d8406edb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.294 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3da00d1320 0x7f3da00c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3da00b45b0 0x7f3da00ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 --2- 172.21.15.40:0/3514705817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3da009aa40 0x7f3da00b2c80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.290+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 >> 172.21.15.40:0/3514705817 conn(0x7f3da00b3a90 msgr2=0x7f3da009ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.291+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 shutdown_connections 2024-04-14T09:59:50.295 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.291+0000 7f3da75bb640 1 -- 172.21.15.40:0/3514705817 wait complete. 2024-04-14T09:59:50.300 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-14T09:59:48.825996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220904,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753816,"statfs":{"total":773094113280,"available":772867907584,"internally_reserved":0,"allocated":4857856,"data_stored":2743404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.166677"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'7","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:39.832774+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:39.832774+0000","last_peered":"2024-04-14T09:59:39.832774+0000","last_clean":"2024-04-14T09:59:39.832774+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:39.832774+0000","last_undegraded":"2024-04-14T09:59:39.832774+0000","last_fullsized":"2024-04-14T09:59:39.832774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671141+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:38.671141+0000","last_peered":"2024-04-14T09:59:38.671141+0000","last_clean":"2024-04-14T09:59:38.671141+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:38.671141+0000","last_undegraded":"2024-04-14T09:59:38.671141+0000","last_fullsized":"2024-04-14T09:59:38.671141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:50.305 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-14T09:59:50.305 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.443+0000 7f35b3d5e640 1 Processor -- start 2024-04-14T09:59:50.443 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.443+0000 7f35b3d5e640 1 -- start start 2024-04-14T09:59:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f35ac15e370 0x7f35ac0d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35ac06d800 0x7f35ac09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac0d12f0 0x7f35ac09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac06d370 con 0x7f35ac06d800 2024-04-14T09:59:50.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f35ac06c760 con 0x7f35ac15e370 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b3d5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac06ca40 con 0x7f35ac0d12f0 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b12f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35ac06d800 0x7f35ac09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b12f9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f35ac06d800 0x7f35ac09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34514/0 (socket says 172.21.15.40:34514) 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b12f9640 1 -- 172.21.15.40:0/1857376673 learned_addr learned my addr 172.21.15.40:0/1857376673 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b1afa640 1 --2- 172.21.15.40:0/1857376673 >> v2:172.21.15.136:3300/0 conn(0x7f35ac15e370 0x7f35ac0d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.444+0000 7f35b22fb640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac0d12f0 0x7f35ac09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 -- 172.21.15.40:0/1857376673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac0d12f0 msgr2=0x7f35ac09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac0d12f0 0x7f35ac09af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 -- 172.21.15.40:0/1857376673 >> v2:172.21.15.136:3300/0 conn(0x7f35ac15e370 msgr2=0x7f35ac0d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 --2- 172.21.15.40:0/1857376673 >> v2:172.21.15.136:3300/0 conn(0x7f35ac15e370 0x7f35ac0d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 -- 172.21.15.40:0/1857376673 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac06cd20 con 0x7f35ac06d800 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.445+0000 7f35b12f9640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac06d800 0x7f35ac09aa40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06f4e0 tx=0x7f35a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6930e6547189bb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b0af8640 1 -- 172.21.15.40:0/1857376673 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035020 con 0x7f35ac06d800 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b0af8640 1 -- 172.21.15.40:0/1857376673 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0031870 con 0x7f35ac06d800 2024-04-14T09:59:50.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b0af8640 1 -- 172.21.15.40:0/1857376673 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0031c40 con 0x7f35ac06d800 2024-04-14T09:59:50.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 -- 172.21.15.40:0/1857376673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac06d800 msgr2=0x7f35ac09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac06d800 0x7f35ac09aa40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06f4e0 tx=0x7f35a002b910 comp rx=0 tx=0).stop 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 -- 172.21.15.40:0/1857376673 shutdown_connections 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac0d12f0 0x7f35ac09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/1857376673 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac06d800 0x7f35ac09aa40 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/1857376673 >> v2:172.21.15.136:3300/0 conn(0x7f35ac15e370 0x7f35ac0d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 -- 172.21.15.40:0/1857376673 >> 172.21.15.40:0/1857376673 conn(0x7f35ac0b3ba0 msgr2=0x7f35ac0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 -- 172.21.15.40:0/1857376673 shutdown_connections 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.446+0000 7f35b3d5e640 1 -- 172.21.15.40:0/1857376673 wait complete. 2024-04-14T09:59:50.451 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.447+0000 7f35b3d5e640 1 Processor -- start 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.447+0000 7f35b3d5e640 1 -- start start 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 0x7f35ac0c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35ac15e370 0x7f35ac0c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac15e8d0 con 0x7f35ac0d12f0 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f35ac15e750 con 0x7f35ac15e370 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b3d5e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35ac162020 con 0x7f35ac06d800 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.452 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34520/0 (socket says 172.21.15.40:34520) 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 -- 172.21.15.40:0/2470608262 learned_addr learned my addr 172.21.15.40:0/2470608262 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b22fb640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35ac15e370 0x7f35ac0c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b1afa640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 0x7f35ac0c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 -- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 msgr2=0x7f35ac0c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 0x7f35ac0c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 -- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35ac15e370 msgr2=0x7f35ac0c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35ac15e370 0x7f35ac0c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b12f9640 1 -- 172.21.15.40:0/2470608262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ac1613b0 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.448+0000 7f35b1afa640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 0x7f35ac0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35b12f9640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35a002b950 tx=0x7f35a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0040070 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0031e10 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ac15fdd0 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0035040 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.449+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ac160390 con 0x7f35ac0d12f0 2024-04-14T09:59:50.454 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.450+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ac0756f0 con 0x7f35ac0d12f0 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.450+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35a004b060 con 0x7f35ac0d12f0 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.451+0000 7f35aa7fc640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.451+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f35a00ad940 con 0x7f35ac0d12f0 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.451+0000 7f35b1afa640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.451+0000 7f35b1afa640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 0x7f359806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f359c009fd0 tx=0x7f359c00b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.455+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f35a007bb40 con 0x7f35ac0d12f0 2024-04-14T09:59:50.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.635+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35ac0b8030 con 0x7f359806c8f0 2024-04-14T09:59:50.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.641+0000 7f35aa7fc640 1 -- 172.21.15.40:0/2470608262 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251848 (secure 0 0 0) 0x7f35ac0b8030 con 0x7f359806c8f0 2024-04-14T09:59:50.643 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:50.645 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 msgr2=0x7f359806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 0x7f359806edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f359c009fd0 tx=0x7f359c00b040 comp rx=0 tx=0).stop 2024-04-14T09:59:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 msgr2=0x7f35ac160e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35a002b950 tx=0x7f35a00046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 shutdown_connections 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f359806c8f0 0x7f359806edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f35ac15e370 0x7f35ac0c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f35ac0d12f0 0x7f35ac160e70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 --2- 172.21.15.40:0/2470608262 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35ac06d800 0x7f35ac0c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 >> 172.21.15.40:0/2470608262 conn(0x7f35ac0b3ba0 msgr2=0x7f35ac09aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:50.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.644+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 shutdown_connections 2024-04-14T09:59:50.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.645+0000 7f35b3d5e640 1 -- 172.21.15.40:0/2470608262 wait complete. 2024-04-14T09:59:50.657 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2024-04-14T09:59:48.825996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593034,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":205,"num_write_kb":2431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220904,"kb_used_data":4744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753816,"statfs":{"total":773094113280,"available":772867907584,"internally_reserved":0,"allocated":4857856,"data_stored":2743404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.166677"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'7","reported_seq":21,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:39.832774+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:39.832774+0000","last_peered":"2024-04-14T09:59:39.832774+0000","last_clean":"2024-04-14T09:59:39.832774+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:39.832774+0000","last_undegraded":"2024-04-14T09:59:39.832774+0000","last_fullsized":"2024-04-14T09:59:39.832774+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671141+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:38.671141+0000","last_peered":"2024-04-14T09:59:38.671141+0000","last_clean":"2024-04-14T09:59:38.671141+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:38.671141+0000","last_undegraded":"2024-04-14T09:59:38.671141+0000","last_fullsized":"2024-04-14T09:59:38.671141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":40,"ondisk_log_size":40,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1060864,"data_stored":786749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":466944,"data_stored":196601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:50.661 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-14T09:59:50.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.801+0000 7fd5d36de640 1 Processor -- start 2024-04-14T09:59:50.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.801+0000 7fd5d36de640 1 -- start start 2024-04-14T09:59:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd5cc0b3b40 0x7fd5cc0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b4a50 0x7fd5cc142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fd5cc0b4ee0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd5cc0b36b0 con 0x7fd5cc0b3b40 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d36de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b5400 con 0x7fd5cc0b4a50 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34524/0 (socket says 172.21.15.40:34524) 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 -- 172.21.15.40:0/338229352 learned_addr learned my addr 172.21.15.40:0/338229352 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:50.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d0c79640 1 --2- 172.21.15.40:0/338229352 >> v2:172.21.15.136:3300/0 conn(0x7fd5cc0b3b40 0x7fd5cc0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d1c7b640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b4a50 0x7fd5cc142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 -- 172.21.15.40:0/338229352 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b4a50 msgr2=0x7fd5cc142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b4a50 0x7fd5cc142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 -- 172.21.15.40:0/338229352 >> v2:172.21.15.136:3300/0 conn(0x7fd5cc0b3b40 msgr2=0x7fd5cc0b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 --2- 172.21.15.40:0/338229352 >> v2:172.21.15.136:3300/0 conn(0x7fd5cc0b3b40 0x7fd5cc0b4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.802+0000 7fd5d147a640 1 -- 172.21.15.40:0/338229352 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc0b24e0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.803+0000 7fd5d147a640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0cd4d0 tx=0x7fd5c802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744b3c2e1d918e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.803+0000 7fd5c3fff640 1 -- 172.21.15.40:0/338229352 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c802e070 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.803+0000 7fd5c3fff640 1 -- 172.21.15.40:0/338229352 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8037070 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.805 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.803+0000 7fd5c3fff640 1 -- 172.21.15.40:0/338229352 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8031a00 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 -- 172.21.15.40:0/338229352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 msgr2=0x7fd5cc0b1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc0cd4d0 tx=0x7fd5c802b880 comp rx=0 tx=0).stop 2024-04-14T09:59:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 -- 172.21.15.40:0/338229352 shutdown_connections 2024-04-14T09:59:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b4a50 0x7fd5cc142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.808 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 --2- 172.21.15.40:0/338229352 >> v2:172.21.15.136:3300/0 conn(0x7fd5cc0b3b40 0x7fd5cc0b4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 --2- 172.21.15.40:0/338229352 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc0b1fa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 -- 172.21.15.40:0/338229352 >> 172.21.15.40:0/338229352 conn(0x7fd5cc06ebf0 msgr2=0x7fd5cc06b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 -- 172.21.15.40:0/338229352 shutdown_connections 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.804+0000 7fd5d36de640 1 -- 172.21.15.40:0/338229352 wait complete. 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.805+0000 7fd5d36de640 1 Processor -- start 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.805+0000 7fd5d36de640 1 -- start start 2024-04-14T09:59:50.809 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.805+0000 7fd5d36de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b3b40 0x7fd5cc1f63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5cc0b4a50 0x7fd5cc1f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b3340 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd5cc0b3060 con 0x7fd5cc0b4a50 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd5cc142b20 con 0x7fd5cc0b3b40 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34536/0 (socket says 172.21.15.40:34536) 2024-04-14T09:59:50.810 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 -- 172.21.15.40:0/2061896493 learned_addr learned my addr 172.21.15.40:0/2061896493 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d0c79640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b3b40 0x7fd5cc1f63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d1c7b640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5cc0b4a50 0x7fd5cc1f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 -- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b3b40 msgr2=0x7fd5cc1f63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b3b40 0x7fd5cc1f63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 -- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5cc0b4a50 msgr2=0x7fd5cc1f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5cc0b4a50 0x7fd5cc1f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 -- 172.21.15.40:0/2061896493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5cc1e50f0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.811 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d147a640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8000c00 tx=0x7fd5c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8032670 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c8032810 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c8032c00 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.806+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5cc1e53d0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.807+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5cc1e5990 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.807+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5cc0756f0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.808+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5c804c060 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.812 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.808+0000 7fd5c1ffb640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 0x7fd5b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:50.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.808+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd5c80ad3f0 con 0x7fd5cc0b1bc0 2024-04-14T09:59:50.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.808+0000 7fd5d0c79640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 0x7fd5b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:50.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.809+0000 7fd5d0c79640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 0x7fd5b006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc158ba0 tx=0x7fd5bc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:50.813 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:50.813+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fd5c8040070 con 0x7fd5cc0b1bc0 2024-04-14T09:59:51.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.001+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5cc06c280 con 0x7fd5cc0b1bc0 2024-04-14T09:59:51.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.002+0000 7fd5c1ffb640 1 -- 172.21.15.40:0/2061896493 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16918 (secure 0 0 0) 0x7fd5c807b190 con 0x7fd5cc0b1bc0 2024-04-14T09:59:51.002 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:51.002 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":39,"fsid":"131eb2ba-6185-454c-b8ac-0bdd05152d4d","created":"2024-04-14T09:57:58.611016+0000","modified":"2024-04-14T09:59:38.657511+0000","last_up_change":"2024-04-14T09:58:09.307742+0000","last_in_change":"2024-04-14T09:58:00.771862+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-14T09:58:10.819824+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-04-14T09:59:35.606234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-04-14T09:59:35.958434+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"891722e2-d1e9-4db3-817d-0aeb11182ec2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6800","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6801","nonce":1123590082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6802","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6803","nonce":1123590082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6806","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6807","nonce":1123590082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6804","nonce":1123590082},{"type":"v1","addr":"172.21.15.40:6805","nonce":1123590082}]},"public_addr":"172.21.15.40:6801/1123590082","cluster_addr":"172.21.15.40:6803/1123590082","heartbeat_back_addr":"172.21.15.40:6807/1123590082","heartbeat_front_addr":"172.21.15.40:6805/1123590082","state":["exists","up"]},{"osd":1,"uuid":"23d39ca6-9667-4783-94d7-d849a12ca05e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6808","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6809","nonce":1198121083}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6810","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6811","nonce":1198121083}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6814","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6815","nonce":1198121083}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6812","nonce":1198121083},{"type":"v1","addr":"172.21.15.40:6813","nonce":1198121083}]},"public_addr":"172.21.15.40:6809/1198121083","cluster_addr":"172.21.15.40:6811/1198121083","heartbeat_back_addr":"172.21.15.40:6815/1198121083","heartbeat_front_addr":"172.21.15.40:6813/1198121083","state":["exists","up"]},{"osd":2,"uuid":"dcabb454-b141-493c-a76f-cc5c9b6da94a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6816","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6818","nonce":3712336313}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6820","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6822","nonce":3712336313}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6828","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6830","nonce":3712336313}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6824","nonce":3712336313},{"type":"v1","addr":"172.21.15.40:6826","nonce":3712336313}]},"public_addr":"172.21.15.40:6818/3712336313","cluster_addr":"172.21.15.40:6822/3712336313","heartbeat_back_addr":"172.21.15.40:6830/3712336313","heartbeat_front_addr":"172.21.15.40:6826/3712336313","state":["exists","up"]},{"osd":3,"uuid":"76305ea2-ea43-4f1a-9c96-9fd089df5c5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6817","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6819","nonce":852135294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6821","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6823","nonce":852135294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6829","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6831","nonce":852135294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6825","nonce":852135294},{"type":"v1","addr":"172.21.15.40:6827","nonce":852135294}]},"public_addr":"172.21.15.40:6819/852135294","cluster_addr":"172.21.15.40:6823/852135294","heartbeat_back_addr":"172.21.15.40:6831/852135294","heartbeat_front_addr":"172.21.15.40:6827/852135294","state":["exists","up"]},{"osd":4,"uuid":"b64e63ea-6a58-4752-851a-22ea09fb8379","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6801","nonce":3007411045}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6803","nonce":3007411045}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6807","nonce":3007411045}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":3007411045},{"type":"v1","addr":"172.21.15.136:6805","nonce":3007411045}]},"public_addr":"172.21.15.136:6801/3007411045","cluster_addr":"172.21.15.136:6803/3007411045","heartbeat_back_addr":"172.21.15.136:6807/3007411045","heartbeat_front_addr":"172.21.15.136:6805/3007411045","state":["exists","up"]},{"osd":5,"uuid":"cb2f0397-51be-49d4-af87-3a665370072d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6817","nonce":265445102}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6819","nonce":265445102}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6823","nonce":265445102}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":265445102},{"type":"v1","addr":"172.21.15.136:6821","nonce":265445102}]},"public_addr":"172.21.15.136:6817/265445102","cluster_addr":"172.21.15.136:6819/265445102","heartbeat_back_addr":"172.21.15.136:6823/265445102","heartbeat_front_addr":"172.21.15.136:6821/265445102","state":["exists","up"]},{"osd":6,"uuid":"33c94f4e-a2d5-485a-b064-587043313130","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6809","nonce":829650642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6811","nonce":829650642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6815","nonce":829650642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":829650642},{"type":"v1","addr":"172.21.15.136:6813","nonce":829650642}]},"public_addr":"172.21.15.136:6809/829650642","cluster_addr":"172.21.15.136:6811/829650642","heartbeat_back_addr":"172.21.15.136:6815/829650642","heartbeat_front_addr":"172.21.15.136:6813/829650642","state":["exists","up"]},{"osd":7,"uuid":"be6b3d90-9d7a-4bc8-a101-1a0bb50b1226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6825","nonce":2810716504}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6827","nonce":2810716504}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6831","nonce":2810716504}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":2810716504},{"type":"v1","addr":"172.21.15.136:6829","nonce":2810716504}]},"public_addr":"172.21.15.136:6825/2810716504","cluster_addr":"172.21.15.136:6827/2810716504","heartbeat_back_addr":"172.21.15.136:6831/2810716504","heartbeat_front_addr":"172.21.15.136:6829/2810716504","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.814684+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.934176+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.957336+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.904230+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.947859+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:06.018833+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.972474+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-14T09:58:05.942755+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 msgr2=0x7fd5b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 0x7fd5b006edb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc158ba0 tx=0x7fd5bc009190 comp rx=0 tx=0).stop 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 msgr2=0x7fd5cc1e4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd5c8000c00 tx=0x7fd5c80046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 shutdown_connections 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fd5b006c8f0 0x7fd5b006edb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:51.004 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd5cc0b4a50 0x7fd5cc1f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd5cc0b3b40 0x7fd5cc1f63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 --2- 172.21.15.40:0/2061896493 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fd5cc0b1bc0 0x7fd5cc1e4a30 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 >> 172.21.15.40:0/2061896493 conn(0x7fd5cc06ebf0 msgr2=0x7fd5cc1445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 shutdown_connections 2024-04-14T09:59:51.005 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:51.004+0000 7fd5d36de640 1 -- 172.21.15.40:0/2061896493 wait complete. 2024-04-14T09:59:52.015 INFO:tasks.ceph:Scrubbing osd.0 2024-04-14T09:59:52.016 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:52.133 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 Processor -- start 2024-04-14T09:59:52.134 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 -- start start 2024-04-14T09:59:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2cc09aa40 0x7fe2cc0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc0cc6f0 con 0x7fe2cc06d850 2024-04-14T09:59:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2cc0d17e0 con 0x7fe2cc0d1350 2024-04-14T09:59:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.134+0000 7fe2d2755640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fe2cc0cc990 con 0x7fe2cc09aa40 2024-04-14T09:59:52.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2cbfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fe2cc09aa40 0x7fe2cc0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2d0cf2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fe2cc06d850 0x7fe2cc0cd190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39612/0 (socket says 172.21.15.40:39612) 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2d0cf2640 1 -- 172.21.15.40:0/2981731660 learned_addr learned my addr 172.21.15.40:0/2981731660 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2cbfff640 1 -- 172.21.15.40:0/2981731660 >> v1:172.21.15.136:6789/0 conn(0x7fe2cc0d1350 legacy=0x7fe2cc09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2cbfff640 1 -- 172.21.15.40:0/2981731660 >> v1:172.21.15.40:6789/0 conn(0x7fe2cc06d850 legacy=0x7fe2cc0cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2cbfff640 1 -- 172.21.15.40:0/2981731660 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc0ccc70 con 0x7fe2cc09aa40 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.135+0000 7fe2caffd640 1 -- 172.21.15.40:0/2981731660 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254777468 0 0) 0x7fe2cc0cc6f0 con 0x7fe2cc06d850 2024-04-14T09:59:52.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2cbfff640 1 --2- 172.21.15.40:0/2981731660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0d0370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf214140e40484be server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2caffd640 1 -- 172.21.15.40:0/2981731660 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc034070 con 0x7fe2cc09aa40 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2caffd640 1 -- 172.21.15.40:0/2981731660 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc030610 con 0x7fe2cc09aa40 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2caffd640 1 -- 172.21.15.40:0/2981731660 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0309e0 con 0x7fe2cc09aa40 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2d2755640 1 -- 172.21.15.40:0/2981731660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 msgr2=0x7fe2cc0d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.136+0000 7fe2d2755640 1 --2- 172.21.15.40:0/2981731660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0d0370 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0097a0 tx=0x7fe2bc02b960 comp rx=0 tx=0).stop 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.137+0000 7fe2d2755640 1 -- 172.21.15.40:0/2981731660 shutdown_connections 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.137+0000 7fe2d2755640 1 --2- 172.21.15.40:0/2981731660 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0d0370 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.137+0000 7fe2d2755640 1 -- 172.21.15.40:0/2981731660 >> 172.21.15.40:0/2981731660 conn(0x7fe2cc0b3af0 msgr2=0x7fe2cc0b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.137+0000 7fe2d2755640 1 -- 172.21.15.40:0/2981731660 shutdown_connections 2024-04-14T09:59:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.137+0000 7fe2d2755640 1 -- 172.21.15.40:0/2981731660 wait complete. 2024-04-14T09:59:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.138+0000 7fe2d2755640 1 Processor -- start 2024-04-14T09:59:52.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.138+0000 7fe2d2755640 1 -- start start 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2cc06d850 0x7fe2cc0d05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2cc0c7ba0 0x7fe2cc152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc15e970 con 0x7fe2cc09aa40 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe2cc15e7f0 con 0x7fe2cc0c7ba0 2024-04-14T09:59:52.142 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d2755640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe2cc0cd8a0 con 0x7fe2cc06d850 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34562/0 (socket says 172.21.15.40:34562) 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 -- 172.21.15.40:0/2929584350 learned_addr learned my addr 172.21.15.40:0/2929584350 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cbfff640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2cc06d850 0x7fe2cc0d05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2d0cf2640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2cc0c7ba0 0x7fe2cc152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 -- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2cc06d850 msgr2=0x7fe2cc0d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe2cc06d850 0x7fe2cc0d05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.143 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 -- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2cc0c7ba0 msgr2=0x7fe2cc152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe2cc0c7ba0 0x7fe2cc152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2cc1f7b80 con 0x7fe2cc09aa40 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2cb7fe640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0c7660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c400 tx=0x7fe2c000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.139+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0017070 con 0x7fe2cc09aa40 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.140+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c00052d0 con 0x7fe2cc09aa40 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.140+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2cc1f7e60 con 0x7fe2cc09aa40 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.140+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0003830 con 0x7fe2cc09aa40 2024-04-14T09:59:52.144 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.140+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2cc1f8420 con 0x7fe2cc09aa40 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.140+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe2cc0757d0 con 0x7fe2cc09aa40 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.141+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe2c001a070 con 0x7fe2cc09aa40 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.141+0000 7fe2c8ff9640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe2b806c8f0 0x7fe2b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fe2c008aec0 con 0x7fe2cc09aa40 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2c8ff9640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7fe2b8075160 0x7fe2b80775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2cbfff640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe2b806c8f0 0x7fe2b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe2b8077c70 con 0x7fe2b8075160 2024-04-14T09:59:52.145 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe2c008d5c0 con 0x7fe2cc09aa40 2024-04-14T09:59:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2d0cf2640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7fe2b8075160 0x7fe2b80775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2d0cf2640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7fe2b8075160 0x7fe2b80775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.142+0000 7fe2cbfff640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe2b806c8f0 0x7fe2b806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc036000 tx=0x7fe2bc03b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.146 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.143+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== osd.0 v2:172.21.15.40:6800/1123590082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe2b8077c70 con 0x7fe2b8075160 2024-04-14T09:59:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.156+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe2cc0cc430 con 0x7fe2b8075160 2024-04-14T09:59:52.156 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.156+0000 7fe2c8ff9640 1 -- 172.21.15.40:0/2929584350 <== osd.0 v2:172.21.15.40:6800/1123590082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe2cc0cc430 con 0x7fe2b8075160 2024-04-14T09:59:52.156 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:52.156 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:52.157 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:52.157 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7fe2b8075160 msgr2=0x7fe2b80775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7fe2b8075160 0x7fe2b80775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe2b806c8f0 msgr2=0x7fe2b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fe2b806c8f0 0x7fe2b806edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc036000 tx=0x7fe2bc03b040 comp rx=0 tx=0).stop 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 msgr2=0x7fe2cc0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 --2- 172.21.15.40:0/2929584350 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fe2cc09aa40 0x7fe2cc0c7660 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c400 tx=0x7fe2c000c8c0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d0cf2640 1 -- 172.21.15.40:0/2929584350 reap_dead start 2024-04-14T09:59:52.158 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 shutdown_connections 2024-04-14T09:59:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 >> 172.21.15.40:0/2929584350 conn(0x7fe2cc0b3af0 msgr2=0x7fe2cc06fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 shutdown_connections 2024-04-14T09:59:52.159 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.157+0000 7fe2d2755640 1 -- 172.21.15.40:0/2929584350 wait complete. 2024-04-14T09:59:52.167 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-14T09:59:52.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.270+0000 7f86a5c20640 1 Processor -- start 2024-04-14T09:59:52.270 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.270+0000 7f86a5c20640 1 -- start start 2024-04-14T09:59:52.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f86a5c20640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86a0070d30 0x7f86a00cfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.271 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f86a5c20640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86a009b860 con 0x7f86a00d0830 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f86a5c20640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86a015c900 con 0x7f86a00b1590 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f86a5c20640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f86a006f890 con 0x7f86a0070d30 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f869ffff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f86a0070d30 0x7f86a00cfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f869f7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f86a00d0830 0x7f86a009aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39618/0 (socket says 172.21.15.40:39618) 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f869f7fe640 1 -- 172.21.15.40:0/1487827390 learned_addr learned my addr 172.21.15.40:0/1487827390 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.271+0000 7f869ffff640 1 -- 172.21.15.40:0/1487827390 >> v1:172.21.15.136:6789/0 conn(0x7f86a00b1590 legacy=0x7f86a009b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869ffff640 1 -- 172.21.15.40:0/1487827390 >> v1:172.21.15.40:6789/0 conn(0x7f86a00d0830 legacy=0x7f86a009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.272 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869e7fc640 1 -- 172.21.15.40:0/1487827390 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085218437 0 0) 0x7f86a009b860 con 0x7f86a00d0830 2024-04-14T09:59:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869ffff640 1 -- 172.21.15.40:0/1487827390 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a00cd6e0 con 0x7f86a0070d30 2024-04-14T09:59:52.273 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869ffff640 1 --2- 172.21.15.40:0/1487827390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a0070d30 0x7f86a00cfdc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8698009d90 tx=0x7f869802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2847c29e5eef93 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869e7fc640 1 -- 172.21.15.40:0/1487827390 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698039070 con 0x7f86a0070d30 2024-04-14T09:59:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869e7fc640 1 -- 172.21.15.40:0/1487827390 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869802cd00 con 0x7f86a0070d30 2024-04-14T09:59:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.272+0000 7f869e7fc640 1 -- 172.21.15.40:0/1487827390 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698034660 con 0x7f86a0070d30 2024-04-14T09:59:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 -- 172.21.15.40:0/1487827390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a0070d30 msgr2=0x7f86a00cfdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.274 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 --2- 172.21.15.40:0/1487827390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a0070d30 0x7f86a00cfdc0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8698009d90 tx=0x7f869802bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 -- 172.21.15.40:0/1487827390 shutdown_connections 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 --2- 172.21.15.40:0/1487827390 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a0070d30 0x7f86a00cfdc0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 -- 172.21.15.40:0/1487827390 >> 172.21.15.40:0/1487827390 conn(0x7f86a00b3ad0 msgr2=0x7f86a00b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 -- 172.21.15.40:0/1487827390 shutdown_connections 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.273+0000 7f86a5c20640 1 -- 172.21.15.40:0/1487827390 wait complete. 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.274+0000 7f86a5c20640 1 Processor -- start 2024-04-14T09:59:52.275 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.274+0000 7f86a5c20640 1 -- start start 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86a0070d30 0x7f86a0156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86a00b1590 0x7f86a00b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f86a00cdf80 con 0x7f86a00d0830 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86a00cdca0 con 0x7f86a00b1590 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f86a5c20640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f86a006f520 con 0x7f86a0070d30 2024-04-14T09:59:52.278 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34580/0 (socket says 172.21.15.40:34580) 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 -- 172.21.15.40:0/3973448914 learned_addr learned my addr 172.21.15.40:0/3973448914 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869effd640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86a00b1590 0x7f86a00b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869f7fe640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86a0070d30 0x7f86a0156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 -- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86a0070d30 msgr2=0x7f86a0156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86a0070d30 0x7f86a0156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 -- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86a00b1590 msgr2=0x7f86a00b71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86a00b1590 0x7f86a00b71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.275+0000 7f869ffff640 1 -- 172.21.15.40:0/3973448914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86a01f23e0 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f869ffff640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8698009d90 tx=0x7f8698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8698039050 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f869803a040 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86a00b5770 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f869803e610 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.276+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86a00b66e0 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.277+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86a0075760 con 0x7f86a00d0830 2024-04-14T09:59:52.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.277+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8698047020 con 0x7f86a00d0830 2024-04-14T09:59:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.278+0000 7f8687fff640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 0x7f868c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.278+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f86980adf00 con 0x7f86a00d0830 2024-04-14T09:59:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.278+0000 7f869f7fe640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 0x7f868c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.278+0000 7f869f7fe640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 0x7f868c06edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8690000f60 tx=0x7f8690007e40 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.282+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f869804e020 con 0x7f86a00d0830 2024-04-14T09:59:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.467+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f86a00d03a0 con 0x7f868c06c8f0 2024-04-14T09:59:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.468+0000 7f8687fff640 1 -- 172.21.15.40:0/3973448914 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f86a00d03a0 con 0x7f868c06c8f0 2024-04-14T09:59:52.467 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 0 to deep-scrub 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 msgr2=0x7f868c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 0x7f868c06edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8690000f60 tx=0x7f8690007e40 comp rx=0 tx=0).stop 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 msgr2=0x7f86a0157510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8698009d90 tx=0x7f8698004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 shutdown_connections 2024-04-14T09:59:52.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f868c06c8f0 0x7f868c06edb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f86a00d0830 0x7f86a0157510 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f86a00b1590 0x7f86a00b71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 --2- 172.21.15.40:0/3973448914 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86a0070d30 0x7f86a0156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 >> 172.21.15.40:0/3973448914 conn(0x7f86a00b3ad0 msgr2=0x7f86a00af070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 shutdown_connections 2024-04-14T09:59:52.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.470+0000 7f86a5c20640 1 -- 172.21.15.40:0/3973448914 wait complete. 2024-04-14T09:59:52.480 INFO:tasks.ceph:Scrubbing osd.1 2024-04-14T09:59:52.480 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.586+0000 7fa28bfc8640 1 Processor -- start 2024-04-14T09:59:52.586 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.586+0000 7fa28bfc8640 1 -- start start 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28bfc8640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa284162570 0x7fa2840cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28bfc8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162950 0x7fa28415e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28bfc8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2840d0670 con 0x7fa2840d0110 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28bfc8640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa2840d0950 con 0x7fa284162570 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28bfc8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa2840d0c30 con 0x7fa284162950 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa289d64640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa284162570 0x7fa2840cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.589 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa289563640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa2840d0110 0x7fa28415e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39630/0 (socket says 172.21.15.40:39630) 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa289563640 1 -- 172.21.15.40:0/324230767 learned_addr learned my addr 172.21.15.40:0/324230767 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.587+0000 7fa28a565640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162950 0x7fa28415e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa289d64640 1 -- 172.21.15.40:0/324230767 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162950 msgr2=0x7fa28415e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa289d64640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162950 0x7fa28415e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa289d64640 1 -- 172.21.15.40:0/324230767 >> v1:172.21.15.40:6789/0 conn(0x7fa2840d0110 legacy=0x7fa28415e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa288d62640 1 -- 172.21.15.40:0/324230767 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961203782 0 0) 0x7fa2840d0670 con 0x7fa2840d0110 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa289d64640 1 -- 172.21.15.40:0/324230767 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2840d0f10 con 0x7fa284162570 2024-04-14T09:59:52.590 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.588+0000 7fa289d64640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284162570 0x7fa2840cfbd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa274009d90 tx=0x7fa27402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7c4844d2ebfabc server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa288d62640 1 -- 172.21.15.40:0/324230767 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274039070 con 0x7fa284162570 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa288d62640 1 -- 172.21.15.40:0/324230767 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27402cc50 con 0x7fa284162570 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa288d62640 1 -- 172.21.15.40:0/324230767 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274034440 con 0x7fa284162570 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 -- 172.21.15.40:0/324230767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284162570 msgr2=0x7fa2840cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284162570 0x7fa2840cfbd0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa274009d90 tx=0x7fa27402bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 -- 172.21.15.40:0/324230767 shutdown_connections 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162950 0x7fa28415e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.591 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/324230767 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa284162570 0x7fa2840cfbd0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 -- 172.21.15.40:0/324230767 >> 172.21.15.40:0/324230767 conn(0x7fa28409d5a0 msgr2=0x7fa2840d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 -- 172.21.15.40:0/324230767 shutdown_connections 2024-04-14T09:59:52.592 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.589+0000 7fa28bfc8640 1 -- 172.21.15.40:0/324230767 wait complete. 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.590+0000 7fa28bfc8640 1 Processor -- start 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.590+0000 7fa28bfc8640 1 -- start start 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 0x7fa284156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162570 0x7fa2841f5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa284162950 0x7fa28406d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.595 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa284163160 con 0x7fa2840d0110 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa284162fe0 con 0x7fa284162950 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28bfc8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa2840d1710 con 0x7fa284162570 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 0x7fa284156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 0x7fa284156920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34606/0 (socket says 172.21.15.40:34606) 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 -- 172.21.15.40:0/2043113498 learned_addr learned my addr 172.21.15.40:0/2043113498 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289563640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162570 0x7fa2841f5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.596 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa28a565640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa284162950 0x7fa28406d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 -- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162570 msgr2=0x7fa2841f5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa284162570 0x7fa2841f5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 -- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa284162950 msgr2=0x7fa28406d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa284162950 0x7fa28406d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.591+0000 7fa289d64640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2840ce6c0 con 0x7fa2840d0110 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa289d64640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 0x7fa284156920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa274037040 tx=0x7fa274004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa274039050 con 0x7fa2840d0110 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa27403a040 con 0x7fa2840d0110 2024-04-14T09:59:52.597 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2841f51d0 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa27402ca50 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa284157310 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.592+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2840757d0 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.593+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa274047020 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.593+0000 7fa2827fc640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa27006c8f0 0x7fa27006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa2740ade20 con 0x7fa2840d0110 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa289563640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa27006c8f0 0x7fa27006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.598 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa2827fc640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7fa270075160 0x7fa2700775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa270077c70 con 0x7fa270075160 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa2740b0440 con 0x7fa2840d0110 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa28a565640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7fa270075160 0x7fa2700775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa28a565640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7fa270075160 0x7fa2700775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.594+0000 7fa289563640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa27006c8f0 0x7fa27006edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2841f77a0 tx=0x7fa278009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.599 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.595+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== osd.1 v2:172.21.15.40:6808/1198121083 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa270077c70 con 0x7fa270075160 2024-04-14T09:59:52.607 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 --> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa2840d1ac0 con 0x7fa270075160 2024-04-14T09:59:52.608 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa2827fc640 1 -- 172.21.15.40:0/2043113498 <== osd.1 v2:172.21.15.40:6808/1198121083 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa2840d1ac0 con 0x7fa270075160 2024-04-14T09:59:52.608 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:52.608 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:52.608 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7fa270075160 msgr2=0x7fa2700775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.609 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:6808/1198121083,v1:172.21.15.40:6809/1198121083] conn(0x7fa270075160 0x7fa2700775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa27006c8f0 msgr2=0x7fa27006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa27006c8f0 0x7fa27006edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa2841f77a0 tx=0x7fa278009040 comp rx=0 tx=0).stop 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 msgr2=0x7fa284156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 --2- 172.21.15.40:0/2043113498 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa2840d0110 0x7fa284156920 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa274037040 tx=0x7fa274004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28a565640 1 -- 172.21.15.40:0/2043113498 reap_dead start 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 shutdown_connections 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.608+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 >> 172.21.15.40:0/2043113498 conn(0x7fa28409d5a0 msgr2=0x7fa2840d2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.610 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.609+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 shutdown_connections 2024-04-14T09:59:52.611 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.609+0000 7fa28bfc8640 1 -- 172.21.15.40:0/2043113498 wait complete. 2024-04-14T09:59:52.618 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-14T09:59:52.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:59:52.687 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T09:59:52.723 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.723+0000 7f70caf1e640 1 Processor -- start 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.723+0000 7f70caf1e640 1 -- start start 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.723+0000 7f70caf1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f70c40d0cc0 0x7f70c40d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70caf1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70c40b1e60 0x7f70c40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70caf1e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70c40b10e0 con 0x7f70c4161c80 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70caf1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f70c40d1660 con 0x7f70c40b1e60 2024-04-14T09:59:52.724 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70caf1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f70c40b1380 con 0x7f70c40d0cc0 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c94bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f70c40b1e60 0x7f70c40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c8cba640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f70c4161c80 0x7f70c40d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39634/0 (socket says 172.21.15.40:39634) 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c8cba640 1 -- 172.21.15.40:0/2076169766 learned_addr learned my addr 172.21.15.40:0/2076169766 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c94bb640 1 -- 172.21.15.40:0/2076169766 >> v2:172.21.15.136:3300/0 conn(0x7f70c40d0cc0 msgr2=0x7f70c40d1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c94bb640 1 --2- 172.21.15.40:0/2076169766 >> v2:172.21.15.136:3300/0 conn(0x7f70c40d0cc0 0x7f70c40d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c94bb640 1 -- 172.21.15.40:0/2076169766 >> v1:172.21.15.40:6789/0 conn(0x7f70c4161c80 legacy=0x7f70c40d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c94bb640 1 -- 172.21.15.40:0/2076169766 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40b1660 con 0x7f70c40b1e60 2024-04-14T09:59:52.725 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.724+0000 7f70c37fe640 1 -- 172.21.15.40:0/2076169766 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3878714514 0 0) 0x7f70c40b10e0 con 0x7f70c4161c80 2024-04-14T09:59:52.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70c94bb640 1 --2- 172.21.15.40:0/2076169766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c40b1e60 0x7f70c40b22f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f70c408cc30 tx=0x7f70bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1be16a5a68d0671 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70c37fe640 1 -- 172.21.15.40:0/2076169766 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc039070 con 0x7f70c40b1e60 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70c37fe640 1 -- 172.21.15.40:0/2076169766 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc02cbf0 con 0x7f70c40b1e60 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70c37fe640 1 -- 172.21.15.40:0/2076169766 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc034440 con 0x7f70c40b1e60 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 -- 172.21.15.40:0/2076169766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c40b1e60 msgr2=0x7f70c40b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 --2- 172.21.15.40:0/2076169766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c40b1e60 0x7f70c40b22f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f70c408cc30 tx=0x7f70bc02be40 comp rx=0 tx=0).stop 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 -- 172.21.15.40:0/2076169766 shutdown_connections 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 --2- 172.21.15.40:0/2076169766 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c40b1e60 0x7f70c40b22f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.729 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 --2- 172.21.15.40:0/2076169766 >> v2:172.21.15.136:3300/0 conn(0x7f70c40d0cc0 0x7f70c40d1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 -- 172.21.15.40:0/2076169766 >> 172.21.15.40:0/2076169766 conn(0x7f70c409d5e0 msgr2=0x7f70c40d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 -- 172.21.15.40:0/2076169766 shutdown_connections 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.725+0000 7f70caf1e640 1 -- 172.21.15.40:0/2076169766 wait complete. 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.727+0000 7f70caf1e640 1 Processor -- start 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.727+0000 7f70caf1e640 1 -- start start 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.727+0000 7f70caf1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70c40b1e60 0x7f70c41f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70c40d0cc0 0x7f70c40cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40d0180 con 0x7f70c4161c80 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f70c40d3340 con 0x7f70c40d0cc0 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f70c40d0300 con 0x7f70c40b1e60 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34622/0 (socket says 172.21.15.40:34622) 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 -- 172.21.15.40:0/1413813478 learned_addr learned my addr 172.21.15.40:0/1413813478 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c3fff640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70c40d0cc0 0x7f70c40cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c8cba640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70c40b1e60 0x7f70c41f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 -- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70c40b1e60 msgr2=0x7f70c41f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70c40b1e60 0x7f70c41f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 -- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70c40d0cc0 msgr2=0x7f70c40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70c40d0cc0 0x7f70c40cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 -- 172.21.15.40:0/1413813478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c40cb660 con 0x7f70c4161c80 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c94bb640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f70bc02c450 tx=0x7f70bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc044030 con 0x7f70c4161c80 2024-04-14T09:59:52.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70bc02c9f0 con 0x7f70c4161c80 2024-04-14T09:59:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c40cb940 con 0x7f70c4161c80 2024-04-14T09:59:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70bc039040 con 0x7f70c4161c80 2024-04-14T09:59:52.733 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.728+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c41f20e0 con 0x7f70c4161c80 2024-04-14T09:59:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.729+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c4075760 con 0x7f70c4161c80 2024-04-14T09:59:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.730+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70bc03f470 con 0x7f70c4161c80 2024-04-14T09:59:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.730+0000 7f70c17fa640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 0x7f70a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.730+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f70bc0ae640 con 0x7f70c4161c80 2024-04-14T09:59:52.734 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.731+0000 7f70c8cba640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 0x7f70a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.731+0000 7f70c8cba640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 0x7f70a806edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f70b8000f60 tx=0x7f70b8007d50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:52.735 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.735+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f70bc07c840 con 0x7f70c4161c80 2024-04-14T09:59:52.919 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.919+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f70c40d2130 con 0x7f70a806c8f0 2024-04-14T09:59:52.920 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.920+0000 7f70c17fa640 1 -- 172.21.15.40:0/1413813478 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f70c40d2130 con 0x7f70a806c8f0 2024-04-14T09:59:52.920 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 1 to deep-scrub 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 msgr2=0x7f70a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 0x7f70a806edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f70b8000f60 tx=0x7f70b8007d50 comp rx=0 tx=0).stop 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 msgr2=0x7f70c40cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f70bc02c450 tx=0x7f70bc004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 shutdown_connections 2024-04-14T09:59:52.922 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f70a806c8f0 0x7f70a806edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f70c4161c80 0x7f70c40cc960 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70c40d0cc0 0x7f70c40cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 --2- 172.21.15.40:0/1413813478 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f70c40b1e60 0x7f70c41f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 >> 172.21.15.40:0/1413813478 conn(0x7f70c409d5e0 msgr2=0x7f70c40d2650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 shutdown_connections 2024-04-14T09:59:52.923 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:52.922+0000 7f70caf1e640 1 -- 172.21.15.40:0/1413813478 wait complete. 2024-04-14T09:59:52.932 INFO:tasks.ceph:Scrubbing osd.2 2024-04-14T09:59:52.932 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:53.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.038+0000 7efff1f55640 1 Processor -- start 2024-04-14T09:59:53.038 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.038+0000 7efff1f55640 1 -- start start 2024-04-14T09:59:53.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7efff1f55640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec071510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7efff1f55640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effec0ce010 con 0x7effec0728e0 2024-04-14T09:59:53.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7efff1f55640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effec0720f0 con 0x7effec071a50 2024-04-14T09:59:53.040 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7efff1f55640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7effec160160 con 0x7effec0cead0 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7effeb7fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7effec0728e0 0x7effec072cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39636/0 (socket says 172.21.15.40:39636) 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7effeb7fe640 1 -- 172.21.15.40:0/383428655 learned_addr learned my addr 172.21.15.40:0/383428655 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.039+0000 7effeaffd640 1 --2- 172.21.15.40:0/383428655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec071510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 810261005 0 0) 0x7effec0ce010 con 0x7effec0728e0 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effd4003520 con 0x7effec0728e0 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311008136 0 0) 0x7effec0720f0 con 0x7effec071a50 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effec0ce010 con 0x7effec071a50 2024-04-14T09:59:53.041 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effeaffd640 1 -- 172.21.15.40:0/383428655 >> v1:172.21.15.136:6789/0 conn(0x7effec071a50 legacy=0x7effec06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effeaffd640 1 -- 172.21.15.40:0/383428655 >> v1:172.21.15.40:6789/0 conn(0x7effec0728e0 legacy=0x7effec072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.040+0000 7effeaffd640 1 -- 172.21.15.40:0/383428655 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec0723d0 con 0x7effec0cead0 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7effeaffd640 1 --2- 172.21.15.40:0/383428655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec071510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effe00097d0 tx=0x7effe002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7b14296ce674ee server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0035020 con 0x7effec0cead0 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe0031890 con 0x7effec0cead0 2024-04-14T09:59:53.042 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7effea7fc640 1 -- 172.21.15.40:0/383428655 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0031c40 con 0x7effec0cead0 2024-04-14T09:59:53.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 -- 172.21.15.40:0/383428655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 msgr2=0x7effec071510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 --2- 172.21.15.40:0/383428655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec071510 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7effe00097d0 tx=0x7effe002b930 comp rx=0 tx=0).stop 2024-04-14T09:59:53.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 -- 172.21.15.40:0/383428655 shutdown_connections 2024-04-14T09:59:53.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 --2- 172.21.15.40:0/383428655 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec071510 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.046 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 -- 172.21.15.40:0/383428655 >> 172.21.15.40:0/383428655 conn(0x7effec0b1cc0 msgr2=0x7effec0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 -- 172.21.15.40:0/383428655 shutdown_connections 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.041+0000 7efff1f55640 1 -- 172.21.15.40:0/383428655 wait complete. 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.042+0000 7efff1f55640 1 Processor -- start 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 -- start start 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effec071a50 0x7effec146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 0x7effec09cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec1e75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.047 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7effec160ce0 con 0x7effec0728e0 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7effec0ce5b0 con 0x7effec071a50 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7efff1f55640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7effec0cef40 con 0x7effec0cead0 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7effeaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 0x7effec09cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7effeaffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 0x7effec09cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34632/0 (socket says 172.21.15.40:34632) 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.043+0000 7effeaffd640 1 -- 172.21.15.40:0/2584452024 learned_addr learned my addr 172.21.15.40:0/2584452024 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeb7fe640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effec071a50 0x7effec146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effebfff640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec1e75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.048 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 -- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 msgr2=0x7effec1e75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7effec0cead0 0x7effec1e75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 -- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effec071a50 msgr2=0x7effec146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7effec071a50 0x7effec146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effec09b4f0 con 0x7effec0728e0 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effeaffd640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 0x7effec09cb30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7effe0034040 tx=0x7effe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0003820 con 0x7effec0728e0 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe00039c0 con 0x7effec0728e0 2024-04-14T09:59:53.049 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effec09b7d0 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe0003d70 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.044+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effec09bd90 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.045+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effec0757d0 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7effe004c060 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effd806c920 0x7effd806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7effe00adc20 con 0x7effec0728e0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effeb7fe640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effd806c920 0x7effd806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.050 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7effd8075190 0x7effd80775d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7effe004fe50 con 0x7effd8075190 2024-04-14T09:59:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7effe00b0320 con 0x7effec0728e0 2024-04-14T09:59:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.046+0000 7effebfff640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7effd8075190 0x7effd80775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.047+0000 7effeb7fe640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effd806c920 0x7effd806ede0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effdc000f60 tx=0x7effdc007d70 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.051 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.047+0000 7effebfff640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7effd8075190 0x7effd80775d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.052 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.047+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== osd.2 v2:172.21.15.40:6816/3712336313 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7effe004fe50 con 0x7effd8075190 2024-04-14T09:59:53.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.060+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 --> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7effec09c1c0 con 0x7effd8075190 2024-04-14T09:59:53.060 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7effd3fff640 1 -- 172.21.15.40:0/2584452024 <== osd.2 v2:172.21.15.40:6816/3712336313 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7effec09c1c0 con 0x7effd8075190 2024-04-14T09:59:53.061 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:53.061 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:53.061 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:53.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7effd8075190 msgr2=0x7effd80775d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:6816/3712336313,v1:172.21.15.40:6818/3712336313] conn(0x7effd8075190 0x7effd80775d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effd806c920 msgr2=0x7effd806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7effd806c920 0x7effd806ede0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7effdc000f60 tx=0x7effdc007d70 comp rx=0 tx=0).stop 2024-04-14T09:59:53.062 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 msgr2=0x7effec09cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 --2- 172.21.15.40:0/2584452024 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7effec0728e0 0x7effec09cb30 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7effe0034040 tx=0x7effe00046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7effebfff640 1 -- 172.21.15.40:0/2584452024 reap_dead start 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 shutdown_connections 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 >> 172.21.15.40:0/2584452024 conn(0x7effec0b1cc0 msgr2=0x7effec15bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 shutdown_connections 2024-04-14T09:59:53.063 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.061+0000 7efff1f55640 1 -- 172.21.15.40:0/2584452024 wait complete. 2024-04-14T09:59:53.071 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-14T09:59:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.174+0000 7f9ce915e640 1 Processor -- start 2024-04-14T09:59:53.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.174+0000 7f9ce915e640 1 -- start start 2024-04-14T09:59:53.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce915e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 0x7f9ce40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce915e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9ce40cef40 0x7f9ce4071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce915e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce4141690 con 0x7f9ce413e0b0 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce915e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce4071360 con 0x7f9ce40cef40 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce915e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce40cf3f0 con 0x7f9ce4140fc0 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce2d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f9ce413e0b0 0x7f9ce41408b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39652/0 (socket says 172.21.15.40:39652) 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce2d9d640 1 -- 172.21.15.40:0/427805753 learned_addr learned my addr 172.21.15.40:0/427805753 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:53.176 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce359e640 1 --2- 172.21.15.40:0/427805753 >> v2:172.21.15.136:3300/0 conn(0x7f9ce40cef40 0x7f9ce4071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce259c640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 0x7f9ce40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.175+0000 7f9ce1d9b640 1 -- 172.21.15.40:0/427805753 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942548510 0 0) 0x7f9cdc001110 con 0x7f9ce413e0b0 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce1d9b640 1 -- 172.21.15.40:0/427805753 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cd0003520 con 0x7f9ce413e0b0 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce359e640 1 -- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 msgr2=0x7f9ce40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce359e640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 0x7f9ce40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce359e640 1 -- 172.21.15.40:0/427805753 >> v1:172.21.15.40:6789/0 conn(0x7f9ce413e0b0 legacy=0x7f9ce41408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce359e640 1 -- 172.21.15.40:0/427805753 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce40cf670 con 0x7f9ce40cef40 2024-04-14T09:59:53.177 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce259c640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 0x7f9ce40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:53.178 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.176+0000 7f9ce359e640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce40cef40 0x7f9ce4071ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009d90 tx=0x7f9cd402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1656b3e2d31d812f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce1d9b640 1 -- 172.21.15.40:0/427805753 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4039070 con 0x7f9ce40cef40 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce1d9b640 1 -- 172.21.15.40:0/427805753 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd402cc50 con 0x7f9ce40cef40 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce1d9b640 1 -- 172.21.15.40:0/427805753 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4034440 con 0x7f9ce40cef40 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 -- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce40cef40 msgr2=0x7f9ce4071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce40cef40 0x7f9ce4071ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009d90 tx=0x7f9cd402bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 -- 172.21.15.40:0/427805753 shutdown_connections 2024-04-14T09:59:53.181 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce4140fc0 0x7f9ce40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 --2- 172.21.15.40:0/427805753 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce40cef40 0x7f9ce4071ad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 -- 172.21.15.40:0/427805753 >> 172.21.15.40:0/427805753 conn(0x7f9ce406eb90 msgr2=0x7f9ce406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 -- 172.21.15.40:0/427805753 shutdown_connections 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.177+0000 7f9ce915e640 1 -- 172.21.15.40:0/427805753 wait complete. 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 Processor -- start 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 -- start start 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce40cef40 0x7f9ce414db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.182 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce413e0b0 0x7f9ce40b4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40715b0 con 0x7f9ce4140fc0 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce40cfc30 con 0x7f9ce413e0b0 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.179+0000 7f9ce915e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce413e490 con 0x7f9ce40cef40 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34646/0 (socket says 172.21.15.40:34646) 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 -- 172.21.15.40:0/3526330485 learned_addr learned my addr 172.21.15.40:0/3526330485 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce259c640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce413e0b0 0x7f9ce40b4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce2d9d640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce40cef40 0x7f9ce414db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 -- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce40cef40 msgr2=0x7f9ce414db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce40cef40 0x7f9ce414db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 -- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce413e0b0 msgr2=0x7f9ce40b4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce413e0b0 0x7f9ce40b4080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 -- 172.21.15.40:0/3526330485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce414e0d0 con 0x7f9ce4140fc0 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce359e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009d90 tx=0x7f9cd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.184 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4039050 con 0x7f9ce4140fc0 2024-04-14T09:59:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd4045070 con 0x7f9ce4140fc0 2024-04-14T09:59:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce4138e50 con 0x7f9ce4140fc0 2024-04-14T09:59:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4009450 con 0x7f9ce4140fc0 2024-04-14T09:59:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.180+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce4139410 con 0x7f9ce4140fc0 2024-04-14T09:59:53.185 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.181+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce4075760 con 0x7f9ce4140fc0 2024-04-14T09:59:53.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.182+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cd403e610 con 0x7f9ce4140fc0 2024-04-14T09:59:53.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.182+0000 7f9cdb7fe640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 0x7f9cc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.182+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f9cd40ae5c0 con 0x7f9ce4140fc0 2024-04-14T09:59:53.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.182+0000 7f9ce2d9d640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 0x7f9cc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.183+0000 7f9ce2d9d640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 0x7f9cc406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc005880 tx=0x7f9cdc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.187+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f9cd407c2d0 con 0x7f9ce4140fc0 2024-04-14T09:59:53.370 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.371+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9ce4072630 con 0x7f9cc406c8f0 2024-04-14T09:59:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.371+0000 7f9cdb7fe640 1 -- 172.21.15.40:0/3526330485 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f9ce4072630 con 0x7f9cc406c8f0 2024-04-14T09:59:53.371 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 2 to deep-scrub 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 msgr2=0x7f9cc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 0x7f9cc406edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc005880 tx=0x7f9cdc009040 comp rx=0 tx=0).stop 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 msgr2=0x7f9ce40b45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4009d90 tx=0x7f9cd4004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 shutdown_connections 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f9cc406c8f0 0x7f9cc406edb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.374 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f9ce4140fc0 0x7f9ce40b45c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9ce413e0b0 0x7f9ce40b4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 --2- 172.21.15.40:0/3526330485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9ce40cef40 0x7f9ce414db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 >> 172.21.15.40:0/3526330485 conn(0x7f9ce406eb90 msgr2=0x7f9ce415ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 shutdown_connections 2024-04-14T09:59:53.375 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.374+0000 7f9ce915e640 1 -- 172.21.15.40:0/3526330485 wait complete. 2024-04-14T09:59:53.384 INFO:tasks.ceph:Scrubbing osd.3 2024-04-14T09:59:53.384 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:53.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.490+0000 7fac2371e640 1 Processor -- start 2024-04-14T09:59:53.490 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.490+0000 7fac2371e640 1 -- start start 2024-04-14T09:59:53.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac2371e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c06f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.491 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac2371e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac1c0cc1e0 0x7fac1c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac2371e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac1c0d0630 con 0x7fac1c0b4660 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac2371e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fac1c0d0910 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac2371e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c0d0bf0 con 0x7fac1c15c2d0 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac20cb9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac1c0cc1e0 0x7fac1c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac20cb9640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fac1c0cc1e0 0x7fac1c09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34654/0 (socket says 172.21.15.40:34654) 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac20cb9640 1 -- 172.21.15.40:0/3382727928 learned_addr learned my addr 172.21.15.40:0/3382727928 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.492 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.491+0000 7fac214ba640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c06f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac20cb9640 1 -- 172.21.15.40:0/3382727928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 msgr2=0x7fac1c06f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac20cb9640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c06f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac20cb9640 1 -- 172.21.15.40:0/3382727928 >> v1:172.21.15.136:6789/0 conn(0x7fac1c0b4660 legacy=0x7fac1c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.493 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac20cb9640 1 -- 172.21.15.40:0/3382727928 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0ccd00 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac20cb9640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c09aa40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac10009870 tx=0x7fac1002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497ed2a0a47255e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.492+0000 7fac1bfff640 1 -- 172.21.15.40:0/3382727928 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10034070 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac1bfff640 1 -- 172.21.15.40:0/3382727928 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac10030840 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac1bfff640 1 -- 172.21.15.40:0/3382727928 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac10030c10 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 -- 172.21.15.40:0/3382727928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0cc1e0 msgr2=0x7fac1c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c09aa40 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fac10009870 tx=0x7fac1002b980 comp rx=0 tx=0).stop 2024-04-14T09:59:53.497 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 -- 172.21.15.40:0/3382727928 shutdown_connections 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c09aa40 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 --2- 172.21.15.40:0/3382727928 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c06f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 -- 172.21.15.40:0/3382727928 >> 172.21.15.40:0/3382727928 conn(0x7fac1c0b3b40 msgr2=0x7fac1c0b3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 -- 172.21.15.40:0/3382727928 shutdown_connections 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.493+0000 7fac2371e640 1 -- 172.21.15.40:0/3382727928 wait complete. 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.494+0000 7fac2371e640 1 Processor -- start 2024-04-14T09:59:53.498 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.494+0000 7fac2371e640 1 -- start start 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 0x7fac1c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c0cb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c15c6b0 con 0x7fac1c0b4660 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac1c0d0ed0 con 0x7fac1c0cc1e0 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac2371e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac1c15c830 con 0x7fac1c15c2d0 2024-04-14T09:59:53.499 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 0x7fac1c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 0x7fac1c0b04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34664/0 (socket says 172.21.15.40:34664) 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 -- 172.21.15.40:0/4058174118 learned_addr learned my addr 172.21.15.40:0/4058174118 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac20cb9640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c0cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac21cbb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 -- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 msgr2=0x7fac1c1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 -- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1c0cc1e0 msgr2=0x7fac1c0cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1c0cc1e0 0x7fac1c0cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.500 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac214ba640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac1c0c5c20 con 0x7fac1c0b4660 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.495+0000 7fac21cbb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1c15c2d0 0x7fac1c1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac214ba640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 0x7fac1c0b04a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fac1400e8a0 tx=0x7fac1400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac14017070 con 0x7fac1c0b4660 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac1400c940 con 0x7fac1c0b4660 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac1c0c5f00 con 0x7fac1c0b4660 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac1400cd30 con 0x7fac1c0b4660 2024-04-14T09:59:53.501 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.496+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac1c0c67a0 con 0x7fac1c0b4660 2024-04-14T09:59:53.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.497+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fac1c0757d0 con 0x7fac1c0b4660 2024-04-14T09:59:53.502 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.497+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac1401a070 con 0x7fac1c0b4660 2024-04-14T09:59:53.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac19ffb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fac0806c8f0 0x7fac0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.503 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fac1408be70 con 0x7fac1c0b4660 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac20cb9640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fac0806c8f0 0x7fac0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac19ffb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fac08075160 0x7fac080775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fac14016ec0 con 0x7fac08075160 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fac1408e570 con 0x7fac1c0b4660 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac21cbb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fac08075160 0x7fac080775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac20cb9640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fac0806c8f0 0x7fac0806edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fac10036000 tx=0x7fac10008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.504 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.498+0000 7fac21cbb640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fac08075160 0x7fac080775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.505 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.499+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== osd.3 v2:172.21.15.40:6817/852135294 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fac14016ec0 con 0x7fac08075160 2024-04-14T09:59:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.512+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 --> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fac1c0ce460 con 0x7fac08075160 2024-04-14T09:59:53.512 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac19ffb640 1 -- 172.21.15.40:0/4058174118 <== osd.3 v2:172.21.15.40:6817/852135294 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fac1c0ce460 con 0x7fac08075160 2024-04-14T09:59:53.512 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:53.512 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:53.513 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fac08075160 msgr2=0x7fac080775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:6817/852135294,v1:172.21.15.40:6819/852135294] conn(0x7fac08075160 0x7fac080775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fac0806c8f0 msgr2=0x7fac0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fac0806c8f0 0x7fac0806edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fac10036000 tx=0x7fac10008030 comp rx=0 tx=0).stop 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 msgr2=0x7fac1c0b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.514 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 --2- 172.21.15.40:0/4058174118 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fac1c0b4660 0x7fac1c0b04a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fac1400e8a0 tx=0x7fac1400ed60 comp rx=0 tx=0).stop 2024-04-14T09:59:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac21cbb640 1 -- 172.21.15.40:0/4058174118 reap_dead start 2024-04-14T09:59:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 shutdown_connections 2024-04-14T09:59:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 >> 172.21.15.40:0/4058174118 conn(0x7fac1c0b3b40 msgr2=0x7fac1c158820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 shutdown_connections 2024-04-14T09:59:53.515 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.513+0000 7fac2371e640 1 -- 172.21.15.40:0/4058174118 wait complete. 2024-04-14T09:59:53.523 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-14T09:59:53.625 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.626+0000 7fa39c315640 1 Processor -- start 2024-04-14T09:59:53.626 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.626+0000 7fa39c315640 1 -- start start 2024-04-14T09:59:53.627 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39c315640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa39413e0b0 0x7fa3941408b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39c315640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa394140df0 0x7fa3940cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39c315640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa394141690 con 0x7fa3940cef40 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39c315640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa394071360 con 0x7fa394140df0 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39c315640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa3940cf3d0 con 0x7fa39413e0b0 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3998b0640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa394140df0 0x7fa3940cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39a8b2640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa3940cef40 0x7fa39415ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39662/0 (socket says 172.21.15.40:39662) 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39a8b2640 1 -- 172.21.15.40:0/3847364294 learned_addr learned my addr 172.21.15.40:0/3847364294 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa39a0b1640 1 --2- 172.21.15.40:0/3847364294 >> v2:172.21.15.136:3300/0 conn(0x7fa39413e0b0 0x7fa3941408b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.628 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3998b0640 1 -- 172.21.15.40:0/3847364294 >> v2:172.21.15.136:3300/0 conn(0x7fa39413e0b0 msgr2=0x7fa3941408b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3998b0640 1 --2- 172.21.15.40:0/3847364294 >> v2:172.21.15.136:3300/0 conn(0x7fa39413e0b0 0x7fa3941408b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3998b0640 1 -- 172.21.15.40:0/3847364294 >> v1:172.21.15.40:6789/0 conn(0x7fa3940cef40 legacy=0x7fa39415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3990af640 1 -- 172.21.15.40:0/3847364294 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1900163771 0 0) 0x7fa38c001490 con 0x7fa3940cef40 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.627+0000 7fa3998b0640 1 -- 172.21.15.40:0/3847364294 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940cf670 con 0x7fa394140df0 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.628+0000 7fa3998b0640 1 --2- 172.21.15.40:0/3847364294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa394140df0 0x7fa3940cea00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa39406f870 tx=0x7fa38402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11dd7ced812c63d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.628+0000 7fa3990af640 1 -- 172.21.15.40:0/3847364294 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384035020 con 0x7fa394140df0 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.628+0000 7fa3990af640 1 -- 172.21.15.40:0/3847364294 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa384031830 con 0x7fa394140df0 2024-04-14T09:59:53.629 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.628+0000 7fa3990af640 1 -- 172.21.15.40:0/3847364294 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384031c00 con 0x7fa394140df0 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 -- 172.21.15.40:0/3847364294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa394140df0 msgr2=0x7fa3940cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 --2- 172.21.15.40:0/3847364294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa394140df0 0x7fa3940cea00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa39406f870 tx=0x7fa38402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 -- 172.21.15.40:0/3847364294 shutdown_connections 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 --2- 172.21.15.40:0/3847364294 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa394140df0 0x7fa3940cea00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 --2- 172.21.15.40:0/3847364294 >> v2:172.21.15.136:3300/0 conn(0x7fa39413e0b0 0x7fa3941408b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.633 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 -- 172.21.15.40:0/3847364294 >> 172.21.15.40:0/3847364294 conn(0x7fa39406eb90 msgr2=0x7fa39406b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 -- 172.21.15.40:0/3847364294 shutdown_connections 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.629+0000 7fa39c315640 1 -- 172.21.15.40:0/3847364294 wait complete. 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.630+0000 7fa39c315640 1 Processor -- start 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.630+0000 7fa39c315640 1 -- start start 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa39413e0b0 0x7fa394152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa394140df0 0x7fa3941f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa3940715b0 con 0x7fa3940cef40 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa3940cfc30 con 0x7fa39413e0b0 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa39413e490 con 0x7fa394140df0 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34692/0 (socket says 172.21.15.40:34692) 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 -- 172.21.15.40:0/2033914530 learned_addr learned my addr 172.21.15.40:0/2033914530 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa3998b0640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa39413e0b0 0x7fa394152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a8b2640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa394140df0 0x7fa3941f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 -- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa394140df0 msgr2=0x7fa3941f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa394140df0 0x7fa3941f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 -- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa39413e0b0 msgr2=0x7fa394152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa39413e0b0 0x7fa394152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 -- 172.21.15.40:0/2033914530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa394153050 con 0x7fa3940cef40 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39a0b1640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e9b0 tx=0x7fa39000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa390017070 con 0x7fa3940cef40 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa39000c9a0 con 0x7fa3940cef40 2024-04-14T09:59:53.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3941532e0 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39000cd90 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.631+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3941538a0 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.632+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa394075760 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.633+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa39001a070 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.633+0000 7fa38affd640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 0x7fa37806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.633+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fa39008bc30 con 0x7fa3940cef40 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.633+0000 7fa3998b0640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 0x7fa37806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.634+0000 7fa3998b0640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 0x7fa37806ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa384036000 tx=0x7fa38403c040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.638+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa390059880 con 0x7fa3940cef40 2024-04-14T09:59:53.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.827+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fa39413b3d0 con 0x7fa37806c920 2024-04-14T09:59:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.827+0000 7fa38affd640 1 -- 172.21.15.40:0/2033914530 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa39413b3d0 con 0x7fa37806c920 2024-04-14T09:59:53.827 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 3 to deep-scrub 2024-04-14T09:59:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 msgr2=0x7fa37806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 0x7fa37806ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa384036000 tx=0x7fa38403c040 comp rx=0 tx=0).stop 2024-04-14T09:59:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 msgr2=0x7fa3941525d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa39000e9b0 tx=0x7fa39000ee70 comp rx=0 tx=0).stop 2024-04-14T09:59:53.829 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 shutdown_connections 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa37806c920 0x7fa37806ede0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa394140df0 0x7fa3941f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa39413e0b0 0x7fa394152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 --2- 172.21.15.40:0/2033914530 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa3940cef40 0x7fa3941525d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 >> 172.21.15.40:0/2033914530 conn(0x7fa39406eb90 msgr2=0x7fa394072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 shutdown_connections 2024-04-14T09:59:53.830 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.829+0000 7fa39c315640 1 -- 172.21.15.40:0/2033914530 wait complete. 2024-04-14T09:59:53.839 INFO:tasks.ceph:Scrubbing osd.4 2024-04-14T09:59:53.839 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:53.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.946+0000 7f2c3a1aa640 1 Processor -- start 2024-04-14T09:59:53.946 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.946+0000 7f2c3a1aa640 1 -- start start 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c3a1aa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2c340d2890 0x7f2c340cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c3a1aa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c340cff00 con 0x7f2c3415e860 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c3a1aa640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c340b3d10 con 0x7f2c340d4a50 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c3a1aa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2c340d01e0 con 0x7f2c340d2890 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c32ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f2c3415e860 0x7f2c340d2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39676/0 (socket says 172.21.15.40:39676) 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c32ffd640 1 -- 172.21.15.40:0/1491321399 learned_addr learned my addr 172.21.15.40:0/1491321399 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c337fe640 1 --2- 172.21.15.40:0/1491321399 >> v2:172.21.15.136:3300/0 conn(0x7f2c340d2890 0x7f2c340cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.948 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951714365 0 0) 0x7f2c340cff00 con 0x7f2c3415e860 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c20003520 con 0x7f2c3415e860 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532960539 0 0) 0x7f2c340b3d10 con 0x7f2c340d4a50 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c340cff00 con 0x7f2c340d4a50 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c337fe640 1 -- 172.21.15.40:0/1491321399 >> v1:172.21.15.136:6789/0 conn(0x7f2c340d4a50 legacy=0x7f2c340b47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c337fe640 1 -- 172.21.15.40:0/1491321399 >> v1:172.21.15.40:6789/0 conn(0x7f2c3415e860 legacy=0x7f2c340d2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.947+0000 7f2c337fe640 1 -- 172.21.15.40:0/1491321399 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c340b3ff0 con 0x7f2c340d2890 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.948+0000 7f2c337fe640 1 --2- 172.21.15.40:0/1491321399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c340cf8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097a0 tx=0x7f2c1c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=987d6924c110bba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.949 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.948+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c035020 con 0x7f2c340d2890 2024-04-14T09:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.948+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1c031830 con 0x7f2c340d2890 2024-04-14T09:59:53.950 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.948+0000 7f2c327fc640 1 -- 172.21.15.40:0/1491321399 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c031be0 con 0x7f2c340d2890 2024-04-14T09:59:53.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1491321399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 msgr2=0x7f2c340cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 --2- 172.21.15.40:0/1491321399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c340cf8d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0097a0 tx=0x7f2c1c02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1491321399 shutdown_connections 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 --2- 172.21.15.40:0/1491321399 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c340cf8d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1491321399 >> 172.21.15.40:0/1491321399 conn(0x7f2c3409d580 msgr2=0x7f2c340d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1491321399 shutdown_connections 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.949+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1491321399 wait complete. 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.950+0000 7f2c3a1aa640 1 Processor -- start 2024-04-14T09:59:53.953 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.950+0000 7f2c3a1aa640 1 -- start start 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c341605b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2c340d4a50 0x7f2c3415f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 0x7f2c340cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340b4f00 con 0x7f2c3415e860 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2c340d4ee0 con 0x7f2c340d2890 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c3a1aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2c340b5080 con 0x7f2c340d4a50 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 0x7f2c340cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.954 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 0x7f2c340cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34698/0 (socket says 172.21.15.40:34698) 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 -- 172.21.15.40:0/1977675113 learned_addr learned my addr 172.21.15.40:0/1977675113 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c32ffd640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2c340d4a50 0x7f2c3415f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c337fe640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c341605b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 -- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2c340d4a50 msgr2=0x7f2c3415f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2c340d4a50 0x7f2c3415f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 -- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 msgr2=0x7f2c341605b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2c340d2890 0x7f2c341605b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.955 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c34160eb0 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.951+0000 7f2c33fff640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 0x7f2c340cd5b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c790 tx=0x7f2c2c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c003b70 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c2c003d10 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c34161190 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c00aa50 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c3415f1c0 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.952+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2c341613d0 con 0x7f2c3415e860 2024-04-14T09:59:53.956 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.953+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c2c00abf0 con 0x7f2c3415e860 2024-04-14T09:59:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.953+0000 7f2c2bfff640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2c1406c920 0x7f2c1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f2c2c08bad0 con 0x7f2c3415e860 2024-04-14T09:59:53.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c2bfff640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f2c14075180 0x7f2c140775c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:53.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c14077c90 con 0x7f2c14075180 2024-04-14T09:59:53.961 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2c2c0902c0 con 0x7f2c3415e860 2024-04-14T09:59:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c337fe640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2c1406c920 0x7f2c1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c32ffd640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f2c14075180 0x7f2c140775c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c337fe640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2c1406c920 0x7f2c1406ede0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c036000 tx=0x7f2c1c008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.954+0000 7f2c32ffd640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f2c14075180 0x7f2c140775c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:53.962 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.955+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== osd.4 v2:172.21.15.136:6800/3007411045 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2c14077c90 con 0x7f2c14075180 2024-04-14T09:59:53.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.968+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 --> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2c340757d0 con 0x7f2c14075180 2024-04-14T09:59:53.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c2bfff640 1 -- 172.21.15.40:0/1977675113 <== osd.4 v2:172.21.15.136:6800/3007411045 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2c340757d0 con 0x7f2c14075180 2024-04-14T09:59:53.969 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:53.969 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:53.969 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:53.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f2c14075180 msgr2=0x7f2c140775c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6800/3007411045,v1:172.21.15.136:6801/3007411045] conn(0x7f2c14075180 0x7f2c140775c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:53.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2c1406c920 msgr2=0x7f2c1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f2c1406c920 0x7f2c1406ede0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c036000 tx=0x7f2c1c008030 comp rx=0 tx=0).stop 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 msgr2=0x7f2c340cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 --2- 172.21.15.40:0/1977675113 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f2c3415e860 0x7f2c340cd5b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c790 tx=0x7f2c2c00cc50 comp rx=0 tx=0).stop 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c33fff640 1 -- 172.21.15.40:0/1977675113 reap_dead start 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 shutdown_connections 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 >> 172.21.15.40:0/1977675113 conn(0x7f2c3409d580 msgr2=0x7f2c3415db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 shutdown_connections 2024-04-14T09:59:53.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:53.969+0000 7f2c3a1aa640 1 -- 172.21.15.40:0/1977675113 wait complete. 2024-04-14T09:59:53.979 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-14T09:59:54.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.082+0000 7fae11ade640 1 Processor -- start 2024-04-14T09:59:54.082 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.082+0000 7fae11ade640 1 -- start start 2024-04-14T09:59:54.084 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae11ade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c09aa40 0x7fae0c070810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae11ade640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae0c0b4700 0x7fae0c09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae11ade640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae0c0d1e60 con 0x7fae0c06f560 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae11ade640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fae0c0b19c0 con 0x7fae0c0b4700 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae11ade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c0d1670 con 0x7fae0c09aa40 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae0c0b4700 0x7fae0c09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0bfff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fae0c06f560 0x7fae0c06f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39682/0 (socket says 172.21.15.40:39682) 2024-04-14T09:59:54.085 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fae0c0b4700 0x7fae0c09ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34700/0 (socket says 172.21.15.40:34700) 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0bfff640 1 -- 172.21.15.40:0/3601198397 learned_addr learned my addr 172.21.15.40:0/3601198397 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0b7fe640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c09aa40 0x7fae0c070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 -- 172.21.15.40:0/3601198397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c09aa40 msgr2=0x7fae0c070810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c09aa40 0x7fae0c070810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 -- 172.21.15.40:0/3601198397 >> v1:172.21.15.40:6789/0 conn(0x7fae0c06f560 legacy=0x7fae0c06f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0a7fc640 1 -- 172.21.15.40:0/3601198397 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384892518 0 0) 0x7fae04001490 con 0x7fae0c06f560 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.083+0000 7fae0affd640 1 -- 172.21.15.40:0/3601198397 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c09b360 con 0x7fae0c0b4700 2024-04-14T09:59:54.086 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.084+0000 7fae0affd640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c0b4700 0x7fae0c09ae20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874ee3567b2550d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.084+0000 7fae0a7fc640 1 -- 172.21.15.40:0/3601198397 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00035020 con 0x7fae0c0b4700 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.084+0000 7fae0a7fc640 1 -- 172.21.15.40:0/3601198397 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00031830 con 0x7fae0c0b4700 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.084+0000 7fae0a7fc640 1 -- 172.21.15.40:0/3601198397 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00031c00 con 0x7fae0c0b4700 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 -- 172.21.15.40:0/3601198397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c0b4700 msgr2=0x7fae0c09ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c0b4700 0x7fae0c09ae20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae0002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 -- 172.21.15.40:0/3601198397 shutdown_connections 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c0b4700 0x7fae0c09ae20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.087 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 --2- 172.21.15.40:0/3601198397 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c09aa40 0x7fae0c070810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 -- 172.21.15.40:0/3601198397 >> 172.21.15.40:0/3601198397 conn(0x7fae0c0b3be0 msgr2=0x7fae0c0b3ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 -- 172.21.15.40:0/3601198397 shutdown_connections 2024-04-14T09:59:54.088 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.085+0000 7fae11ade640 1 -- 172.21.15.40:0/3601198397 wait complete. 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.086+0000 7fae11ade640 1 Processor -- start 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.086+0000 7fae11ade640 1 -- start start 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c06f560 0x7fae0c1f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae0c0b4700 0x7fae0c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.091 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c0710c0 con 0x7fae0c09aa40 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c070de0 con 0x7fae0c0b4700 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae11ade640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fae0c06c6d0 con 0x7fae0c06f560 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34710/0 (socket says 172.21.15.40:34710) 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 -- 172.21.15.40:0/1641074628 learned_addr learned my addr 172.21.15.40:0/1641074628 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0b7fe640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c06f560 0x7fae0c1f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0bfff640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae0c0b4700 0x7fae0c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.092 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 -- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c06f560 msgr2=0x7fae0c1f49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c06f560 0x7fae0c1f49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 -- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae0c0b4700 msgr2=0x7fae0c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae0c0b4700 0x7fae0c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 -- 172.21.15.40:0/1641074628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1f4f20 con 0x7fae0c09aa40 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fae0affd640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.087+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae00035070 con 0x7fae0c09aa40 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.088+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00004230 con 0x7fae0c09aa40 2024-04-14T09:59:54.093 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.088+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1e9240 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.088+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0003a630 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.088+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c0b66c0 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.088+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c075760 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.089+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae00038020 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.089+0000 7fadf3fff640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.089+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fae000ad7f0 con 0x7fae0c09aa40 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.089+0000 7fae0b7fe640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.094 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.090+0000 7fae0b7fe640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 0x7fadf806edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06d9d0 tx=0x7fadfc009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.095 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.094+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fae0c1f4f20 con 0x7fae0c09aa40 2024-04-14T09:59:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.277+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fae0c1e9520 con 0x7fadf806c8f0 2024-04-14T09:59:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.278+0000 7fadf3fff640 1 -- 172.21.15.40:0/1641074628 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fadfc011a30 con 0x7fadf806c8f0 2024-04-14T09:59:54.277 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 4 to deep-scrub 2024-04-14T09:59:54.279 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 msgr2=0x7fadf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 0x7fadf806edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fae0c06d9d0 tx=0x7fadfc009190 comp rx=0 tx=0).stop 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 msgr2=0x7fae0c1df740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fae000097a0 tx=0x7fae000046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 shutdown_connections 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fadf806c8f0 0x7fadf806edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fae0c0b4700 0x7fae0c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fae0c09aa40 0x7fae0c1df740 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.280 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 --2- 172.21.15.40:0/1641074628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fae0c06f560 0x7fae0c1f49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 >> 172.21.15.40:0/1641074628 conn(0x7fae0c0b3be0 msgr2=0x7fae0c0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 shutdown_connections 2024-04-14T09:59:54.281 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.280+0000 7fae11ade640 1 -- 172.21.15.40:0/1641074628 wait complete. 2024-04-14T09:59:54.290 INFO:tasks.ceph:Scrubbing osd.5 2024-04-14T09:59:54.290 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.396+0000 7f3d5df95640 1 Processor -- start 2024-04-14T09:59:54.396 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.396+0000 7f3d5df95640 1 -- start start 2024-04-14T09:59:54.397 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d5df95640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3d5815e860 0x7f3d580c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d5df95640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580d0670 con 0x7f3d58162950 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d5df95640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580d0950 con 0x7f3d58162570 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d5df95640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3d580d0c30 con 0x7f3d5815e860 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d56ffd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f3d58162950 0x7f3d5815e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39692/0 (socket says 172.21.15.40:39692) 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d56ffd640 1 -- 172.21.15.40:0/2274329811 learned_addr learned my addr 172.21.15.40:0/2274329811 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.397+0000 7f3d57fff640 1 --2- 172.21.15.40:0/2274329811 >> v2:172.21.15.136:3300/0 conn(0x7f3d5815e860 0x7f3d580c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037924783 0 0) 0x7f3d580d0670 con 0x7f3d58162950 2024-04-14T09:59:54.398 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d40003520 con 0x7f3d58162950 2024-04-14T09:59:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4198770634 0 0) 0x7f3d580d0950 con 0x7f3d58162570 2024-04-14T09:59:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d580d0670 con 0x7f3d58162570 2024-04-14T09:59:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d57fff640 1 -- 172.21.15.40:0/2274329811 >> v1:172.21.15.136:6789/0 conn(0x7f3d58162570 legacy=0x7f3d580cfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d57fff640 1 -- 172.21.15.40:0/2274329811 >> v1:172.21.15.40:6789/0 conn(0x7f3d58162950 legacy=0x7f3d5815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.399 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d57fff640 1 -- 172.21.15.40:0/2274329811 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d580d0f10 con 0x7f3d5815e860 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.398+0000 7f3d57fff640 1 --2- 172.21.15.40:0/2274329811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d5815e860 0x7f3d580c9f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009d90 tx=0x7f3d5002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7525d5813932bc58 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50039070 con 0x7f3d5815e860 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d5002cd00 con 0x7f3d5815e860 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d567fc640 1 -- 172.21.15.40:0/2274329811 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50034640 con 0x7f3d5815e860 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 -- 172.21.15.40:0/2274329811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d5815e860 msgr2=0x7f3d580c9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 --2- 172.21.15.40:0/2274329811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d5815e860 0x7f3d580c9f50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009d90 tx=0x7f3d5002bf50 comp rx=0 tx=0).stop 2024-04-14T09:59:54.402 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 -- 172.21.15.40:0/2274329811 shutdown_connections 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 --2- 172.21.15.40:0/2274329811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d5815e860 0x7f3d580c9f50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 -- 172.21.15.40:0/2274329811 >> 172.21.15.40:0/2274329811 conn(0x7f3d5809d5a0 msgr2=0x7f3d580d42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 -- 172.21.15.40:0/2274329811 shutdown_connections 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.399+0000 7f3d5df95640 1 -- 172.21.15.40:0/2274329811 wait complete. 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.400+0000 7f3d5df95640 1 Processor -- start 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 -- start start 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d5815e860 0x7f3d580ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d58162570 0x7f3d580cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.403 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 0x7f3d580cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f3d58162fe0 con 0x7f3d58162950 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3d580d02e0 con 0x7f3d58162570 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d5df95640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3d58163160 con 0x7f3d5815e860 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 0x7f3d580cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d57fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 0x7f3d580cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34712/0 (socket says 172.21.15.40:34712) 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d57fff640 1 -- 172.21.15.40:0/655146748 learned_addr learned my addr 172.21.15.40:0/655146748 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d56ffd640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d58162570 0x7f3d580cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.401+0000 7f3d577fe640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d5815e860 0x7f3d580ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.404 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 -- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d5815e860 msgr2=0x7f3d580ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3d5815e860 0x7f3d580ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 -- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d58162570 msgr2=0x7f3d580cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3d58162570 0x7f3d580cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d580cc850 con 0x7f3d58162950 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d57fff640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 0x7f3d580cd8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009eb0 tx=0x7f3d50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50039050 con 0x7f3d58162950 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d50045070 con 0x7f3d58162950 2024-04-14T09:59:54.405 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d580ccb30 con 0x7f3d58162950 2024-04-14T09:59:54.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50009450 con 0x7f3d58162950 2024-04-14T09:59:54.406 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.402+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d580cd0f0 con 0x7f3d58162950 2024-04-14T09:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.403+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3d580757d0 con 0x7f3d58162950 2024-04-14T09:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.403+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3d5003e830 con 0x7f3d58162950 2024-04-14T09:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d3ffff640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d4406c8f0 0x7f3d4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.407 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f3d500ae7a0 con 0x7f3d58162950 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d577fe640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d4406c8f0 0x7f3d4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d3ffff640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7f3d440750e0 0x7f3d44077520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d50041e50 con 0x7f3d440750e0 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3d500b32c0 con 0x7f3d58162950 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d56ffd640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7f3d440750e0 0x7f3d44077520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.404+0000 7f3d577fe640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d4406c8f0 0x7f3d4406edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3d48007fd0 tx=0x7f3d48009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.405+0000 7f3d56ffd640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7f3d440750e0 0x7f3d44077520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.408 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.405+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== osd.5 v2:172.21.15.136:6816/265445102 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3d50041e50 con 0x7f3d440750e0 2024-04-14T09:59:54.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.418+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 --> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3d580b5060 con 0x7f3d440750e0 2024-04-14T09:59:54.418 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d3ffff640 1 -- 172.21.15.40:0/655146748 <== osd.5 v2:172.21.15.136:6816/265445102 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3d580b5060 con 0x7f3d440750e0 2024-04-14T09:59:54.418 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:54.419 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:54.419 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7f3d440750e0 msgr2=0x7f3d44077520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6816/265445102,v1:172.21.15.136:6817/265445102] conn(0x7f3d440750e0 0x7f3d44077520 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d4406c8f0 msgr2=0x7f3d4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f3d4406c8f0 0x7f3d4406edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3d48007fd0 tx=0x7f3d48009040 comp rx=0 tx=0).stop 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 msgr2=0x7f3d580cd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.420 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 --2- 172.21.15.40:0/655146748 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f3d58162950 0x7f3d580cd8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f3d50009eb0 tx=0x7f3d50004a40 comp rx=0 tx=0).stop 2024-04-14T09:59:54.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d57fff640 1 -- 172.21.15.40:0/655146748 reap_dead start 2024-04-14T09:59:54.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 shutdown_connections 2024-04-14T09:59:54.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 >> 172.21.15.40:0/655146748 conn(0x7f3d5809d5a0 msgr2=0x7f3d5815eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 shutdown_connections 2024-04-14T09:59:54.421 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.419+0000 7f3d5df95640 1 -- 172.21.15.40:0/655146748 wait complete. 2024-04-14T09:59:54.429 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-14T09:59:54.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.532+0000 7fbecdd11640 1 Processor -- start 2024-04-14T09:59:54.532 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.532+0000 7fbecdd11640 1 -- start start 2024-04-14T09:59:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbecdd11640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbec815c720 0x7fbec80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.533 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbecdd11640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec806f630 0x7fbec80cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbecdd11640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec80ce110 con 0x7fbec815c340 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbecdd11640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fbec80d0710 con 0x7fbec815c720 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbecdd11640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80cd030 con 0x7fbec806f630 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbec7fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec806f630 0x7fbec80cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbec6ffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fbec815c720 0x7fbec80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbec77fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fbec815c340 0x7fbec80cd4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:41268/0 (socket says 172.21.15.40:41268) 2024-04-14T09:59:54.534 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.533+0000 7fbec77fe640 1 -- 172.21.15.40:0/204444693 learned_addr learned my addr 172.21.15.40:0/204444693 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.534+0000 7fbec6ffd640 1 -- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec806f630 msgr2=0x7fbec80cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.534+0000 7fbec6ffd640 1 --2- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec806f630 0x7fbec80cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.534+0000 7fbec6ffd640 1 -- 172.21.15.40:0/204444693 >> v1:172.21.15.136:6789/0 conn(0x7fbec815c340 legacy=0x7fbec80cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.534+0000 7fbec6ffd640 1 -- 172.21.15.40:0/204444693 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80d0960 con 0x7fbec815c720 2024-04-14T09:59:54.535 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.534+0000 7fbec67fc640 1 -- 172.21.15.40:0/204444693 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038476010 0 0) 0x7fbeb8001110 con 0x7fbec815c340 2024-04-14T09:59:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbec6ffd640 1 --2- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec815c720 0x7fbec80b4740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097a0 tx=0x7fbebc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b727672c1bd11e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbec67fc640 1 -- 172.21.15.40:0/204444693 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc035020 con 0x7fbec815c720 2024-04-14T09:59:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbec67fc640 1 -- 172.21.15.40:0/204444693 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc031830 con 0x7fbec815c720 2024-04-14T09:59:54.538 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbec67fc640 1 -- 172.21.15.40:0/204444693 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc031c00 con 0x7fbec815c720 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 -- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec815c720 msgr2=0x7fbec80b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 --2- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec815c720 0x7fbec80b4740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097a0 tx=0x7fbebc02b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 -- 172.21.15.40:0/204444693 shutdown_connections 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 --2- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec806f630 0x7fbec80cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 --2- 172.21.15.40:0/204444693 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec815c720 0x7fbec80b4740 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 -- 172.21.15.40:0/204444693 >> 172.21.15.40:0/204444693 conn(0x7fbec80b3c20 msgr2=0x7fbec80b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 -- 172.21.15.40:0/204444693 shutdown_connections 2024-04-14T09:59:54.539 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.535+0000 7fbecdd11640 1 -- 172.21.15.40:0/204444693 wait complete. 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.536+0000 7fbecdd11640 1 Processor -- start 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 -- start start 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec806f630 0x7fbec80ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 0x7fbec81589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fbec80d0f20 con 0x7fbec815c720 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fbec806fae0 con 0x7fbec806f630 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbecdd11640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fbec80ccc20 con 0x7fbec815c340 2024-04-14T09:59:54.540 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbec7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbec7fff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34718/0 (socket says 172.21.15.40:34718) 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbec7fff640 1 -- 172.21.15.40:0/649528905 learned_addr learned my addr 172.21.15.40:0/649528905 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbec6ffd640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 0x7fbec81589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.537+0000 7fbec77fe640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec806f630 0x7fbec80ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 -- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 msgr2=0x7fbec81589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 0x7fbec81589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 -- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec806f630 msgr2=0x7fbec80ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec806f630 0x7fbec80ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.541 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 -- 172.21.15.40:0/649528905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec80ca860 con 0x7fbec815c720 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec6ffd640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 0x7fbec81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbec7fff640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbec000efc0 tx=0x7fbec000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0018020 con 0x7fbec815c720 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbec0014480 con 0x7fbec815c720 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec80c6f10 con 0x7fbec815c720 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbec0014870 con 0x7fbec815c720 2024-04-14T09:59:54.542 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.538+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec815e5d0 con 0x7fbec815c720 2024-04-14T09:59:54.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.539+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec8075760 con 0x7fbec815c720 2024-04-14T09:59:54.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.539+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbec0005d10 con 0x7fbec815c720 2024-04-14T09:59:54.543 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.540+0000 7fbeaffff640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.540+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fbec008c530 con 0x7fbec815c720 2024-04-14T09:59:54.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.540+0000 7fbec77fe640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.540+0000 7fbec77fe640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 0x7fbeb406ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb8007b50 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.544 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.544+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fbec0022070 con 0x7fbec815c720 2024-04-14T09:59:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.728+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fbec80b80b0 con 0x7fbeb406c920 2024-04-14T09:59:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.728+0000 7fbeaffff640 1 -- 172.21.15.40:0/649528905 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbec80b80b0 con 0x7fbeb406c920 2024-04-14T09:59:54.728 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 5 to deep-scrub 2024-04-14T09:59:54.730 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.730+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 msgr2=0x7fbeb406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.730+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 0x7fbeb406ede0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8000f60 tx=0x7fbeb8007b50 comp rx=0 tx=0).stop 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.730+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 msgr2=0x7fbec80c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.730+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbec000efc0 tx=0x7fbec000c490 comp rx=0 tx=0).stop 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 shutdown_connections 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fbeb406c920 0x7fbeb406ede0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fbec815c720 0x7fbec80c85b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fbec815c340 0x7fbec81589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.731 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 --2- 172.21.15.40:0/649528905 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fbec806f630 0x7fbec80ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 >> 172.21.15.40:0/649528905 conn(0x7fbec80b3c20 msgr2=0x7fbec806fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 shutdown_connections 2024-04-14T09:59:54.732 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.731+0000 7fbecdd11640 1 -- 172.21.15.40:0/649528905 wait complete. 2024-04-14T09:59:54.741 INFO:tasks.ceph:Scrubbing osd.6 2024-04-14T09:59:54.741 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:54.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.848+0000 7f6a0d755640 1 Processor -- start 2024-04-14T09:59:54.848 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.848+0000 7f6a0d755640 1 -- start start 2024-04-14T09:59:54.849 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a0d755640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a0809aa40 0x7f6a080d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a0d755640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a080d1350 0x7f6a0809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a0d755640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a080cc6f0 con 0x7f6a0806c840 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a0d755640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0809b360 con 0x7f6a080d1350 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a0d755640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6a080d17e0 con 0x7f6a0809aa40 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a067fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f6a080d1350 0x7f6a0809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a077fe640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6a0806c840 0x7f6a0806cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39700/0 (socket says 172.21.15.40:39700) 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a077fe640 1 -- 172.21.15.40:0/637550742 learned_addr learned my addr 172.21.15.40:0/637550742 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:54.850 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a06ffd640 1 --2- 172.21.15.40:0/637550742 >> v2:172.21.15.136:3300/0 conn(0x7f6a0809aa40 0x7f6a080d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a067fc640 1 -- 172.21.15.40:0/637550742 >> v2:172.21.15.136:3300/0 conn(0x7f6a0809aa40 msgr2=0x7f6a080d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a067fc640 1 --2- 172.21.15.40:0/637550742 >> v2:172.21.15.136:3300/0 conn(0x7f6a0809aa40 0x7f6a080d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a067fc640 1 -- 172.21.15.40:0/637550742 >> v1:172.21.15.40:6789/0 conn(0x7f6a0806c840 legacy=0x7f6a0806cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a067fc640 1 -- 172.21.15.40:0/637550742 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a080cc990 con 0x7f6a080d1350 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.849+0000 7f6a05ffb640 1 -- 172.21.15.40:0/637550742 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341938351 0 0) 0x7f6a080cc6f0 con 0x7f6a0806c840 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.850+0000 7f6a067fc640 1 --2- 172.21.15.40:0/637550742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a080d1350 0x7f6a0809ae20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6a08073040 tx=0x7f69f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c43cbfd5d24514 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.851 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.850+0000 7f6a05ffb640 1 -- 172.21.15.40:0/637550742 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0035020 con 0x7f6a080d1350 2024-04-14T09:59:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.850+0000 7f6a05ffb640 1 -- 172.21.15.40:0/637550742 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f0031830 con 0x7f6a080d1350 2024-04-14T09:59:54.852 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.850+0000 7f6a05ffb640 1 -- 172.21.15.40:0/637550742 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f0031c00 con 0x7f6a080d1350 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 -- 172.21.15.40:0/637550742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a080d1350 msgr2=0x7f6a0809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 --2- 172.21.15.40:0/637550742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a080d1350 0x7f6a0809ae20 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6a08073040 tx=0x7f69f002b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 -- 172.21.15.40:0/637550742 shutdown_connections 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 --2- 172.21.15.40:0/637550742 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a080d1350 0x7f6a0809ae20 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 --2- 172.21.15.40:0/637550742 >> v2:172.21.15.136:3300/0 conn(0x7f6a0809aa40 0x7f6a080d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 -- 172.21.15.40:0/637550742 >> 172.21.15.40:0/637550742 conn(0x7f6a080b3af0 msgr2=0x7f6a080b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.856 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 -- 172.21.15.40:0/637550742 shutdown_connections 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.851+0000 7f6a0d755640 1 -- 172.21.15.40:0/637550742 wait complete. 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.852+0000 7f6a0d755640 1 Processor -- start 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.852+0000 7f6a0d755640 1 -- start start 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 0x7f6a08151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a0809aa40 0x7f6a081f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a080c90d0 0x7f6a081f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0815e7f0 con 0x7f6a0806c840 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6a080d1ac0 con 0x7f6a0809aa40 2024-04-14T09:59:54.857 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a0d755640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0815e970 con 0x7f6a080c90d0 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 0x7f6a08151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 0x7f6a08151620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34732/0 (socket says 172.21.15.40:34732) 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 -- 172.21.15.40:0/3345299644 learned_addr learned my addr 172.21.15.40:0/3345299644 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a067fc640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a0809aa40 0x7f6a081f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a077fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a080c90d0 0x7f6a081f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 -- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a080c90d0 msgr2=0x7f6a081f7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a080c90d0 0x7f6a081f7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.858 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 -- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a0809aa40 msgr2=0x7f6a081f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a0809aa40 0x7f6a081f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a080c9670 con 0x7f6a0806c840 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a077fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a080c90d0 0x7f6a081f7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.853+0000 7f6a06ffd640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 0x7f6a08151620 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f69f800efc0 tx=0x7f69f800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8018020 con 0x7f6a0806c840 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f8014480 con 0x7f6a0806c840 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f8014870 con 0x7f6a0806c840 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a080c9950 con 0x7f6a0806c840 2024-04-14T09:59:54.859 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a080c9f10 con 0x7f6a0806c840 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.854+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6a080757d0 con 0x7f6a0806c840 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.855+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69f8005d10 con 0x7f6a0806c840 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.855+0000 7f69ff7fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f69e806c8f0 0x7f69e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.855+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f69f808c700 con 0x7f6a0806c840 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f6a067fc640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f69e806c8f0 0x7f69e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f69ff7fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f69e8075160 0x7f69e80775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f69f800be50 con 0x7f69e8075160 2024-04-14T09:59:54.860 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f69f8093050 con 0x7f6a0806c840 2024-04-14T09:59:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f6a077fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f69e8075160 0x7f69e80775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f6a067fc640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f69e806c8f0 0x7f69e806edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f69f0036000 tx=0x7f69f0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.856+0000 7f6a077fe640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f69e8075160 0x7f69e80775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.861 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.857+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== osd.6 v2:172.21.15.136:6808/829650642 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f69f800be50 con 0x7f69e8075160 2024-04-14T09:59:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.870+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 --> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6a080cd230 con 0x7f69e8075160 2024-04-14T09:59:54.869 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.870+0000 7f69ff7fe640 1 -- 172.21.15.40:0/3345299644 <== osd.6 v2:172.21.15.136:6808/829650642 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6a080cd230 con 0x7f69e8075160 2024-04-14T09:59:54.870 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:54.870 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:54.870 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.870+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f69e8075160 msgr2=0x7f69e80775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6808/829650642,v1:172.21.15.136:6809/829650642] conn(0x7f69e8075160 0x7f69e80775a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f69e806c8f0 msgr2=0x7f69e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.871 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f69e806c8f0 0x7f69e806edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f69f0036000 tx=0x7f69f0008030 comp rx=0 tx=0).stop 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 msgr2=0x7f6a08151620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 --2- 172.21.15.40:0/3345299644 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6a0806c840 0x7f6a08151620 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f69f800efc0 tx=0x7f69f800c490 comp rx=0 tx=0).stop 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a077fe640 1 -- 172.21.15.40:0/3345299644 reap_dead start 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 shutdown_connections 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 >> 172.21.15.40:0/3345299644 conn(0x7f6a080b3af0 msgr2=0x7f6a080cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 shutdown_connections 2024-04-14T09:59:54.872 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.871+0000 7f6a0d755640 1 -- 172.21.15.40:0/3345299644 wait complete. 2024-04-14T09:59:54.880 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-14T09:59:54.984 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.984+0000 7fb900ede640 1 Processor -- start 2024-04-14T09:59:54.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.984+0000 7fb900ede640 1 -- start start 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb900ede640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8fc161c80 0x7fb8fc0d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb900ede640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb8fc0d2e50 0x7fb8fc0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb900ede640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8fc0b10e0 con 0x7fb8fc0d1200 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb900ede640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc0b1380 con 0x7fb8fc161c80 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb900ede640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb8fc0b1660 con 0x7fb8fc0d2e50 2024-04-14T09:59:54.987 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb8fa59c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fb8fc161c80 0x7fb8fc0d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb8fad9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb8fc0d1200 0x7fb8fc0cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39714/0 (socket says 172.21.15.40:39714) 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb8fad9d640 1 -- 172.21.15.40:0/322228982 learned_addr learned my addr 172.21.15.40:0/322228982 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.985+0000 7fb8f9d9b640 1 --2- 172.21.15.40:0/322228982 >> v2:172.21.15.136:3300/0 conn(0x7fb8fc0d2e50 0x7fb8fc0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8fa59c640 1 -- 172.21.15.40:0/322228982 >> v2:172.21.15.136:3300/0 conn(0x7fb8fc0d2e50 msgr2=0x7fb8fc0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8fa59c640 1 --2- 172.21.15.40:0/322228982 >> v2:172.21.15.136:3300/0 conn(0x7fb8fc0d2e50 0x7fb8fc0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8fa59c640 1 -- 172.21.15.40:0/322228982 >> v1:172.21.15.40:6789/0 conn(0x7fb8fc0d1200 legacy=0x7fb8fc0cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8fa59c640 1 -- 172.21.15.40:0/322228982 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0d3340 con 0x7fb8fc161c80 2024-04-14T09:59:54.988 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8f959a640 1 -- 172.21.15.40:0/322228982 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3088053248 0 0) 0x7fb8fc0b10e0 con 0x7fb8fc0d1200 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.986+0000 7fb8fa59c640 1 --2- 172.21.15.40:0/322228982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0d2910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc08cc30 tx=0x7fb8f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a25de1b5f9a61459 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb8f959a640 1 -- 172.21.15.40:0/322228982 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f40315a0 con 0x7fb8fc161c80 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb8f959a640 1 -- 172.21.15.40:0/322228982 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8f4037070 con 0x7fb8fc161c80 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb8f959a640 1 -- 172.21.15.40:0/322228982 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4031960 con 0x7fb8fc161c80 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 -- 172.21.15.40:0/322228982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 msgr2=0x7fb8fc0d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 --2- 172.21.15.40:0/322228982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0d2910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc08cc30 tx=0x7fb8f402b840 comp rx=0 tx=0).stop 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 -- 172.21.15.40:0/322228982 shutdown_connections 2024-04-14T09:59:54.989 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 --2- 172.21.15.40:0/322228982 >> v2:172.21.15.136:3300/0 conn(0x7fb8fc0d2e50 0x7fb8fc0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 --2- 172.21.15.40:0/322228982 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0d2910 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 -- 172.21.15.40:0/322228982 >> 172.21.15.40:0/322228982 conn(0x7fb8fc09d5e0 msgr2=0x7fb8fc0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 -- 172.21.15.40:0/322228982 shutdown_connections 2024-04-14T09:59:54.990 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.987+0000 7fb900ede640 1 -- 172.21.15.40:0/322228982 wait complete. 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 Processor -- start 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 -- start start 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8fc0d1200 0x7fb8fc15d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8fc0d2e50 0x7fb8fc0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b2e70 con 0x7fb8fc161c80 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb8fc0d0390 con 0x7fb8fc0d2e50 2024-04-14T09:59:54.993 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb900ede640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb8fc0b2ff0 con 0x7fb8fc0d1200 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb8fad9d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34742/0 (socket says 172.21.15.40:34742) 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.989+0000 7fb8fad9d640 1 -- 172.21.15.40:0/486626729 learned_addr learned my addr 172.21.15.40:0/486626729 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8f9d9b640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8fc0d2e50 0x7fb8fc0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fa59c640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8fc0d1200 0x7fb8fc15d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 -- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8fc0d1200 msgr2=0x7fb8fc15d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.994 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8fc0d1200 0x7fb8fc15d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 -- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8fc0d2e50 msgr2=0x7fb8fc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8fc0d2e50 0x7fb8fc0cd9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 -- 172.21.15.40:0/486626729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8fc0cb4f0 con 0x7fb8fc161c80 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8fad9d640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c700 tx=0x7fb8ec00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec018070 con 0x7fb8fc161c80 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00ce10 con 0x7fb8fc161c80 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8fc0cb7d0 con 0x7fb8fc161c80 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8ec00a880 con 0x7fb8fc161c80 2024-04-14T09:59:54.995 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.990+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8fc0cc070 con 0x7fb8fc161c80 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.991+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8fc075760 con 0x7fb8fc161c80 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.991+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8ec01b070 con 0x7fb8fc161c80 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.992+0000 7fb8f2ffd640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 0x7fb8dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.992+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fb8ec08b120 con 0x7fb8fc161c80 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.992+0000 7fb8fa59c640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 0x7fb8dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:54.996 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.992+0000 7fb8fa59c640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 0x7fb8dc06edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4036000 tx=0x7fb8f403d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:54.997 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:54.996+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb8ec058e00 con 0x7fb8fc161c80 2024-04-14T09:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.183+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fb8fc0cc240 con 0x7fb8dc06c8f0 2024-04-14T09:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.184+0000 7fb8f2ffd640 1 -- 172.21.15.40:0/486626729 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb8fc0cc240 con 0x7fb8dc06c8f0 2024-04-14T09:59:55.183 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 6 to deep-scrub 2024-04-14T09:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 msgr2=0x7fb8dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 0x7fb8dc06edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4036000 tx=0x7fb8f403d040 comp rx=0 tx=0).stop 2024-04-14T09:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 msgr2=0x7fb8fc0cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec00c700 tx=0x7fb8ec00cbc0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.186 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 shutdown_connections 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb8dc06c8f0 0x7fb8dc06edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb8fc161c80 0x7fb8fc0cdf20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8fc0d2e50 0x7fb8fc0cd9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 --2- 172.21.15.40:0/486626729 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8fc0d1200 0x7fb8fc15d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 >> 172.21.15.40:0/486626729 conn(0x7fb8fc09d5e0 msgr2=0x7fb8fc0d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 shutdown_connections 2024-04-14T09:59:55.187 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.186+0000 7fb900ede640 1 -- 172.21.15.40:0/486626729 wait complete. 2024-04-14T09:59:55.196 INFO:tasks.ceph:Scrubbing osd.7 2024-04-14T09:59:55.197 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-14T09:59:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.303+0000 7f6dd03aa640 1 Processor -- start 2024-04-14T09:59:55.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.303+0000 7f6dd03aa640 1 -- start start 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dd03aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 0x7f6dc8072cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dd03aa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6dc8071c20 0x7f6dc806e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dd03aa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc8073200 con 0x7f6dc80cead0 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dd03aa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc8160160 con 0x7f6dc8071c20 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dd03aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc80ce010 con 0x7f6dc80728e0 2024-04-14T09:59:55.304 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dcd945640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f6dc80cead0 0x7f6dc8071510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39726/0 (socket says 172.21.15.40:39726) 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dcd945640 1 -- 172.21.15.40:0/3503842817 learned_addr learned my addr 172.21.15.40:0/3503842817 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce146640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 0x7f6dc8072cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce947640 1 --2- 172.21.15.40:0/3503842817 >> v2:172.21.15.136:3300/0 conn(0x7f6dc8071c20 0x7f6dc806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dcd144640 1 -- 172.21.15.40:0/3503842817 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3041803715 0 0) 0x7f6dc8073200 con 0x7f6dc80cead0 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dcd144640 1 -- 172.21.15.40:0/3503842817 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6db4003520 con 0x7f6dc80cead0 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce947640 1 -- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 msgr2=0x7f6dc8072cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce947640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 0x7f6dc8072cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.305 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce947640 1 -- 172.21.15.40:0/3503842817 >> v1:172.21.15.40:6789/0 conn(0x7f6dc80cead0 legacy=0x7f6dc8071510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce947640 1 -- 172.21.15.40:0/3503842817 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc80720f0 con 0x7f6dc8071c20 2024-04-14T09:59:55.306 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.304+0000 7f6dce146640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 0x7f6dc8072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.305+0000 7f6dce947640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc8071c20 0x7f6dc806e350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009d90 tx=0x7f6dc002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70acbc8cf66c6394 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.305+0000 7f6dcd144640 1 -- 172.21.15.40:0/3503842817 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0039070 con 0x7f6dc8071c20 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.305+0000 7f6dcd144640 1 -- 172.21.15.40:0/3503842817 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc002cc50 con 0x7f6dc8071c20 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.305+0000 7f6dcd144640 1 -- 172.21.15.40:0/3503842817 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0034440 con 0x7f6dc8071c20 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 -- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc8071c20 msgr2=0x7f6dc806e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc8071c20 0x7f6dc806e350 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6dc0009d90 tx=0x7f6dc002bea0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 -- 172.21.15.40:0/3503842817 shutdown_connections 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc8071c20 0x7f6dc806e350 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/3503842817 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80728e0 0x7f6dc8072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 -- 172.21.15.40:0/3503842817 >> 172.21.15.40:0/3503842817 conn(0x7f6dc80b1cc0 msgr2=0x7f6dc80b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 -- 172.21.15.40:0/3503842817 shutdown_connections 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.306+0000 7f6dd03aa640 1 -- 172.21.15.40:0/3503842817 wait complete. 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.307+0000 7f6dd03aa640 1 Processor -- start 2024-04-14T09:59:55.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.307+0000 7f6dd03aa640 1 -- start start 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 0x7f6dc809cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc80728e0 0x7f6dc809d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80cead0 0x7f6dc81462a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80ce5b0 con 0x7f6dc8071c20 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc80ce2d0 con 0x7f6dc80728e0 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dd03aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc8160ce0 con 0x7f6dc80cead0 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 0x7f6dc809cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 0x7f6dc809cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34748/0 (socket says 172.21.15.40:34748) 2024-04-14T09:59:55.311 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 -- 172.21.15.40:0/1224823078 learned_addr learned my addr 172.21.15.40:0/1224823078 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dcd945640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc80728e0 0x7f6dc809d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce947640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80cead0 0x7f6dc81462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 -- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80cead0 msgr2=0x7f6dc81462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6dc80cead0 0x7f6dc81462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 -- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc80728e0 msgr2=0x7f6dc809d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6dc80728e0 0x7f6dc809d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc81f2130 con 0x7f6dc8071c20 2024-04-14T09:59:55.312 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.308+0000 7f6dce146640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 0x7f6dc809cfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400ebe0 tx=0x7f6dc400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4017070 con 0x7f6dc8071c20 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc400cc30 con 0x7f6dc8071c20 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc8149b90 con 0x7f6dc8071c20 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4013470 con 0x7f6dc8071c20 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc815cb70 con 0x7f6dc8071c20 2024-04-14T09:59:55.313 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.309+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6dc80757d0 con 0x7f6dc8071c20 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.310+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dc401a070 con 0x7f6dc8071c20 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dbeffd640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6dac06c8f0 0x7f6dac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6dc408bf20 con 0x7f6dc8071c20 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dbeffd640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f6dac075160 0x7f6dac0775a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6dc40093e0 con 0x7f6dac075160 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6dc408c3b0 con 0x7f6dc8071c20 2024-04-14T09:59:55.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dcd945640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6dac06c8f0 0x7f6dac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dce947640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f6dac075160 0x7f6dac0775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dcd945640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6dac06c8f0 0x7f6dac06edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6dc815c7c0 tx=0x7f6db8009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.311+0000 7f6dce947640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f6dac075160 0x7f6dac0775a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.316 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.312+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== osd.7 v2:172.21.15.136:6824/2810716504 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6dc40093e0 con 0x7f6dac075160 2024-04-14T09:59:55.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.325+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 --> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6dc80cf2d0 con 0x7f6dac075160 2024-04-14T09:59:55.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.325+0000 7f6dbeffd640 1 -- 172.21.15.40:0/1224823078 <== osd.7 v2:172.21.15.136:6824/2810716504 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6dc80cf2d0 con 0x7f6dac075160 2024-04-14T09:59:55.325 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T09:59:55.326 INFO:teuthology.orchestra.run.smithi040.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-14T09:59:55.326 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f6dac075160 msgr2=0x7f6dac0775a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6824/2810716504,v1:172.21.15.136:6825/2810716504] conn(0x7f6dac075160 0x7f6dac0775a0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6dac06c8f0 msgr2=0x7f6dac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f6dac06c8f0 0x7f6dac06edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6dc815c7c0 tx=0x7f6db8009040 comp rx=0 tx=0).stop 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 msgr2=0x7f6dc809cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 --2- 172.21.15.40:0/1224823078 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f6dc8071c20 0x7f6dc809cfb0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400ebe0 tx=0x7f6dc400c520 comp rx=0 tx=0).stop 2024-04-14T09:59:55.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dce947640 1 -- 172.21.15.40:0/1224823078 reap_dead start 2024-04-14T09:59:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 shutdown_connections 2024-04-14T09:59:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 >> 172.21.15.40:0/1224823078 conn(0x7f6dc80b1cc0 msgr2=0x7f6dc80ad390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 shutdown_connections 2024-04-14T09:59:55.328 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.326+0000 7f6dd03aa640 1 -- 172.21.15.40:0/1224823078 wait complete. 2024-04-14T09:59:55.335 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-14T09:59:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.438+0000 7fc34e295640 1 Processor -- start 2024-04-14T09:59:55.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.438+0000 7fc34e295640 1 -- start start 2024-04-14T09:59:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34e295640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc348161c80 0x7fc3480d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34e295640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc3480d2e50 0x7fc3480d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34e295640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3480b10e0 con 0x7fc3480d1200 2024-04-14T09:59:55.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34e295640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fc3480b1380 con 0x7fc348161c80 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34e295640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc3480b1660 con 0x7fc3480d2e50 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc347fff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fc348161c80 0x7fc3480d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34c832640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fc3480d1200 0x7fc3480cef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39734/0 (socket says 172.21.15.40:39734) 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc34c832640 1 -- 172.21.15.40:0/2957723817 learned_addr learned my addr 172.21.15.40:0/2957723817 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.439+0000 7fc3477fe640 1 --2- 172.21.15.40:0/2957723817 >> v2:172.21.15.136:3300/0 conn(0x7fc3480d2e50 0x7fc3480d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc347fff640 1 -- 172.21.15.40:0/2957723817 >> v2:172.21.15.136:3300/0 conn(0x7fc3480d2e50 msgr2=0x7fc3480d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc347fff640 1 --2- 172.21.15.40:0/2957723817 >> v2:172.21.15.136:3300/0 conn(0x7fc3480d2e50 0x7fc3480d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc347fff640 1 -- 172.21.15.40:0/2957723817 >> v1:172.21.15.40:6789/0 conn(0x7fc3480d1200 legacy=0x7fc3480cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.441 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc346ffd640 1 -- 172.21.15.40:0/2957723817 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378390004 0 0) 0x7fc3480b10e0 con 0x7fc3480d1200 2024-04-14T09:59:55.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc347fff640 1 -- 172.21.15.40:0/2957723817 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480d3340 con 0x7fc348161c80 2024-04-14T09:59:55.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.440+0000 7fc347fff640 1 --2- 172.21.15.40:0/2957723817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc348161c80 0x7fc3480d2910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc34808cc30 tx=0x7fc33802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fbb90a68752dff server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc346ffd640 1 -- 172.21.15.40:0/2957723817 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3380315a0 con 0x7fc348161c80 2024-04-14T09:59:55.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc346ffd640 1 -- 172.21.15.40:0/2957723817 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc338037070 con 0x7fc348161c80 2024-04-14T09:59:55.442 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc346ffd640 1 -- 172.21.15.40:0/2957723817 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc338031960 con 0x7fc348161c80 2024-04-14T09:59:55.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 -- 172.21.15.40:0/2957723817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc348161c80 msgr2=0x7fc3480d2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 --2- 172.21.15.40:0/2957723817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc348161c80 0x7fc3480d2910 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc34808cc30 tx=0x7fc33802b840 comp rx=0 tx=0).stop 2024-04-14T09:59:55.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 -- 172.21.15.40:0/2957723817 shutdown_connections 2024-04-14T09:59:55.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 --2- 172.21.15.40:0/2957723817 >> v2:172.21.15.136:3300/0 conn(0x7fc3480d2e50 0x7fc3480d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 --2- 172.21.15.40:0/2957723817 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc348161c80 0x7fc3480d2910 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 -- 172.21.15.40:0/2957723817 >> 172.21.15.40:0/2957723817 conn(0x7fc34809d5e0 msgr2=0x7fc3480d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 -- 172.21.15.40:0/2957723817 shutdown_connections 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.441+0000 7fc34e295640 1 -- 172.21.15.40:0/2957723817 wait complete. 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.442+0000 7fc34e295640 1 Processor -- start 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.442+0000 7fc34e295640 1 -- start start 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 0x7fc34815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc348161c80 0x7fc3480cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480b2e70 con 0x7fc3480d2e50 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc3480d0390 con 0x7fc348161c80 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34e295640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc3480b2ff0 con 0x7fc3480d1200 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc3477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc3477fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34762/0 (socket says 172.21.15.40:34762) 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc3477fe640 1 -- 172.21.15.40:0/2950918838 learned_addr learned my addr 172.21.15.40:0/2950918838 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:55.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc34c832640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc348161c80 0x7fc3480cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.443+0000 7fc347fff640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 0x7fc34815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 -- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 msgr2=0x7fc34815d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 0x7fc34815d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 -- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc348161c80 msgr2=0x7fc3480cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc348161c80 0x7fc3480cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 -- 172.21.15.40:0/2950918838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3480cb4f0 con 0x7fc3480d2e50 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc347fff640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 0x7fc34815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc3477fe640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e840 tx=0x7fc33c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c017070 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc33c00c940 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc33c00cd10 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3480cb7d0 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.444+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3480cc070 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.445+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc348075760 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.445+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc33c01a070 con 0x7fc3480d2e50 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.446+0000 7fc344ff9640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.446+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fc33c08bdc0 con 0x7fc3480d2e50 2024-04-14T09:59:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.446+0000 7fc347fff640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.446+0000 7fc347fff640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 0x7fc33406edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc338036000 tx=0x7fc33803d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.450+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fc33c059aa0 con 0x7fc3480d2e50 2024-04-14T09:59:55.634 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.634+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fc348160300 con 0x7fc33406c8f0 2024-04-14T09:59:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.635+0000 7fc344ff9640 1 -- 172.21.15.40:0/2950918838 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc348160300 con 0x7fc33406c8f0 2024-04-14T09:59:55.635 INFO:teuthology.orchestra.run.smithi040.stderr:instructed osd(s) 7 to deep-scrub 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 msgr2=0x7fc33406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 0x7fc33406edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc338036000 tx=0x7fc33803d040 comp rx=0 tx=0).stop 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 msgr2=0x7fc3480cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc33c00e840 tx=0x7fc33c00ed00 comp rx=0 tx=0).stop 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 shutdown_connections 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fc33406c8f0 0x7fc33406edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc348161c80 0x7fc3480cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fc3480d2e50 0x7fc3480cd9e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 --2- 172.21.15.40:0/2950918838 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3480d1200 0x7fc34815d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 >> 172.21.15.40:0/2950918838 conn(0x7fc34809d5e0 msgr2=0x7fc3480d1630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 shutdown_connections 2024-04-14T09:59:55.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.637+0000 7fc34e295640 1 -- 172.21.15.40:0/2950918838 wait complete. 2024-04-14T09:59:55.647 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T09:59:55.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.749+0000 7f4668880640 1 Processor -- start 2024-04-14T09:59:55.749 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.749+0000 7f4668880640 1 -- start start 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4668880640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f466409aa40 0x7f466409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4668880640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f46640b45b0 0x7f46640cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4668880640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466409b360 con 0x7f46640cd610 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4668880640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f466406f840 con 0x7f466409aa40 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4668880640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f466406fb20 con 0x7f46640b45b0 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f466259c640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f466409aa40 0x7f466409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.751 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4662d9d640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f46640cd610 0x7f46640cda80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:39746/0 (socket says 172.21.15.40:39746) 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4662d9d640 1 -- 172.21.15.40:0/2203251479 learned_addr learned my addr 172.21.15.40:0/2203251479 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f465bfff640 1 --2- 172.21.15.40:0/2203251479 >> v2:172.21.15.136:3300/0 conn(0x7f46640b45b0 0x7f46640cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f466259c640 1 -- 172.21.15.40:0/2203251479 >> v2:172.21.15.136:3300/0 conn(0x7f46640b45b0 msgr2=0x7f46640cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f466259c640 1 --2- 172.21.15.40:0/2203251479 >> v2:172.21.15.136:3300/0 conn(0x7f46640b45b0 0x7f46640cd0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f466259c640 1 -- 172.21.15.40:0/2203251479 >> v1:172.21.15.40:6789/0 conn(0x7f46640cd610 legacy=0x7f46640cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f466259c640 1 -- 172.21.15.40:0/2203251479 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46640cc5f0 con 0x7f466409aa40 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.750+0000 7f4661d9b640 1 -- 172.21.15.40:0/2203251479 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 217628350 0 0) 0x7f466409b360 con 0x7f46640cd610 2024-04-14T09:59:55.752 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.751+0000 7f466259c640 1 --2- 172.21.15.40:0/2203251479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409ae20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f466406f350 tx=0x7f465402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cedd481f87e25c49 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.751+0000 7f4661d9b640 1 -- 172.21.15.40:0/2203251479 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654035020 con 0x7f466409aa40 2024-04-14T09:59:55.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.751+0000 7f4661d9b640 1 -- 172.21.15.40:0/2203251479 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4654031830 con 0x7f466409aa40 2024-04-14T09:59:55.753 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.751+0000 7f4661d9b640 1 -- 172.21.15.40:0/2203251479 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654031c00 con 0x7f466409aa40 2024-04-14T09:59:55.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 -- 172.21.15.40:0/2203251479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 msgr2=0x7f466409ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 --2- 172.21.15.40:0/2203251479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409ae20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f466406f350 tx=0x7f465402b8d0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.756 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 -- 172.21.15.40:0/2203251479 shutdown_connections 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 --2- 172.21.15.40:0/2203251479 >> v2:172.21.15.136:3300/0 conn(0x7f46640b45b0 0x7f46640cd0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 --2- 172.21.15.40:0/2203251479 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409ae20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 -- 172.21.15.40:0/2203251479 >> 172.21.15.40:0/2203251479 conn(0x7f46640b3a90 msgr2=0x7f46640b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 -- 172.21.15.40:0/2203251479 shutdown_connections 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.752+0000 7f4668880640 1 -- 172.21.15.40:0/2203251479 wait complete. 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.753+0000 7f4668880640 1 Processor -- start 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.753+0000 7f4668880640 1 -- start start 2024-04-14T09:59:55.757 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46640b45b0 0x7f466409ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f46640cd610 0x7f4664157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f466409b860 con 0x7f466409aa40 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f46640ccbb0 con 0x7f46640b45b0 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4668880640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f466409b9e0 con 0x7f46640cd610 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:34784/0 (socket says 172.21.15.40:34784) 2024-04-14T09:59:55.758 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 -- 172.21.15.40:0/713820670 learned_addr learned my addr 172.21.15.40:0/713820670 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f465bfff640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46640b45b0 0x7f466409ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f4662d9d640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f46640cd610 0x7f4664157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 -- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f46640cd610 msgr2=0x7f4664157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f46640cd610 0x7f4664157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 -- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46640b45b0 msgr2=0x7f466409ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46640b45b0 0x7f466409ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.754+0000 7f466259c640 1 -- 172.21.15.40:0/713820670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466409f4c0 con 0x7f466409aa40 2024-04-14T09:59:55.759 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f466259c640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4654000c00 tx=0x7f46540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4654035040 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4654004230 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f465403a640 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f466409f7a0 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.755+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46641f7650 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.756+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46641f7850 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.756+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4654038020 con 0x7f466409aa40 2024-04-14T09:59:55.760 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.757+0000 7f465affd640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 0x7f464406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T09:59:55.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.757+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f46540ad8a0 con 0x7f466409aa40 2024-04-14T09:59:55.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.757+0000 7f465bfff640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 0x7f464406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T09:59:55.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.757+0000 7f465bfff640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 0x7f464406edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f466409eb10 tx=0x7f464c009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T09:59:55.761 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.761+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f46641f7850 con 0x7f466409aa40 2024-04-14T09:59:55.945 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.946+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f466409f260 con 0x7f464406c8f0 2024-04-14T09:59:55.952 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.952+0000 7f465affd640 1 -- 172.21.15.40:0/713820670 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251848 (secure 0 0 0) 0x7f464c0119d0 con 0x7f464406c8f0 2024-04-14T09:59:55.954 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T09:59:55.956 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T09:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 msgr2=0x7f464406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 0x7f464406edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f466409eb10 tx=0x7f464c009190 comp rx=0 tx=0).stop 2024-04-14T09:59:55.957 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 msgr2=0x7f466409c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4654000c00 tx=0x7f46540046c0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 shutdown_connections 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f464406c8f0 0x7f464406edb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f46640cd610 0x7f4664157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f46640b45b0 0x7f466409ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 --2- 172.21.15.40:0/713820670 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f466409aa40 0x7f466409c010 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 >> 172.21.15.40:0/713820670 conn(0x7f46640b3a90 msgr2=0x7f46640b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T09:59:55.958 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 shutdown_connections 2024-04-14T09:59:55.959 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T09:59:55.955+0000 7f4668880640 1 -- 172.21.15.40:0/713820670 wait complete. 2024-04-14T09:59:55.966 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-04-14T09:59:54.827004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220900,"kb_used_data":4752,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753820,"statfs":{"total":773094113280,"available":772867911680,"internally_reserved":0,"allocated":4866048,"data_stored":2754214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5533,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001993"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661243+0000","last_change":"2024-04-14T09:59:37.665054+0000","last_active":"2024-04-14T09:59:38.661243+0000","last_peered":"2024-04-14T09:59:38.661243+0000","last_clean":"2024-04-14T09:59:38.661243+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.661243+0000","last_undegraded":"2024-04-14T09:59:38.661243+0000","last_fullsized":"2024-04-14T09:59:38.661243+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661020+0000","last_change":"2024-04-14T09:59:37.669662+0000","last_active":"2024-04-14T09:59:38.661020+0000","last_peered":"2024-04-14T09:59:38.661020+0000","last_clean":"2024-04-14T09:59:38.661020+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T09:59:38.661020+0000","last_undegraded":"2024-04-14T09:59:38.661020+0000","last_fullsized":"2024-04-14T09:59:38.661020+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996802+0000","last_change":"2024-04-14T09:59:37.663889+0000","last_active":"2024-04-14T09:59:38.996802+0000","last_peered":"2024-04-14T09:59:38.996802+0000","last_clean":"2024-04-14T09:59:38.996802+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T09:59:38.996802+0000","last_undegraded":"2024-04-14T09:59:38.996802+0000","last_fullsized":"2024-04-14T09:59:38.996802+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669861+0000","last_change":"2024-04-14T09:59:37.671211+0000","last_active":"2024-04-14T09:59:38.669861+0000","last_peered":"2024-04-14T09:59:38.669861+0000","last_clean":"2024-04-14T09:59:38.669861+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T09:59:38.669861+0000","last_undegraded":"2024-04-14T09:59:38.669861+0000","last_fullsized":"2024-04-14T09:59:38.669861+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:43:42.301067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669765+0000","last_change":"2024-04-14T09:59:37.666603+0000","last_active":"2024-04-14T09:59:38.669765+0000","last_peered":"2024-04-14T09:59:38.669765+0000","last_clean":"2024-04-14T09:59:38.669765+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T09:59:38.669765+0000","last_undegraded":"2024-04-14T09:59:38.669765+0000","last_fullsized":"2024-04-14T09:59:38.669765+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:42:08.815484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.663331+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671744+0000","last_change":"2024-04-14T09:59:37.667390+0000","last_active":"2024-04-14T09:59:38.671744+0000","last_peered":"2024-04-14T09:59:38.671744+0000","last_clean":"2024-04-14T09:59:38.671744+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T09:59:38.671744+0000","last_undegraded":"2024-04-14T09:59:38.671744+0000","last_fullsized":"2024-04-14T09:59:38.671744+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660710+0000","last_change":"2024-04-14T09:59:37.662675+0000","last_active":"2024-04-14T09:59:38.660710+0000","last_peered":"2024-04-14T09:59:38.660710+0000","last_clean":"2024-04-14T09:59:38.660710+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T09:59:38.660710+0000","last_undegraded":"2024-04-14T09:59:38.660710+0000","last_fullsized":"2024-04-14T09:59:38.660710+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.997035+0000","last_change":"2024-04-14T09:59:37.673330+0000","last_active":"2024-04-14T09:59:38.997035+0000","last_peered":"2024-04-14T09:59:38.997035+0000","last_clean":"2024-04-14T09:59:38.997035+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T09:59:38.997035+0000","last_undegraded":"2024-04-14T09:59:38.997035+0000","last_fullsized":"2024-04-14T09:59:38.997035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672008+0000","last_change":"2024-04-14T09:59:37.663571+0000","last_active":"2024-04-14T09:59:38.672008+0000","last_peered":"2024-04-14T09:59:38.672008+0000","last_clean":"2024-04-14T09:59:38.672008+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T09:59:38.672008+0000","last_undegraded":"2024-04-14T09:59:38.672008+0000","last_fullsized":"2024-04-14T09:59:38.672008+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:06.699768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672021+0000","last_change":"2024-04-14T09:59:37.670146+0000","last_active":"2024-04-14T09:59:38.672021+0000","last_peered":"2024-04-14T09:59:38.672021+0000","last_clean":"2024-04-14T09:59:38.672021+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T09:59:38.672021+0000","last_undegraded":"2024-04-14T09:59:38.672021+0000","last_fullsized":"2024-04-14T09:59:38.672021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:53:44.539861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996814+0000","last_change":"2024-04-14T09:59:37.665450+0000","last_active":"2024-04-14T09:59:38.996814+0000","last_peered":"2024-04-14T09:59:38.996814+0000","last_clean":"2024-04-14T09:59:38.996814+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T09:59:38.996814+0000","last_undegraded":"2024-04-14T09:59:38.996814+0000","last_fullsized":"2024-04-14T09:59:38.996814+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671813+0000","last_change":"2024-04-14T09:59:37.664249+0000","last_active":"2024-04-14T09:59:38.671813+0000","last_peered":"2024-04-14T09:59:38.671813+0000","last_clean":"2024-04-14T09:59:38.671813+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T09:59:38.671813+0000","last_undegraded":"2024-04-14T09:59:38.671813+0000","last_fullsized":"2024-04-14T09:59:38.671813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826159+0000","last_change":"2024-04-14T09:59:37.674638+0000","last_active":"2024-04-14T09:59:38.826159+0000","last_peered":"2024-04-14T09:59:38.826159+0000","last_clean":"2024-04-14T09:59:38.826159+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T09:59:38.826159+0000","last_undegraded":"2024-04-14T09:59:38.826159+0000","last_fullsized":"2024-04-14T09:59:38.826159+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671774+0000","last_change":"2024-04-14T09:59:37.665255+0000","last_active":"2024-04-14T09:59:38.671774+0000","last_peered":"2024-04-14T09:59:38.671774+0000","last_clean":"2024-04-14T09:59:38.671774+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T09:59:38.671774+0000","last_undegraded":"2024-04-14T09:59:38.671774+0000","last_fullsized":"2024-04-14T09:59:38.671774+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995708+0000","last_change":"2024-04-14T09:59:37.660898+0000","last_active":"2024-04-14T09:59:38.995708+0000","last_peered":"2024-04-14T09:59:38.995708+0000","last_clean":"2024-04-14T09:59:38.995708+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T09:59:38.995708+0000","last_undegraded":"2024-04-14T09:59:38.995708+0000","last_fullsized":"2024-04-14T09:59:38.995708+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996091+0000","last_change":"2024-04-14T09:59:37.658959+0000","last_active":"2024-04-14T09:59:38.996091+0000","last_peered":"2024-04-14T09:59:38.996091+0000","last_clean":"2024-04-14T09:59:38.996091+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T09:59:38.996091+0000","last_undegraded":"2024-04-14T09:59:38.996091+0000","last_fullsized":"2024-04-14T09:59:38.996091+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661000+0000","last_change":"2024-04-14T09:59:37.667729+0000","last_active":"2024-04-14T09:59:38.661000+0000","last_peered":"2024-04-14T09:59:38.661000+0000","last_clean":"2024-04-14T09:59:38.661000+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T09:59:38.661000+0000","last_undegraded":"2024-04-14T09:59:38.661000+0000","last_fullsized":"2024-04-14T09:59:38.661000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669963+0000","last_change":"2024-04-14T09:59:37.669248+0000","last_active":"2024-04-14T09:59:38.669963+0000","last_peered":"2024-04-14T09:59:38.669963+0000","last_clean":"2024-04-14T09:59:38.669963+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T09:59:38.669963+0000","last_undegraded":"2024-04-14T09:59:38.669963+0000","last_fullsized":"2024-04-14T09:59:38.669963+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:18:46.189832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660907+0000","last_change":"2024-04-14T09:59:37.670072+0000","last_active":"2024-04-14T09:59:38.660907+0000","last_peered":"2024-04-14T09:59:38.660907+0000","last_clean":"2024-04-14T09:59:38.660907+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T09:59:38.660907+0000","last_undegraded":"2024-04-14T09:59:38.660907+0000","last_fullsized":"2024-04-14T09:59:38.660907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:34.803007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671889+0000","last_change":"2024-04-14T09:59:37.665061+0000","last_active":"2024-04-14T09:59:38.671889+0000","last_peered":"2024-04-14T09:59:38.671889+0000","last_clean":"2024-04-14T09:59:38.671889+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T09:59:38.671889+0000","last_undegraded":"2024-04-14T09:59:38.671889+0000","last_fullsized":"2024-04-14T09:59:38.671889+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826452+0000","last_change":"2024-04-14T09:59:37.668893+0000","last_active":"2024-04-14T09:59:38.826452+0000","last_peered":"2024-04-14T09:59:38.826452+0000","last_clean":"2024-04-14T09:59:38.826452+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T09:59:38.826452+0000","last_undegraded":"2024-04-14T09:59:38.826452+0000","last_fullsized":"2024-04-14T09:59:38.826452+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995785+0000","last_change":"2024-04-14T09:59:37.671264+0000","last_active":"2024-04-14T09:59:38.995785+0000","last_peered":"2024-04-14T09:59:38.995785+0000","last_clean":"2024-04-14T09:59:38.995785+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T09:59:38.995785+0000","last_undegraded":"2024-04-14T09:59:38.995785+0000","last_fullsized":"2024-04-14T09:59:38.995785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:02.411489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669784+0000","last_change":"2024-04-14T09:59:37.674349+0000","last_active":"2024-04-14T09:59:38.669784+0000","last_peered":"2024-04-14T09:59:38.669784+0000","last_clean":"2024-04-14T09:59:38.669784+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T09:59:38.669784+0000","last_undegraded":"2024-04-14T09:59:38.669784+0000","last_fullsized":"2024-04-14T09:59:38.669784+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:10:02.538848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660837+0000","last_change":"2024-04-14T09:59:37.666760+0000","last_active":"2024-04-14T09:59:38.660837+0000","last_peered":"2024-04-14T09:59:38.660837+0000","last_clean":"2024-04-14T09:59:38.660837+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T09:59:38.660837+0000","last_undegraded":"2024-04-14T09:59:38.660837+0000","last_fullsized":"2024-04-14T09:59:38.660837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:10.871408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996673+0000","last_change":"2024-04-14T09:59:37.665336+0000","last_active":"2024-04-14T09:59:38.996673+0000","last_peered":"2024-04-14T09:59:38.996673+0000","last_clean":"2024-04-14T09:59:38.996673+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T09:59:38.996673+0000","last_undegraded":"2024-04-14T09:59:38.996673+0000","last_fullsized":"2024-04-14T09:59:38.996673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660896+0000","last_change":"2024-04-14T09:59:37.668740+0000","last_active":"2024-04-14T09:59:38.660896+0000","last_peered":"2024-04-14T09:59:38.660896+0000","last_clean":"2024-04-14T09:59:38.660896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T09:59:38.660896+0000","last_undegraded":"2024-04-14T09:59:38.660896+0000","last_fullsized":"2024-04-14T09:59:38.660896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:18.955117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671929+0000","last_change":"2024-04-14T09:59:37.666995+0000","last_active":"2024-04-14T09:59:38.671929+0000","last_peered":"2024-04-14T09:59:38.671929+0000","last_clean":"2024-04-14T09:59:38.671929+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T09:59:38.671929+0000","last_undegraded":"2024-04-14T09:59:38.671929+0000","last_fullsized":"2024-04-14T09:59:38.671929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:14.256185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660800+0000","last_change":"2024-04-14T09:59:37.660781+0000","last_active":"2024-04-14T09:59:38.660800+0000","last_peered":"2024-04-14T09:59:38.660800+0000","last_clean":"2024-04-14T09:59:38.660800+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T09:59:38.660800+0000","last_undegraded":"2024-04-14T09:59:38.660800+0000","last_fullsized":"2024-04-14T09:59:38.660800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:43:51.876296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660997+0000","last_change":"2024-04-14T09:59:37.664322+0000","last_active":"2024-04-14T09:59:38.660997+0000","last_peered":"2024-04-14T09:59:38.660997+0000","last_clean":"2024-04-14T09:59:38.660997+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T09:59:38.660997+0000","last_undegraded":"2024-04-14T09:59:38.660997+0000","last_fullsized":"2024-04-14T09:59:38.660997+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995866+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T09:59:38.995866+0000","last_peered":"2024-04-14T09:59:38.995866+0000","last_clean":"2024-04-14T09:59:38.995866+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T09:59:38.995866+0000","last_undegraded":"2024-04-14T09:59:38.995866+0000","last_fullsized":"2024-04-14T09:59:38.995866+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:49:14.798294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996295+0000","last_change":"2024-04-14T09:59:37.664529+0000","last_active":"2024-04-14T09:59:38.996295+0000","last_peered":"2024-04-14T09:59:38.996295+0000","last_clean":"2024-04-14T09:59:38.996295+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T09:59:38.996295+0000","last_undegraded":"2024-04-14T09:59:38.996295+0000","last_fullsized":"2024-04-14T09:59:38.996295+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996067+0000","last_change":"2024-04-14T09:59:37.661516+0000","last_active":"2024-04-14T09:59:38.996067+0000","last_peered":"2024-04-14T09:59:38.996067+0000","last_clean":"2024-04-14T09:59:38.996067+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T09:59:38.996067+0000","last_undegraded":"2024-04-14T09:59:38.996067+0000","last_fullsized":"2024-04-14T09:59:38.996067+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:04.573250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660820+0000","last_change":"2024-04-14T09:59:36.649468+0000","last_active":"2024-04-14T09:59:38.660820+0000","last_peered":"2024-04-14T09:59:38.660820+0000","last_clean":"2024-04-14T09:59:38.660820+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T09:59:38.660820+0000","last_undegraded":"2024-04-14T09:59:38.660820+0000","last_fullsized":"2024-04-14T09:59:38.660820+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996578+0000","last_change":"2024-04-14T09:59:37.665313+0000","last_active":"2024-04-14T09:59:38.996578+0000","last_peered":"2024-04-14T09:59:38.996578+0000","last_clean":"2024-04-14T09:59:38.996578+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T09:59:38.996578+0000","last_undegraded":"2024-04-14T09:59:38.996578+0000","last_fullsized":"2024-04-14T09:59:38.996578+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:40.610432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996927+0000","last_change":"2024-04-14T09:59:36.656627+0000","last_active":"2024-04-14T09:59:38.996927+0000","last_peered":"2024-04-14T09:59:38.996927+0000","last_clean":"2024-04-14T09:59:38.996927+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T09:59:38.996927+0000","last_undegraded":"2024-04-14T09:59:38.996927+0000","last_fullsized":"2024-04-14T09:59:38.996927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826519+0000","last_change":"2024-04-14T09:59:37.673748+0000","last_active":"2024-04-14T09:59:38.826519+0000","last_peered":"2024-04-14T09:59:38.826519+0000","last_clean":"2024-04-14T09:59:38.826519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T09:59:38.826519+0000","last_undegraded":"2024-04-14T09:59:38.826519+0000","last_fullsized":"2024-04-14T09:59:38.826519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996809+0000","last_change":"2024-04-14T09:59:36.657775+0000","last_active":"2024-04-14T09:59:38.996809+0000","last_peered":"2024-04-14T09:59:38.996809+0000","last_clean":"2024-04-14T09:59:38.996809+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T09:59:38.996809+0000","last_undegraded":"2024-04-14T09:59:38.996809+0000","last_fullsized":"2024-04-14T09:59:38.996809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661120+0000","last_change":"2024-04-14T09:59:37.664814+0000","last_active":"2024-04-14T09:59:38.661120+0000","last_peered":"2024-04-14T09:59:38.661120+0000","last_clean":"2024-04-14T09:59:38.661120+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T09:59:38.661120+0000","last_undegraded":"2024-04-14T09:59:38.661120+0000","last_fullsized":"2024-04-14T09:59:38.661120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:05.600885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826414+0000","last_change":"2024-04-14T09:59:36.657197+0000","last_active":"2024-04-14T09:59:38.826414+0000","last_peered":"2024-04-14T09:59:38.826414+0000","last_clean":"2024-04-14T09:59:38.826414+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T09:59:38.826414+0000","last_undegraded":"2024-04-14T09:59:38.826414+0000","last_fullsized":"2024-04-14T09:59:38.826414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:53:07.426669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996206+0000","last_change":"2024-04-14T09:59:37.660965+0000","last_active":"2024-04-14T09:59:38.996206+0000","last_peered":"2024-04-14T09:59:38.996206+0000","last_clean":"2024-04-14T09:59:38.996206+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T09:59:38.996206+0000","last_undegraded":"2024-04-14T09:59:38.996206+0000","last_fullsized":"2024-04-14T09:59:38.996206+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:50.267722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671999+0000","last_change":"2024-04-14T09:59:36.662518+0000","last_active":"2024-04-14T09:59:38.671999+0000","last_peered":"2024-04-14T09:59:38.671999+0000","last_clean":"2024-04-14T09:59:38.671999+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T09:59:38.671999+0000","last_undegraded":"2024-04-14T09:59:38.671999+0000","last_fullsized":"2024-04-14T09:59:38.671999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671905+0000","last_change":"2024-04-14T09:59:37.663938+0000","last_active":"2024-04-14T09:59:38.671905+0000","last_peered":"2024-04-14T09:59:38.671905+0000","last_clean":"2024-04-14T09:59:38.671905+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T09:59:38.671905+0000","last_undegraded":"2024-04-14T09:59:38.671905+0000","last_fullsized":"2024-04-14T09:59:38.671905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:30:53.569447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995809+0000","last_change":"2024-04-14T09:59:36.653430+0000","last_active":"2024-04-14T09:59:38.995809+0000","last_peered":"2024-04-14T09:59:38.995809+0000","last_clean":"2024-04-14T09:59:38.995809+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T09:59:38.995809+0000","last_undegraded":"2024-04-14T09:59:38.995809+0000","last_fullsized":"2024-04-14T09:59:38.995809+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:56.727919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826498+0000","last_change":"2024-04-14T09:59:37.673083+0000","last_active":"2024-04-14T09:59:38.826498+0000","last_peered":"2024-04-14T09:59:38.826498+0000","last_clean":"2024-04-14T09:59:38.826498+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T09:59:38.826498+0000","last_undegraded":"2024-04-14T09:59:38.826498+0000","last_fullsized":"2024-04-14T09:59:38.826498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996517+0000","last_change":"2024-04-14T09:59:36.659127+0000","last_active":"2024-04-14T09:59:38.996517+0000","last_peered":"2024-04-14T09:59:38.996517+0000","last_clean":"2024-04-14T09:59:38.996517+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T09:59:38.996517+0000","last_undegraded":"2024-04-14T09:59:38.996517+0000","last_fullsized":"2024-04-14T09:59:38.996517+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660888+0000","last_change":"2024-04-14T09:59:37.660022+0000","last_active":"2024-04-14T09:59:38.660888+0000","last_peered":"2024-04-14T09:59:38.660888+0000","last_clean":"2024-04-14T09:59:38.660888+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T09:59:38.660888+0000","last_undegraded":"2024-04-14T09:59:38.660888+0000","last_fullsized":"2024-04-14T09:59:38.660888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826123+0000","last_change":"2024-04-14T09:59:36.654492+0000","last_active":"2024-04-14T09:59:38.826123+0000","last_peered":"2024-04-14T09:59:38.826123+0000","last_clean":"2024-04-14T09:59:38.826123+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T09:59:38.826123+0000","last_undegraded":"2024-04-14T09:59:38.826123+0000","last_fullsized":"2024-04-14T09:59:38.826123+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669927+0000","last_change":"2024-04-14T09:59:37.670995+0000","last_active":"2024-04-14T09:59:38.669927+0000","last_peered":"2024-04-14T09:59:38.669927+0000","last_clean":"2024-04-14T09:59:38.669927+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T09:59:38.669927+0000","last_undegraded":"2024-04-14T09:59:38.669927+0000","last_fullsized":"2024-04-14T09:59:38.669927+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:05:31.405716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661231+0000","last_change":"2024-04-14T09:59:36.652707+0000","last_active":"2024-04-14T09:59:38.661231+0000","last_peered":"2024-04-14T09:59:38.661231+0000","last_clean":"2024-04-14T09:59:38.661231+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T09:59:38.661231+0000","last_undegraded":"2024-04-14T09:59:38.661231+0000","last_fullsized":"2024-04-14T09:59:38.661231+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996011+0000","last_change":"2024-04-14T09:59:37.658427+0000","last_active":"2024-04-14T09:59:38.996011+0000","last_peered":"2024-04-14T09:59:38.996011+0000","last_clean":"2024-04-14T09:59:38.996011+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T09:59:38.996011+0000","last_undegraded":"2024-04-14T09:59:38.996011+0000","last_fullsized":"2024-04-14T09:59:38.996011+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.979458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672095+0000","last_change":"2024-04-14T09:59:36.655503+0000","last_active":"2024-04-14T09:59:38.672095+0000","last_peered":"2024-04-14T09:59:38.672095+0000","last_clean":"2024-04-14T09:59:38.672095+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T09:59:38.672095+0000","last_undegraded":"2024-04-14T09:59:38.672095+0000","last_fullsized":"2024-04-14T09:59:38.672095+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:33.798808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996943+0000","last_change":"2024-04-14T09:59:37.670690+0000","last_active":"2024-04-14T09:59:38.996943+0000","last_peered":"2024-04-14T09:59:38.996943+0000","last_clean":"2024-04-14T09:59:38.996943+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T09:59:38.996943+0000","last_undegraded":"2024-04-14T09:59:38.996943+0000","last_fullsized":"2024-04-14T09:59:38.996943+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:44.043347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672266+0000","last_change":"2024-04-14T09:59:36.660280+0000","last_active":"2024-04-14T09:59:38.672266+0000","last_peered":"2024-04-14T09:59:38.672266+0000","last_clean":"2024-04-14T09:59:38.672266+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T09:59:38.672266+0000","last_undegraded":"2024-04-14T09:59:38.672266+0000","last_fullsized":"2024-04-14T09:59:38.672266+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:29.031906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826512+0000","last_change":"2024-04-14T09:59:37.670755+0000","last_active":"2024-04-14T09:59:38.826512+0000","last_peered":"2024-04-14T09:59:38.826512+0000","last_clean":"2024-04-14T09:59:38.826512+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T09:59:38.826512+0000","last_undegraded":"2024-04-14T09:59:38.826512+0000","last_fullsized":"2024-04-14T09:59:38.826512+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:13:18.151934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:45.777592+0000","last_change":"2024-04-14T09:59:36.656396+0000","last_active":"2024-04-14T09:59:45.777592+0000","last_peered":"2024-04-14T09:59:45.777592+0000","last_clean":"2024-04-14T09:59:45.777592+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T09:59:45.777592+0000","last_undegraded":"2024-04-14T09:59:45.777592+0000","last_fullsized":"2024-04-14T09:59:45.777592+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:43:49.263523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996689+0000","last_change":"2024-04-14T09:59:37.668087+0000","last_active":"2024-04-14T09:59:38.996689+0000","last_peered":"2024-04-14T09:59:38.996689+0000","last_clean":"2024-04-14T09:59:38.996689+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T09:59:38.996689+0000","last_undegraded":"2024-04-14T09:59:38.996689+0000","last_fullsized":"2024-04-14T09:59:38.996689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660999+0000","last_change":"2024-04-14T09:59:36.654742+0000","last_active":"2024-04-14T09:59:38.660999+0000","last_peered":"2024-04-14T09:59:38.660999+0000","last_clean":"2024-04-14T09:59:38.660999+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T09:59:38.660999+0000","last_undegraded":"2024-04-14T09:59:38.660999+0000","last_fullsized":"2024-04-14T09:59:38.660999+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:37:17.950918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660846+0000","last_change":"2024-04-14T09:59:37.664220+0000","last_active":"2024-04-14T09:59:38.660846+0000","last_peered":"2024-04-14T09:59:38.660846+0000","last_clean":"2024-04-14T09:59:38.660846+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T09:59:38.660846+0000","last_undegraded":"2024-04-14T09:59:38.660846+0000","last_fullsized":"2024-04-14T09:59:38.660846+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996739+0000","last_change":"2024-04-14T09:59:36.659897+0000","last_active":"2024-04-14T09:59:38.996739+0000","last_peered":"2024-04-14T09:59:38.996739+0000","last_clean":"2024-04-14T09:59:38.996739+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T09:59:38.996739+0000","last_undegraded":"2024-04-14T09:59:38.996739+0000","last_fullsized":"2024-04-14T09:59:38.996739+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995783+0000","last_change":"2024-04-14T09:59:37.663864+0000","last_active":"2024-04-14T09:59:38.995783+0000","last_peered":"2024-04-14T09:59:38.995783+0000","last_clean":"2024-04-14T09:59:38.995783+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T09:59:38.995783+0000","last_undegraded":"2024-04-14T09:59:38.995783+0000","last_fullsized":"2024-04-14T09:59:38.995783+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:04:00.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660595+0000","last_change":"2024-04-14T09:59:36.649186+0000","last_active":"2024-04-14T09:59:38.660595+0000","last_peered":"2024-04-14T09:59:38.660595+0000","last_clean":"2024-04-14T09:59:38.660595+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T09:59:38.660595+0000","last_undegraded":"2024-04-14T09:59:38.660595+0000","last_fullsized":"2024-04-14T09:59:38.660595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:43:28.782426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660895+0000","last_change":"2024-04-14T09:59:37.660322+0000","last_active":"2024-04-14T09:59:38.660895+0000","last_peered":"2024-04-14T09:59:38.660895+0000","last_clean":"2024-04-14T09:59:38.660895+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T09:59:38.660895+0000","last_undegraded":"2024-04-14T09:59:38.660895+0000","last_fullsized":"2024-04-14T09:59:38.660895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995704+0000","last_change":"2024-04-14T09:59:36.652785+0000","last_active":"2024-04-14T09:59:38.995704+0000","last_peered":"2024-04-14T09:59:38.995704+0000","last_clean":"2024-04-14T09:59:38.995704+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T09:59:38.995704+0000","last_undegraded":"2024-04-14T09:59:38.995704+0000","last_fullsized":"2024-04-14T09:59:38.995704+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661051+0000","last_change":"2024-04-14T09:59:37.667722+0000","last_active":"2024-04-14T09:59:38.661051+0000","last_peered":"2024-04-14T09:59:38.661051+0000","last_clean":"2024-04-14T09:59:38.661051+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T09:59:38.661051+0000","last_undegraded":"2024-04-14T09:59:38.661051+0000","last_fullsized":"2024-04-14T09:59:38.661051+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:37:41.750875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672186+0000","last_change":"2024-04-14T09:59:36.654425+0000","last_active":"2024-04-14T09:59:38.672186+0000","last_peered":"2024-04-14T09:59:38.672186+0000","last_clean":"2024-04-14T09:59:38.672186+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T09:59:38.672186+0000","last_undegraded":"2024-04-14T09:59:38.672186+0000","last_fullsized":"2024-04-14T09:59:38.672186+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:00.853922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672167+0000","last_change":"2024-04-14T09:59:37.665445+0000","last_active":"2024-04-14T09:59:38.672167+0000","last_peered":"2024-04-14T09:59:38.672167+0000","last_clean":"2024-04-14T09:59:38.672167+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.672167+0000","last_undegraded":"2024-04-14T09:59:38.672167+0000","last_fullsized":"2024-04-14T09:59:38.672167+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:27.797566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826540+0000","last_change":"2024-04-14T09:59:36.656062+0000","last_active":"2024-04-14T09:59:38.826540+0000","last_peered":"2024-04-14T09:59:38.826540+0000","last_clean":"2024-04-14T09:59:38.826540+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T09:59:38.826540+0000","last_undegraded":"2024-04-14T09:59:38.826540+0000","last_fullsized":"2024-04-14T09:59:38.826540+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:22:26.600536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826444+0000","last_change":"2024-04-14T09:59:37.669099+0000","last_active":"2024-04-14T09:59:38.826444+0000","last_peered":"2024-04-14T09:59:38.826444+0000","last_clean":"2024-04-14T09:59:38.826444+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T09:59:38.826444+0000","last_undegraded":"2024-04-14T09:59:38.826444+0000","last_fullsized":"2024-04-14T09:59:38.826444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670003+0000","last_change":"2024-04-14T09:59:36.653235+0000","last_active":"2024-04-14T09:59:38.670003+0000","last_peered":"2024-04-14T09:59:38.670003+0000","last_clean":"2024-04-14T09:59:38.670003+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T09:59:38.670003+0000","last_undegraded":"2024-04-14T09:59:38.670003+0000","last_fullsized":"2024-04-14T09:59:38.670003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:44:54.523224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.670004+0000","last_change":"2024-04-14T09:59:37.665719+0000","last_active":"2024-04-14T09:59:38.670004+0000","last_peered":"2024-04-14T09:59:38.670004+0000","last_clean":"2024-04-14T09:59:38.670004+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T09:59:38.670004+0000","last_undegraded":"2024-04-14T09:59:38.670004+0000","last_fullsized":"2024-04-14T09:59:38.670004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:07.146705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996439+0000","last_change":"2024-04-14T09:59:36.658288+0000","last_active":"2024-04-14T09:59:38.996439+0000","last_peered":"2024-04-14T09:59:38.996439+0000","last_clean":"2024-04-14T09:59:38.996439+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T09:59:38.996439+0000","last_undegraded":"2024-04-14T09:59:38.996439+0000","last_fullsized":"2024-04-14T09:59:38.996439+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995895+0000","last_change":"2024-04-14T09:59:37.663553+0000","last_active":"2024-04-14T09:59:38.995895+0000","last_peered":"2024-04-14T09:59:38.995895+0000","last_clean":"2024-04-14T09:59:38.995895+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T09:59:38.995895+0000","last_undegraded":"2024-04-14T09:59:38.995895+0000","last_fullsized":"2024-04-14T09:59:38.995895+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:30.140805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669766+0000","last_change":"2024-04-14T09:59:36.653176+0000","last_active":"2024-04-14T09:59:38.669766+0000","last_peered":"2024-04-14T09:59:38.669766+0000","last_clean":"2024-04-14T09:59:38.669766+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T09:59:38.669766+0000","last_undegraded":"2024-04-14T09:59:38.669766+0000","last_fullsized":"2024-04-14T09:59:38.669766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:26:10.512623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996327+0000","last_change":"2024-04-14T09:59:37.669323+0000","last_active":"2024-04-14T09:59:38.996327+0000","last_peered":"2024-04-14T09:59:38.996327+0000","last_clean":"2024-04-14T09:59:38.996327+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T09:59:38.996327+0000","last_undegraded":"2024-04-14T09:59:38.996327+0000","last_fullsized":"2024-04-14T09:59:38.996327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:34:01.858121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669798+0000","last_change":"2024-04-14T09:59:36.649825+0000","last_active":"2024-04-14T09:59:38.669798+0000","last_peered":"2024-04-14T09:59:38.669798+0000","last_clean":"2024-04-14T09:59:38.669798+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T09:59:38.669798+0000","last_undegraded":"2024-04-14T09:59:38.669798+0000","last_fullsized":"2024-04-14T09:59:38.669798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:31:46.204427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.671856+0000","last_change":"2024-04-14T09:59:37.669449+0000","last_active":"2024-04-14T09:59:38.671856+0000","last_peered":"2024-04-14T09:59:38.671856+0000","last_clean":"2024-04-14T09:59:38.671856+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T09:59:38.671856+0000","last_undegraded":"2024-04-14T09:59:38.671856+0000","last_fullsized":"2024-04-14T09:59:38.671856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995960+0000","last_change":"2024-04-14T09:59:36.657862+0000","last_active":"2024-04-14T09:59:38.995960+0000","last_peered":"2024-04-14T09:59:38.995960+0000","last_clean":"2024-04-14T09:59:38.995960+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T09:59:38.995960+0000","last_undegraded":"2024-04-14T09:59:38.995960+0000","last_fullsized":"2024-04-14T09:59:38.995960+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661183+0000","last_change":"2024-04-14T09:59:37.660252+0000","last_active":"2024-04-14T09:59:38.661183+0000","last_peered":"2024-04-14T09:59:38.661183+0000","last_clean":"2024-04-14T09:59:38.661183+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T09:59:38.661183+0000","last_undegraded":"2024-04-14T09:59:38.661183+0000","last_fullsized":"2024-04-14T09:59:38.661183+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:34.903200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.669848+0000","last_change":"2024-04-14T09:59:36.654430+0000","last_active":"2024-04-14T09:59:38.669848+0000","last_peered":"2024-04-14T09:59:38.669848+0000","last_clean":"2024-04-14T09:59:38.669848+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T09:59:38.669848+0000","last_undegraded":"2024-04-14T09:59:38.669848+0000","last_fullsized":"2024-04-14T09:59:38.669848+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:12:49.891892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996321+0000","last_change":"2024-04-14T09:59:37.665129+0000","last_active":"2024-04-14T09:59:38.996321+0000","last_peered":"2024-04-14T09:59:38.996321+0000","last_clean":"2024-04-14T09:59:38.996321+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T09:59:38.996321+0000","last_undegraded":"2024-04-14T09:59:38.996321+0000","last_fullsized":"2024-04-14T09:59:38.996321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672220+0000","last_change":"2024-04-14T09:59:36.660374+0000","last_active":"2024-04-14T09:59:38.672220+0000","last_peered":"2024-04-14T09:59:38.672220+0000","last_clean":"2024-04-14T09:59:38.672220+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T09:59:38.672220+0000","last_undegraded":"2024-04-14T09:59:38.672220+0000","last_fullsized":"2024-04-14T09:59:38.672220+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:24.146025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996061+0000","last_change":"2024-04-14T09:59:37.664749+0000","last_active":"2024-04-14T09:59:38.996061+0000","last_peered":"2024-04-14T09:59:38.996061+0000","last_clean":"2024-04-14T09:59:38.996061+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T09:59:38.996061+0000","last_undegraded":"2024-04-14T09:59:38.996061+0000","last_fullsized":"2024-04-14T09:59:38.996061+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:49:56.045353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:45.667506+0000","last_change":"2024-04-14T09:59:36.655155+0000","last_active":"2024-04-14T09:59:45.667506+0000","last_peered":"2024-04-14T09:59:45.667506+0000","last_clean":"2024-04-14T09:59:45.667506+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T09:59:45.667506+0000","last_undegraded":"2024-04-14T09:59:45.667506+0000","last_fullsized":"2024-04-14T09:59:45.667506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:55:30.863220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.661129+0000","last_change":"2024-04-14T09:59:37.672253+0000","last_active":"2024-04-14T09:59:38.661129+0000","last_peered":"2024-04-14T09:59:38.661129+0000","last_clean":"2024-04-14T09:59:38.661129+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T09:59:38.661129+0000","last_undegraded":"2024-04-14T09:59:38.661129+0000","last_fullsized":"2024-04-14T09:59:38.661129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:35.085635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996894+0000","last_change":"2024-04-14T09:59:36.654589+0000","last_active":"2024-04-14T09:59:38.996894+0000","last_peered":"2024-04-14T09:59:38.996894+0000","last_clean":"2024-04-14T09:59:38.996894+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T09:59:38.996894+0000","last_undegraded":"2024-04-14T09:59:38.996894+0000","last_fullsized":"2024-04-14T09:59:38.996894+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:21:23.598643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996365+0000","last_change":"2024-04-14T09:59:37.660639+0000","last_active":"2024-04-14T09:59:38.996365+0000","last_peered":"2024-04-14T09:59:38.996365+0000","last_clean":"2024-04-14T09:59:38.996365+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T09:59:38.996365+0000","last_undegraded":"2024-04-14T09:59:38.996365+0000","last_fullsized":"2024-04-14T09:59:38.996365+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:30.036105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996531+0000","last_change":"2024-04-14T09:59:36.658613+0000","last_active":"2024-04-14T09:59:38.996531+0000","last_peered":"2024-04-14T09:59:38.996531+0000","last_clean":"2024-04-14T09:59:38.996531+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T09:59:38.996531+0000","last_undegraded":"2024-04-14T09:59:38.996531+0000","last_fullsized":"2024-04-14T09:59:38.996531+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:16:14.800651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.996413+0000","last_change":"2024-04-14T09:59:37.659359+0000","last_active":"2024-04-14T09:59:38.996413+0000","last_peered":"2024-04-14T09:59:38.996413+0000","last_clean":"2024-04-14T09:59:38.996413+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T09:59:38.996413+0000","last_undegraded":"2024-04-14T09:59:38.996413+0000","last_fullsized":"2024-04-14T09:59:38.996413+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:16.119891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660674+0000","last_change":"2024-04-14T09:59:36.654062+0000","last_active":"2024-04-14T09:59:38.660674+0000","last_peered":"2024-04-14T09:59:38.660674+0000","last_clean":"2024-04-14T09:59:38.660674+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T09:59:38.660674+0000","last_undegraded":"2024-04-14T09:59:38.660674+0000","last_fullsized":"2024-04-14T09:59:38.660674+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:13:06.142506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826191+0000","last_change":"2024-04-14T09:59:37.671475+0000","last_active":"2024-04-14T09:59:38.826191+0000","last_peered":"2024-04-14T09:59:38.826191+0000","last_clean":"2024-04-14T09:59:38.826191+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T09:59:38.826191+0000","last_undegraded":"2024-04-14T09:59:38.826191+0000","last_fullsized":"2024-04-14T09:59:38.826191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:10:25.150224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.826135+0000","last_change":"2024-04-14T09:59:36.656493+0000","last_active":"2024-04-14T09:59:38.826135+0000","last_peered":"2024-04-14T09:59:38.826135+0000","last_clean":"2024-04-14T09:59:38.826135+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T09:59:38.826135+0000","last_undegraded":"2024-04-14T09:59:38.826135+0000","last_fullsized":"2024-04-14T09:59:38.826135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:23:52.099411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995955+0000","last_change":"2024-04-14T09:59:37.659123+0000","last_active":"2024-04-14T09:59:38.995955+0000","last_peered":"2024-04-14T09:59:38.995955+0000","last_clean":"2024-04-14T09:59:38.995955+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T09:59:38.995955+0000","last_undegraded":"2024-04-14T09:59:38.995955+0000","last_fullsized":"2024-04-14T09:59:38.995955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:16:58.906484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.660730+0000","last_change":"2024-04-14T09:59:36.651890+0000","last_active":"2024-04-14T09:59:38.660730+0000","last_peered":"2024-04-14T09:59:38.660730+0000","last_clean":"2024-04-14T09:59:38.660730+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T09:59:38.660730+0000","last_undegraded":"2024-04-14T09:59:38.660730+0000","last_fullsized":"2024-04-14T09:59:38.660730+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:17:09.867208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.672105+0000","last_change":"2024-04-14T09:59:37.667573+0000","last_active":"2024-04-14T09:59:38.672105+0000","last_peered":"2024-04-14T09:59:38.672105+0000","last_clean":"2024-04-14T09:59:38.672105+0000","last_became_active":"2024-04-14T09:59:37.666738+0000","last_became_peered":"2024-04-14T09:59:37.666738+0000","last_unstale":"2024-04-14T09:59:38.672105+0000","last_undegraded":"2024-04-14T09:59:38.672105+0000","last_fullsized":"2024-04-14T09:59:38.672105+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:30.725495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995959+0000","last_change":"2024-04-14T09:59:36.657375+0000","last_active":"2024-04-14T09:59:38.995959+0000","last_peered":"2024-04-14T09:59:38.995959+0000","last_clean":"2024-04-14T09:59:38.995959+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T09:59:38.995959+0000","last_undegraded":"2024-04-14T09:59:38.995959+0000","last_fullsized":"2024-04-14T09:59:38.995959+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:35.630101+0000","last_clean_scrub_stamp":"2024-04-14T09:59:35.630101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:25:59.503272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-14T09:59:38.995838+0000","last_change":"2024-04-14T09:58:12.864077+0000","last_active":"2024-04-14T09:59:38.995838+0000","last_peered":"2024-04-14T09:59:38.995838+0000","last_clean":"2024-04-14T09:59:38.995838+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T09:59:38.995838+0000","last_undegraded":"2024-04-14T09:59:38.995838+0000","last_fullsized":"2024-04-14T09:59:38.995838+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:58:11.311354+0000","last_clean_scrub_stamp":"2024-04-14T09:58:11.311354+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:26:26.985201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343784,"statfs":{"total":96636764160,"available":96608034816,"internally_reserved":0,"allocated":1064960,"data_stored":792282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":195281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":471040,"data_stored":201878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":454656,"data_stored":194769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":454656,"data_stored":194789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28044,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343796,"statfs":{"total":96636764160,"available":96608047104,"internally_reserved":0,"allocated":1048576,"data_stored":785101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3f last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3e last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3d last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3c last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3b last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.972 INFO:tasks.ceph:pgid 6.3a last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.39 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.38 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.37 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.36 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.35 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.34 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.973 INFO:tasks.ceph:pgid 6.33 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.32 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.31 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.30 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.2f last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.2e last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.2d last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.974 INFO:tasks.ceph:pgid 6.2c last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.2b last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.2a last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.29 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.28 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.27 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.975 INFO:tasks.ceph:pgid 6.26 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.25 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.24 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.23 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.22 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.20 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.976 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.977 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.977 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.977 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.977 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.977 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.978 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.979 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.980 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.981 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.982 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.983 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.984 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.985 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.986 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.986 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.986 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-14T09:59:35.630101+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=35, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.986 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-14T09:58:11.311354+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=58, tm_sec=11, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T09:59:55.986 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:00:15.987 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:00:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.103+0000 7ff19002d640 1 Processor -- start 2024-04-14T10:00:16.103 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.103+0000 7ff19002d640 1 -- start start 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff19002d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 0x7ff1880d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff19002d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 0x7ff1880d0850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff19002d640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff18806f840 con 0x7ff18809aa40 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff19002d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff18806fb20 con 0x7ff1880ce0e0 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff19002d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff1880cc5f0 con 0x7ff1880b45b0 2024-04-14T10:00:16.105 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18ddc9640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7ff18809aa40 0x7ff18809ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:38074/0 (socket says 172.21.15.40:38074) 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18ddc9640 1 -- 172.21.15.40:0/3994602353 learned_addr learned my addr 172.21.15.40:0/3994602353 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/3994602353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 0x7ff1880d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18e5ca640 1 --2- 172.21.15.40:0/3994602353 >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 0x7ff1880d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18cdc7640 1 -- 172.21.15.40:0/3994602353 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 815845057 0 0) 0x7ff18806f840 con 0x7ff18809aa40 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18cdc7640 1 -- 172.21.15.40:0/3994602353 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff174003520 con 0x7ff18809aa40 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18d5c8640 1 -- 172.21.15.40:0/3994602353 >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 msgr2=0x7ff1880d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:00:16.106 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/3994602353 >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 0x7ff1880d0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18d5c8640 1 -- 172.21.15.40:0/3994602353 >> v1:172.21.15.40:6789/0 conn(0x7ff18809aa40 legacy=0x7ff18809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18d5c8640 1 -- 172.21.15.40:0/3994602353 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1880cc8d0 con 0x7ff1880b45b0 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.104+0000 7ff18e5ca640 1 --2- 172.21.15.40:0/3994602353 >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 0x7ff1880d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.105+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/3994602353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 0x7ff1880d0310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1ed8e283e6d3908 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.105+0000 7ff18cdc7640 1 -- 172.21.15.40:0/3994602353 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178035020 con 0x7ff1880b45b0 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.105+0000 7ff18cdc7640 1 -- 172.21.15.40:0/3994602353 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff178031830 con 0x7ff1880b45b0 2024-04-14T10:00:16.107 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.105+0000 7ff18cdc7640 1 -- 172.21.15.40:0/3994602353 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178031c00 con 0x7ff1880b45b0 2024-04-14T10:00:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 -- 172.21.15.40:0/3994602353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 msgr2=0x7ff1880d0310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 --2- 172.21.15.40:0/3994602353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 0x7ff1880d0310 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff1780097a0 tx=0x7ff17802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 -- 172.21.15.40:0/3994602353 shutdown_connections 2024-04-14T10:00:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 --2- 172.21.15.40:0/3994602353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880b45b0 0x7ff1880d0310 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.110 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 --2- 172.21.15.40:0/3994602353 >> v2:172.21.15.136:3300/0 conn(0x7ff1880ce0e0 0x7ff1880d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 -- 172.21.15.40:0/3994602353 >> 172.21.15.40:0/3994602353 conn(0x7ff1880b3a90 msgr2=0x7ff1880b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 -- 172.21.15.40:0/3994602353 shutdown_connections 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.106+0000 7ff19002d640 1 -- 172.21.15.40:0/3994602353 wait complete. 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 Processor -- start 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 -- start start 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff18809aa40 0x7ff188151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.111 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880ce0e0 0x7ff18806d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ff18809b9e0 con 0x7ff1880b45b0 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff18809b860 con 0x7ff18809aa40 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff19002d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff18815e890 con 0x7ff1880ce0e0 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff18d5c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff18d5c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:35202/0 (socket says 172.21.15.40:35202) 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.108+0000 7ff18d5c8640 1 -- 172.21.15.40:0/1911083717 learned_addr learned my addr 172.21.15.40:0/1911083717 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18e5ca640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880ce0e0 0x7ff18806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.112 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18ddc9640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff18809aa40 0x7ff188151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 -- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880ce0e0 msgr2=0x7ff18806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880ce0e0 0x7ff18806d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 -- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff18809aa40 msgr2=0x7ff188151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff18809aa40 0x7ff188151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 -- 172.21.15.40:0/1911083717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff18815f350 con 0x7ff1880b45b0 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff18d5c8640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff17802bee0 tx=0x7ff1780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff178035040 con 0x7ff1880b45b0 2024-04-14T10:00:16.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17803b860 con 0x7ff1880b45b0 2024-04-14T10:00:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff17803bc50 con 0x7ff1880b45b0 2024-04-14T10:00:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1880c67c0 con 0x7ff1880b45b0 2024-04-14T10:00:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.109+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1880aec90 con 0x7ff1880b45b0 2024-04-14T10:00:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.110+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1880b4ac0 con 0x7ff1880b45b0 2024-04-14T10:00:16.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.111+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff178038020 con 0x7ff1880b45b0 2024-04-14T10:00:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.111+0000 7ff17e7fc640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 0x7ff16c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.111+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7ff1780adc80 con 0x7ff1880b45b0 2024-04-14T10:00:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.111+0000 7ff18ddc9640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 0x7ff16c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:16.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.112+0000 7ff18ddc9640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 0x7ff16c06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff184005880 tx=0x7ff184009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:16.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.116+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7ff1880b4ac0 con 0x7ff1880b45b0 2024-04-14T10:00:16.298 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.296+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff1880756f0 con 0x7ff16c06c8f0 2024-04-14T10:00:16.302 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.303+0000 7ff17e7fc640 1 -- 172.21.15.40:0/1911083717 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251896 (secure 0 0 0) 0x7ff1880756f0 con 0x7ff16c06c8f0 2024-04-14T10:00:16.305 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:00:16.307 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 msgr2=0x7ff16c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 0x7ff16c06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff184005880 tx=0x7ff184009040 comp rx=0 tx=0).stop 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 msgr2=0x7ff18815ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff17802bee0 tx=0x7ff1780046c0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 shutdown_connections 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ff16c06c8f0 0x7ff16c06edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff1880ce0e0 0x7ff18806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.309 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ff1880b45b0 0x7ff18815ee10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 --2- 172.21.15.40:0/1911083717 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff18809aa40 0x7ff188151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 >> 172.21.15.40:0/1911083717 conn(0x7ff1880b3a90 msgr2=0x7ff1880b3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 shutdown_connections 2024-04-14T10:00:16.310 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:16.305+0000 7ff19002d640 1 -- 172.21.15.40:0/1911083717 wait complete. 2024-04-14T10:00:16.316 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2024-04-14T10:00:14.830141+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221088,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001317"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427720+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427720+0000","last_peered":"2024-04-14T10:00:05.427720+0000","last_clean":"2024-04-14T10:00:05.427720+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427720+0000","last_undegraded":"2024-04-14T10:00:05.427720+0000","last_fullsized":"2024-04-14T10:00:05.427720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428742+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428742+0000","last_peered":"2024-04-14T10:00:06.428742+0000","last_clean":"2024-04-14T10:00:06.428742+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428742+0000","last_undegraded":"2024-04-14T10:00:06.428742+0000","last_fullsized":"2024-04-14T10:00:06.428742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939148+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939148+0000","last_peered":"2024-04-14T10:00:04.939148+0000","last_clean":"2024-04-14T10:00:04.939148+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939148+0000","last_undegraded":"2024-04-14T10:00:04.939148+0000","last_fullsized":"2024-04-14T10:00:04.939148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071145+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071145+0000","last_peered":"2024-04-14T10:00:05.071145+0000","last_clean":"2024-04-14T10:00:05.071145+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071145+0000","last_undegraded":"2024-04-14T10:00:05.071145+0000","last_fullsized":"2024-04-14T10:00:05.071145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937828+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937828+0000","last_peered":"2024-04-14T10:00:04.937828+0000","last_clean":"2024-04-14T10:00:04.937828+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937828+0000","last_undegraded":"2024-04-14T10:00:04.937828+0000","last_fullsized":"2024-04-14T10:00:04.937828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651006+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651006+0000","last_peered":"2024-04-14T10:00:05.651006+0000","last_clean":"2024-04-14T10:00:05.651006+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651006+0000","last_undegraded":"2024-04-14T10:00:05.651006+0000","last_fullsized":"2024-04-14T10:00:05.651006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651731+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651731+0000","last_peered":"2024-04-14T10:00:05.651731+0000","last_clean":"2024-04-14T10:00:05.651731+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651731+0000","last_undegraded":"2024-04-14T10:00:05.651731+0000","last_fullsized":"2024-04-14T10:00:05.651731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042369+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042369+0000","last_peered":"2024-04-14T10:00:09.042369+0000","last_clean":"2024-04-14T10:00:09.042369+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042369+0000","last_undegraded":"2024-04-14T10:00:09.042369+0000","last_fullsized":"2024-04-14T10:00:09.042369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070925+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070925+0000","last_peered":"2024-04-14T10:00:05.070925+0000","last_clean":"2024-04-14T10:00:05.070925+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070925+0000","last_undegraded":"2024-04-14T10:00:05.070925+0000","last_fullsized":"2024-04-14T10:00:05.070925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937981+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.937981+0000","last_peered":"2024-04-14T10:00:04.937981+0000","last_clean":"2024-04-14T10:00:04.937981+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.937981+0000","last_undegraded":"2024-04-14T10:00:04.937981+0000","last_fullsized":"2024-04-14T10:00:04.937981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650493+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650493+0000","last_peered":"2024-04-14T10:00:05.650493+0000","last_clean":"2024-04-14T10:00:05.650493+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650493+0000","last_undegraded":"2024-04-14T10:00:05.650493+0000","last_fullsized":"2024-04-14T10:00:05.650493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937857+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937857+0000","last_peered":"2024-04-14T10:00:04.937857+0000","last_clean":"2024-04-14T10:00:04.937857+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937857+0000","last_undegraded":"2024-04-14T10:00:04.937857+0000","last_fullsized":"2024-04-14T10:00:04.937857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236614+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236614+0000","last_peered":"2024-04-14T10:00:06.236614+0000","last_clean":"2024-04-14T10:00:06.236614+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236614+0000","last_undegraded":"2024-04-14T10:00:06.236614+0000","last_fullsized":"2024-04-14T10:00:06.236614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937552+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937552+0000","last_peered":"2024-04-14T10:00:04.937552+0000","last_clean":"2024-04-14T10:00:04.937552+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937552+0000","last_undegraded":"2024-04-14T10:00:04.937552+0000","last_fullsized":"2024-04-14T10:00:04.937552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937929+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937929+0000","last_peered":"2024-04-14T10:00:04.937929+0000","last_clean":"2024-04-14T10:00:04.937929+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937929+0000","last_undegraded":"2024-04-14T10:00:04.937929+0000","last_fullsized":"2024-04-14T10:00:04.937929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":17,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936860+0000","last_change":"2024-04-14T09:59:37.671485+0000","last_active":"2024-04-14T10:00:04.936860+0000","last_peered":"2024-04-14T10:00:04.936860+0000","last_clean":"2024-04-14T10:00:04.936860+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:04.936860+0000","last_undegraded":"2024-04-14T10:00:04.936860+0000","last_fullsized":"2024-04-14T10:00:04.936860+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650163+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650163+0000","last_peered":"2024-04-14T10:00:05.650163+0000","last_clean":"2024-04-14T10:00:05.650163+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650163+0000","last_undegraded":"2024-04-14T10:00:05.650163+0000","last_fullsized":"2024-04-14T10:00:05.650163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937990+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.937990+0000","last_peered":"2024-04-14T10:00:04.937990+0000","last_clean":"2024-04-14T10:00:04.937990+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.937990+0000","last_undegraded":"2024-04-14T10:00:04.937990+0000","last_fullsized":"2024-04-14T10:00:04.937990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939180+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939180+0000","last_peered":"2024-04-14T10:00:04.939180+0000","last_clean":"2024-04-14T10:00:04.939180+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939180+0000","last_undegraded":"2024-04-14T10:00:04.939180+0000","last_fullsized":"2024-04-14T10:00:04.939180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651519+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651519+0000","last_peered":"2024-04-14T10:00:05.651519+0000","last_clean":"2024-04-14T10:00:05.651519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651519+0000","last_undegraded":"2024-04-14T10:00:05.651519+0000","last_fullsized":"2024-04-14T10:00:05.651519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427763+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427763+0000","last_peered":"2024-04-14T10:00:05.427763+0000","last_clean":"2024-04-14T10:00:05.427763+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427763+0000","last_undegraded":"2024-04-14T10:00:05.427763+0000","last_fullsized":"2024-04-14T10:00:05.427763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427515+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427515+0000","last_peered":"2024-04-14T10:00:05.427515+0000","last_clean":"2024-04-14T10:00:05.427515+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427515+0000","last_undegraded":"2024-04-14T10:00:05.427515+0000","last_fullsized":"2024-04-14T10:00:05.427515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651342+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651342+0000","last_peered":"2024-04-14T10:00:05.651342+0000","last_clean":"2024-04-14T10:00:05.651342+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651342+0000","last_undegraded":"2024-04-14T10:00:05.651342+0000","last_fullsized":"2024-04-14T10:00:05.651342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651049+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651049+0000","last_peered":"2024-04-14T10:00:05.651049+0000","last_clean":"2024-04-14T10:00:05.651049+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651049+0000","last_undegraded":"2024-04-14T10:00:05.651049+0000","last_fullsized":"2024-04-14T10:00:05.651049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651599+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651599+0000","last_peered":"2024-04-14T10:00:05.651599+0000","last_clean":"2024-04-14T10:00:05.651599+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651599+0000","last_undegraded":"2024-04-14T10:00:05.651599+0000","last_fullsized":"2024-04-14T10:00:05.651599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071192+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071192+0000","last_peered":"2024-04-14T10:00:05.071192+0000","last_clean":"2024-04-14T10:00:05.071192+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071192+0000","last_undegraded":"2024-04-14T10:00:05.071192+0000","last_fullsized":"2024-04-14T10:00:05.071192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071347+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071347+0000","last_peered":"2024-04-14T10:00:05.071347+0000","last_clean":"2024-04-14T10:00:05.071347+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071347+0000","last_undegraded":"2024-04-14T10:00:05.071347+0000","last_fullsized":"2024-04-14T10:00:05.071347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650343+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650343+0000","last_peered":"2024-04-14T10:00:05.650343+0000","last_clean":"2024-04-14T10:00:05.650343+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650343+0000","last_undegraded":"2024-04-14T10:00:05.650343+0000","last_fullsized":"2024-04-14T10:00:05.650343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070210+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070210+0000","last_peered":"2024-04-14T10:00:05.070210+0000","last_clean":"2024-04-14T10:00:05.070210+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070210+0000","last_undegraded":"2024-04-14T10:00:05.070210+0000","last_fullsized":"2024-04-14T10:00:05.070210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071050+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071050+0000","last_peered":"2024-04-14T10:00:05.071050+0000","last_clean":"2024-04-14T10:00:05.071050+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071050+0000","last_undegraded":"2024-04-14T10:00:05.071050+0000","last_fullsized":"2024-04-14T10:00:05.071050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938921+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938921+0000","last_peered":"2024-04-14T10:00:04.938921+0000","last_clean":"2024-04-14T10:00:04.938921+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938921+0000","last_undegraded":"2024-04-14T10:00:04.938921+0000","last_fullsized":"2024-04-14T10:00:04.938921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070938+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070938+0000","last_peered":"2024-04-14T10:00:05.070938+0000","last_clean":"2024-04-14T10:00:05.070938+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070938+0000","last_undegraded":"2024-04-14T10:00:05.070938+0000","last_fullsized":"2024-04-14T10:00:05.070938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200970+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200970+0000","last_peered":"2024-04-14T10:00:08.200970+0000","last_clean":"2024-04-14T10:00:08.200970+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200970+0000","last_undegraded":"2024-04-14T10:00:08.200970+0000","last_fullsized":"2024-04-14T10:00:08.200970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936963+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.936963+0000","last_peered":"2024-04-14T10:00:04.936963+0000","last_clean":"2024-04-14T10:00:04.936963+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.936963+0000","last_undegraded":"2024-04-14T10:00:04.936963+0000","last_fullsized":"2024-04-14T10:00:04.936963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427631+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427631+0000","last_peered":"2024-04-14T10:00:05.427631+0000","last_clean":"2024-04-14T10:00:05.427631+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427631+0000","last_undegraded":"2024-04-14T10:00:05.427631+0000","last_fullsized":"2024-04-14T10:00:05.427631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070926+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.070926+0000","last_peered":"2024-04-14T10:00:05.070926+0000","last_clean":"2024-04-14T10:00:05.070926+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.070926+0000","last_undegraded":"2024-04-14T10:00:05.070926+0000","last_fullsized":"2024-04-14T10:00:05.070926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650250+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650250+0000","last_peered":"2024-04-14T10:00:05.650250+0000","last_clean":"2024-04-14T10:00:05.650250+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650250+0000","last_undegraded":"2024-04-14T10:00:05.650250+0000","last_fullsized":"2024-04-14T10:00:05.650250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651414+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651414+0000","last_peered":"2024-04-14T10:00:05.651414+0000","last_clean":"2024-04-14T10:00:05.651414+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651414+0000","last_undegraded":"2024-04-14T10:00:05.651414+0000","last_fullsized":"2024-04-14T10:00:05.651414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992247+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992247+0000","last_peered":"2024-04-14T10:00:07.992247+0000","last_clean":"2024-04-14T10:00:07.992247+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992247+0000","last_undegraded":"2024-04-14T10:00:07.992247+0000","last_fullsized":"2024-04-14T10:00:07.992247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071273+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071273+0000","last_peered":"2024-04-14T10:00:05.071273+0000","last_clean":"2024-04-14T10:00:05.071273+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071273+0000","last_undegraded":"2024-04-14T10:00:05.071273+0000","last_fullsized":"2024-04-14T10:00:05.071273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394004+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394004+0000","last_peered":"2024-04-14T10:00:07.394004+0000","last_clean":"2024-04-14T10:00:07.394004+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394004+0000","last_undegraded":"2024-04-14T10:00:07.394004+0000","last_fullsized":"2024-04-14T10:00:07.394004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939187+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939187+0000","last_peered":"2024-04-14T10:00:04.939187+0000","last_clean":"2024-04-14T10:00:04.939187+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939187+0000","last_undegraded":"2024-04-14T10:00:04.939187+0000","last_fullsized":"2024-04-14T10:00:04.939187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939207+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939207+0000","last_peered":"2024-04-14T10:00:04.939207+0000","last_clean":"2024-04-14T10:00:04.939207+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939207+0000","last_undegraded":"2024-04-14T10:00:04.939207+0000","last_fullsized":"2024-04-14T10:00:04.939207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939175+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939175+0000","last_peered":"2024-04-14T10:00:04.939175+0000","last_clean":"2024-04-14T10:00:04.939175+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939175+0000","last_undegraded":"2024-04-14T10:00:04.939175+0000","last_fullsized":"2024-04-14T10:00:04.939175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650090+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650090+0000","last_peered":"2024-04-14T10:00:05.650090+0000","last_clean":"2024-04-14T10:00:05.650090+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650090+0000","last_undegraded":"2024-04-14T10:00:05.650090+0000","last_fullsized":"2024-04-14T10:00:05.650090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937784+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937784+0000","last_peered":"2024-04-14T10:00:04.937784+0000","last_clean":"2024-04-14T10:00:04.937784+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937784+0000","last_undegraded":"2024-04-14T10:00:04.937784+0000","last_fullsized":"2024-04-14T10:00:04.937784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651591+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651591+0000","last_peered":"2024-04-14T10:00:05.651591+0000","last_clean":"2024-04-14T10:00:05.651591+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651591+0000","last_undegraded":"2024-04-14T10:00:05.651591+0000","last_fullsized":"2024-04-14T10:00:05.651591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650877+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650877+0000","last_peered":"2024-04-14T10:00:05.650877+0000","last_clean":"2024-04-14T10:00:05.650877+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650877+0000","last_undegraded":"2024-04-14T10:00:05.650877+0000","last_fullsized":"2024-04-14T10:00:05.650877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937149+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937149+0000","last_peered":"2024-04-14T10:00:04.937149+0000","last_clean":"2024-04-14T10:00:04.937149+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937149+0000","last_undegraded":"2024-04-14T10:00:04.937149+0000","last_fullsized":"2024-04-14T10:00:04.937149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427207+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427207+0000","last_peered":"2024-04-14T10:00:05.427207+0000","last_clean":"2024-04-14T10:00:05.427207+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427207+0000","last_undegraded":"2024-04-14T10:00:05.427207+0000","last_fullsized":"2024-04-14T10:00:05.427207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937371+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937371+0000","last_peered":"2024-04-14T10:00:04.937371+0000","last_clean":"2024-04-14T10:00:04.937371+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937371+0000","last_undegraded":"2024-04-14T10:00:04.937371+0000","last_fullsized":"2024-04-14T10:00:04.937371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":218,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936834+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936834+0000","last_peered":"2024-04-14T10:00:04.936834+0000","last_clean":"2024-04-14T10:00:04.936834+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936834+0000","last_undegraded":"2024-04-14T10:00:04.936834+0000","last_fullsized":"2024-04-14T10:00:04.936834+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:00:16.321 INFO:tasks.ceph:pgid 6.21 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:00:16.322 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:00:16.322 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:00:22.747 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:00:22.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:00:36.323 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:00:36.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.436+0000 7f194bc0f640 1 Processor -- start 2024-04-14T10:00:36.436 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 -- start start 2024-04-14T10:00:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f194415e570 0x7f19440cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 0x7f19440c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19440d05b0 con 0x7f1944162f70 2024-04-14T10:00:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f19440d11c0 con 0x7f194415e570 2024-04-14T10:00:36.438 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.437+0000 7f194bc0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19440d0890 con 0x7f19440d0130 2024-04-14T10:00:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f19491aa640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f1944162f70 0x7f1944162340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:41088/0 (socket says 172.21.15.40:41088) 2024-04-14T10:00:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f19491aa640 1 -- 172.21.15.40:0/2912023718 learned_addr learned my addr 172.21.15.40:0/2912023718 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:00:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f194a1ac640 1 --2- 172.21.15.40:0/2912023718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 0x7f19440c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f19499ab640 1 --2- 172.21.15.40:0/2912023718 >> v2:172.21.15.136:3300/0 conn(0x7f194415e570 0x7f19440cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.439 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f19489a9640 1 -- 172.21.15.40:0/2912023718 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528876662 0 0) 0x7f19440d05b0 con 0x7f1944162f70 2024-04-14T10:00:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f19489a9640 1 -- 172.21.15.40:0/2912023718 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f192c003520 con 0x7f1944162f70 2024-04-14T10:00:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f194a1ac640 1 -- 172.21.15.40:0/2912023718 >> v2:172.21.15.136:3300/0 conn(0x7f194415e570 msgr2=0x7f19440cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:00:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f194a1ac640 1 --2- 172.21.15.40:0/2912023718 >> v2:172.21.15.136:3300/0 conn(0x7f194415e570 0x7f19440cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f194a1ac640 1 -- 172.21.15.40:0/2912023718 >> v1:172.21.15.40:6789/0 conn(0x7f1944162f70 legacy=0x7f1944162340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.440 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.438+0000 7f194a1ac640 1 -- 172.21.15.40:0/2912023718 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19440d0b70 con 0x7f19440d0130 2024-04-14T10:00:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.439+0000 7f194a1ac640 1 --2- 172.21.15.40:0/2912023718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 0x7f19440c9f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097a0 tx=0x7f193c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6f3f5c1f94abd0e server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.439+0000 7f19489a9640 1 -- 172.21.15.40:0/2912023718 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c035020 con 0x7f19440d0130 2024-04-14T10:00:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.439+0000 7f19489a9640 1 -- 172.21.15.40:0/2912023718 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c031830 con 0x7f19440d0130 2024-04-14T10:00:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.439+0000 7f19489a9640 1 -- 172.21.15.40:0/2912023718 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c031c00 con 0x7f19440d0130 2024-04-14T10:00:36.444 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 -- 172.21.15.40:0/2912023718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 msgr2=0x7f19440c9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 --2- 172.21.15.40:0/2912023718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 0x7f19440c9f90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f193c0097a0 tx=0x7f193c02b8d0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 -- 172.21.15.40:0/2912023718 shutdown_connections 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 --2- 172.21.15.40:0/2912023718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19440d0130 0x7f19440c9f90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 --2- 172.21.15.40:0/2912023718 >> v2:172.21.15.136:3300/0 conn(0x7f194415e570 0x7f19440cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 -- 172.21.15.40:0/2912023718 >> 172.21.15.40:0/2912023718 conn(0x7f194409d5a0 msgr2=0x7f19440d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 -- 172.21.15.40:0/2912023718 shutdown_connections 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.440+0000 7f194bc0f640 1 -- 172.21.15.40:0/2912023718 wait complete. 2024-04-14T10:00:36.445 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.441+0000 7f194bc0f640 1 Processor -- start 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.441+0000 7f194bc0f640 1 -- start start 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 0x7f19440b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f194415e570 0x7f19440ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 0x7f19441517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1944162bd0 con 0x7f1944162f70 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1944162a50 con 0x7f19440d0130 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194bc0f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19440d1650 con 0x7f194415e570 2024-04-14T10:00:36.446 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f19499ab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 0x7f19440b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 0x7f19441517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f19499ab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 0x7f19440b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.40:57570/0 (socket says 172.21.15.40:57570) 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f19499ab640 1 -- 172.21.15.40:0/885091006 learned_addr learned my addr 172.21.15.40:0/885091006 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f19491aa640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f194415e570 0x7f19440ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 -- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f194415e570 msgr2=0x7f19440ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f194415e570 0x7f19440ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 -- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 msgr2=0x7f19440b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.447 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 0x7f19440b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 -- 172.21.15.40:0/885091006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194409e2d0 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.442+0000 7f194a1ac640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 0x7f19441517a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f193c033000 tx=0x7f193c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.443+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c035040 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.443+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f193c03b880 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.443+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194409e5b0 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.443+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f193c03bc70 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.443+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19440b7690 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.444+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194409e780 con 0x7f1944162f70 2024-04-14T10:00:36.448 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.444+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f193c038020 con 0x7f1944162f70 2024-04-14T10:00:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.445+0000 7f19427fc640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 0x7f193006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.445+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f193c0adbe0 con 0x7f1944162f70 2024-04-14T10:00:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.445+0000 7f19499ab640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 0x7f193006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:36.449 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.445+0000 7f19499ab640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 0x7f193006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1934009a40 tx=0x7f193400b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:36.450 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.449+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f193c07b800 con 0x7f1944162f70 2024-04-14T10:00:36.630 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.631+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f194409e080 con 0x7f193006c8f0 2024-04-14T10:00:36.641 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.642+0000 7f19427fc640 1 -- 172.21.15.40:0/885091006 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f194409e080 con 0x7f193006c8f0 2024-04-14T10:00:36.644 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:00:36.645 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:00:36.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.644+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 msgr2=0x7f193006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.644+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 0x7f193006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1934009a40 tx=0x7f193400b040 comp rx=0 tx=0).stop 2024-04-14T10:00:36.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.644+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 msgr2=0x7f19441517a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.644+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 0x7f19441517a0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f193c033000 tx=0x7f193c0046c0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 shutdown_connections 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f193006c8f0 0x7f193006edb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f1944162f70 0x7f19441517a0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f194415e570 0x7f19440ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 --2- 172.21.15.40:0/885091006 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19440d0130 0x7f19440b67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 >> 172.21.15.40:0/885091006 conn(0x7f194409d5a0 msgr2=0x7f194415ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:36.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 shutdown_connections 2024-04-14T10:00:36.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:36.645+0000 7f194bc0f640 1 -- 172.21.15.40:0/885091006 wait complete. 2024-04-14T10:00:36.654 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2024-04-14T10:00:34.833389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001819"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427720+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427720+0000","last_peered":"2024-04-14T10:00:05.427720+0000","last_clean":"2024-04-14T10:00:05.427720+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427720+0000","last_undegraded":"2024-04-14T10:00:05.427720+0000","last_fullsized":"2024-04-14T10:00:05.427720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428742+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428742+0000","last_peered":"2024-04-14T10:00:06.428742+0000","last_clean":"2024-04-14T10:00:06.428742+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428742+0000","last_undegraded":"2024-04-14T10:00:06.428742+0000","last_fullsized":"2024-04-14T10:00:06.428742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939148+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939148+0000","last_peered":"2024-04-14T10:00:04.939148+0000","last_clean":"2024-04-14T10:00:04.939148+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939148+0000","last_undegraded":"2024-04-14T10:00:04.939148+0000","last_fullsized":"2024-04-14T10:00:04.939148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071145+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071145+0000","last_peered":"2024-04-14T10:00:05.071145+0000","last_clean":"2024-04-14T10:00:05.071145+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071145+0000","last_undegraded":"2024-04-14T10:00:05.071145+0000","last_fullsized":"2024-04-14T10:00:05.071145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937828+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937828+0000","last_peered":"2024-04-14T10:00:04.937828+0000","last_clean":"2024-04-14T10:00:04.937828+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937828+0000","last_undegraded":"2024-04-14T10:00:04.937828+0000","last_fullsized":"2024-04-14T10:00:04.937828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651006+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651006+0000","last_peered":"2024-04-14T10:00:05.651006+0000","last_clean":"2024-04-14T10:00:05.651006+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651006+0000","last_undegraded":"2024-04-14T10:00:05.651006+0000","last_fullsized":"2024-04-14T10:00:05.651006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651731+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651731+0000","last_peered":"2024-04-14T10:00:05.651731+0000","last_clean":"2024-04-14T10:00:05.651731+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651731+0000","last_undegraded":"2024-04-14T10:00:05.651731+0000","last_fullsized":"2024-04-14T10:00:05.651731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042369+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042369+0000","last_peered":"2024-04-14T10:00:09.042369+0000","last_clean":"2024-04-14T10:00:09.042369+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042369+0000","last_undegraded":"2024-04-14T10:00:09.042369+0000","last_fullsized":"2024-04-14T10:00:09.042369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070925+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070925+0000","last_peered":"2024-04-14T10:00:05.070925+0000","last_clean":"2024-04-14T10:00:05.070925+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070925+0000","last_undegraded":"2024-04-14T10:00:05.070925+0000","last_fullsized":"2024-04-14T10:00:05.070925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937981+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.937981+0000","last_peered":"2024-04-14T10:00:04.937981+0000","last_clean":"2024-04-14T10:00:04.937981+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.937981+0000","last_undegraded":"2024-04-14T10:00:04.937981+0000","last_fullsized":"2024-04-14T10:00:04.937981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650493+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650493+0000","last_peered":"2024-04-14T10:00:05.650493+0000","last_clean":"2024-04-14T10:00:05.650493+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650493+0000","last_undegraded":"2024-04-14T10:00:05.650493+0000","last_fullsized":"2024-04-14T10:00:05.650493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937857+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937857+0000","last_peered":"2024-04-14T10:00:04.937857+0000","last_clean":"2024-04-14T10:00:04.937857+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937857+0000","last_undegraded":"2024-04-14T10:00:04.937857+0000","last_fullsized":"2024-04-14T10:00:04.937857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236614+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236614+0000","last_peered":"2024-04-14T10:00:06.236614+0000","last_clean":"2024-04-14T10:00:06.236614+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236614+0000","last_undegraded":"2024-04-14T10:00:06.236614+0000","last_fullsized":"2024-04-14T10:00:06.236614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937552+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937552+0000","last_peered":"2024-04-14T10:00:04.937552+0000","last_clean":"2024-04-14T10:00:04.937552+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937552+0000","last_undegraded":"2024-04-14T10:00:04.937552+0000","last_fullsized":"2024-04-14T10:00:04.937552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937929+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937929+0000","last_peered":"2024-04-14T10:00:04.937929+0000","last_clean":"2024-04-14T10:00:04.937929+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937929+0000","last_undegraded":"2024-04-14T10:00:04.937929+0000","last_fullsized":"2024-04-14T10:00:04.937929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011831+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011831+0000","last_peered":"2024-04-14T10:00:10.011831+0000","last_clean":"2024-04-14T10:00:10.011831+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011831+0000","last_undegraded":"2024-04-14T10:00:10.011831+0000","last_fullsized":"2024-04-14T10:00:10.011831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650163+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650163+0000","last_peered":"2024-04-14T10:00:05.650163+0000","last_clean":"2024-04-14T10:00:05.650163+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650163+0000","last_undegraded":"2024-04-14T10:00:05.650163+0000","last_fullsized":"2024-04-14T10:00:05.650163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937990+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.937990+0000","last_peered":"2024-04-14T10:00:04.937990+0000","last_clean":"2024-04-14T10:00:04.937990+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.937990+0000","last_undegraded":"2024-04-14T10:00:04.937990+0000","last_fullsized":"2024-04-14T10:00:04.937990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939180+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939180+0000","last_peered":"2024-04-14T10:00:04.939180+0000","last_clean":"2024-04-14T10:00:04.939180+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939180+0000","last_undegraded":"2024-04-14T10:00:04.939180+0000","last_fullsized":"2024-04-14T10:00:04.939180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651519+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651519+0000","last_peered":"2024-04-14T10:00:05.651519+0000","last_clean":"2024-04-14T10:00:05.651519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651519+0000","last_undegraded":"2024-04-14T10:00:05.651519+0000","last_fullsized":"2024-04-14T10:00:05.651519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427763+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427763+0000","last_peered":"2024-04-14T10:00:05.427763+0000","last_clean":"2024-04-14T10:00:05.427763+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427763+0000","last_undegraded":"2024-04-14T10:00:05.427763+0000","last_fullsized":"2024-04-14T10:00:05.427763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427515+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427515+0000","last_peered":"2024-04-14T10:00:05.427515+0000","last_clean":"2024-04-14T10:00:05.427515+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427515+0000","last_undegraded":"2024-04-14T10:00:05.427515+0000","last_fullsized":"2024-04-14T10:00:05.427515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651342+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651342+0000","last_peered":"2024-04-14T10:00:05.651342+0000","last_clean":"2024-04-14T10:00:05.651342+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651342+0000","last_undegraded":"2024-04-14T10:00:05.651342+0000","last_fullsized":"2024-04-14T10:00:05.651342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651049+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651049+0000","last_peered":"2024-04-14T10:00:05.651049+0000","last_clean":"2024-04-14T10:00:05.651049+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651049+0000","last_undegraded":"2024-04-14T10:00:05.651049+0000","last_fullsized":"2024-04-14T10:00:05.651049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651599+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651599+0000","last_peered":"2024-04-14T10:00:05.651599+0000","last_clean":"2024-04-14T10:00:05.651599+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651599+0000","last_undegraded":"2024-04-14T10:00:05.651599+0000","last_fullsized":"2024-04-14T10:00:05.651599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071192+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071192+0000","last_peered":"2024-04-14T10:00:05.071192+0000","last_clean":"2024-04-14T10:00:05.071192+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071192+0000","last_undegraded":"2024-04-14T10:00:05.071192+0000","last_fullsized":"2024-04-14T10:00:05.071192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071347+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071347+0000","last_peered":"2024-04-14T10:00:05.071347+0000","last_clean":"2024-04-14T10:00:05.071347+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071347+0000","last_undegraded":"2024-04-14T10:00:05.071347+0000","last_fullsized":"2024-04-14T10:00:05.071347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650343+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650343+0000","last_peered":"2024-04-14T10:00:05.650343+0000","last_clean":"2024-04-14T10:00:05.650343+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650343+0000","last_undegraded":"2024-04-14T10:00:05.650343+0000","last_fullsized":"2024-04-14T10:00:05.650343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070210+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070210+0000","last_peered":"2024-04-14T10:00:05.070210+0000","last_clean":"2024-04-14T10:00:05.070210+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070210+0000","last_undegraded":"2024-04-14T10:00:05.070210+0000","last_fullsized":"2024-04-14T10:00:05.070210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071050+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071050+0000","last_peered":"2024-04-14T10:00:05.071050+0000","last_clean":"2024-04-14T10:00:05.071050+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071050+0000","last_undegraded":"2024-04-14T10:00:05.071050+0000","last_fullsized":"2024-04-14T10:00:05.071050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938921+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938921+0000","last_peered":"2024-04-14T10:00:04.938921+0000","last_clean":"2024-04-14T10:00:04.938921+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938921+0000","last_undegraded":"2024-04-14T10:00:04.938921+0000","last_fullsized":"2024-04-14T10:00:04.938921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070938+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070938+0000","last_peered":"2024-04-14T10:00:05.070938+0000","last_clean":"2024-04-14T10:00:05.070938+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070938+0000","last_undegraded":"2024-04-14T10:00:05.070938+0000","last_fullsized":"2024-04-14T10:00:05.070938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200970+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200970+0000","last_peered":"2024-04-14T10:00:08.200970+0000","last_clean":"2024-04-14T10:00:08.200970+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200970+0000","last_undegraded":"2024-04-14T10:00:08.200970+0000","last_fullsized":"2024-04-14T10:00:08.200970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936963+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.936963+0000","last_peered":"2024-04-14T10:00:04.936963+0000","last_clean":"2024-04-14T10:00:04.936963+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.936963+0000","last_undegraded":"2024-04-14T10:00:04.936963+0000","last_fullsized":"2024-04-14T10:00:04.936963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427631+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427631+0000","last_peered":"2024-04-14T10:00:05.427631+0000","last_clean":"2024-04-14T10:00:05.427631+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427631+0000","last_undegraded":"2024-04-14T10:00:05.427631+0000","last_fullsized":"2024-04-14T10:00:05.427631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070926+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.070926+0000","last_peered":"2024-04-14T10:00:05.070926+0000","last_clean":"2024-04-14T10:00:05.070926+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.070926+0000","last_undegraded":"2024-04-14T10:00:05.070926+0000","last_fullsized":"2024-04-14T10:00:05.070926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650250+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650250+0000","last_peered":"2024-04-14T10:00:05.650250+0000","last_clean":"2024-04-14T10:00:05.650250+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650250+0000","last_undegraded":"2024-04-14T10:00:05.650250+0000","last_fullsized":"2024-04-14T10:00:05.650250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651414+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651414+0000","last_peered":"2024-04-14T10:00:05.651414+0000","last_clean":"2024-04-14T10:00:05.651414+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651414+0000","last_undegraded":"2024-04-14T10:00:05.651414+0000","last_fullsized":"2024-04-14T10:00:05.651414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992247+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992247+0000","last_peered":"2024-04-14T10:00:07.992247+0000","last_clean":"2024-04-14T10:00:07.992247+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992247+0000","last_undegraded":"2024-04-14T10:00:07.992247+0000","last_fullsized":"2024-04-14T10:00:07.992247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071273+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071273+0000","last_peered":"2024-04-14T10:00:05.071273+0000","last_clean":"2024-04-14T10:00:05.071273+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071273+0000","last_undegraded":"2024-04-14T10:00:05.071273+0000","last_fullsized":"2024-04-14T10:00:05.071273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394004+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394004+0000","last_peered":"2024-04-14T10:00:07.394004+0000","last_clean":"2024-04-14T10:00:07.394004+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394004+0000","last_undegraded":"2024-04-14T10:00:07.394004+0000","last_fullsized":"2024-04-14T10:00:07.394004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939187+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939187+0000","last_peered":"2024-04-14T10:00:04.939187+0000","last_clean":"2024-04-14T10:00:04.939187+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939187+0000","last_undegraded":"2024-04-14T10:00:04.939187+0000","last_fullsized":"2024-04-14T10:00:04.939187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939207+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939207+0000","last_peered":"2024-04-14T10:00:04.939207+0000","last_clean":"2024-04-14T10:00:04.939207+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939207+0000","last_undegraded":"2024-04-14T10:00:04.939207+0000","last_fullsized":"2024-04-14T10:00:04.939207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939175+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939175+0000","last_peered":"2024-04-14T10:00:04.939175+0000","last_clean":"2024-04-14T10:00:04.939175+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939175+0000","last_undegraded":"2024-04-14T10:00:04.939175+0000","last_fullsized":"2024-04-14T10:00:04.939175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650090+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650090+0000","last_peered":"2024-04-14T10:00:05.650090+0000","last_clean":"2024-04-14T10:00:05.650090+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650090+0000","last_undegraded":"2024-04-14T10:00:05.650090+0000","last_fullsized":"2024-04-14T10:00:05.650090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937784+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937784+0000","last_peered":"2024-04-14T10:00:04.937784+0000","last_clean":"2024-04-14T10:00:04.937784+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937784+0000","last_undegraded":"2024-04-14T10:00:04.937784+0000","last_fullsized":"2024-04-14T10:00:04.937784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651591+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651591+0000","last_peered":"2024-04-14T10:00:05.651591+0000","last_clean":"2024-04-14T10:00:05.651591+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651591+0000","last_undegraded":"2024-04-14T10:00:05.651591+0000","last_fullsized":"2024-04-14T10:00:05.651591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650877+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650877+0000","last_peered":"2024-04-14T10:00:05.650877+0000","last_clean":"2024-04-14T10:00:05.650877+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650877+0000","last_undegraded":"2024-04-14T10:00:05.650877+0000","last_fullsized":"2024-04-14T10:00:05.650877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937149+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937149+0000","last_peered":"2024-04-14T10:00:04.937149+0000","last_clean":"2024-04-14T10:00:04.937149+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937149+0000","last_undegraded":"2024-04-14T10:00:04.937149+0000","last_fullsized":"2024-04-14T10:00:04.937149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427207+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427207+0000","last_peered":"2024-04-14T10:00:05.427207+0000","last_clean":"2024-04-14T10:00:05.427207+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427207+0000","last_undegraded":"2024-04-14T10:00:05.427207+0000","last_fullsized":"2024-04-14T10:00:05.427207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937371+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937371+0000","last_peered":"2024-04-14T10:00:04.937371+0000","last_clean":"2024-04-14T10:00:04.937371+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937371+0000","last_undegraded":"2024-04-14T10:00:04.937371+0000","last_fullsized":"2024-04-14T10:00:04.937371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936876+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936876+0000","last_peered":"2024-04-14T10:00:04.936876+0000","last_clean":"2024-04-14T10:00:04.936876+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936876+0000","last_undegraded":"2024-04-14T10:00:04.936876+0000","last_fullsized":"2024-04-14T10:00:04.936876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:00:36.660 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:00:36.660 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:00:52.859 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:00:52.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:00:56.662 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:00:56.773 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.774+0000 7f16267aa640 1 Processor -- start 2024-04-14T10:00:56.774 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.774+0000 7f16267aa640 1 -- start start 2024-04-14T10:00:56.775 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f16267aa640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f162006bcf0 0x7f16200ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f16267aa640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16200b4bb0 con 0x7f16200b0690 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f16267aa640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1620072570 con 0x7f1620161b80 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f16267aa640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1620072320 con 0x7f162006bcf0 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f1624d47640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f16200b0690 0x7f162006e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:42536/0 (socket says 172.21.15.40:42536) 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f1624d47640 1 -- 172.21.15.40:0/2007034909 learned_addr learned my addr 172.21.15.40:0/2007034909 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161f7fe640 1 --2- 172.21.15.40:0/2007034909 >> v2:172.21.15.136:3300/0 conn(0x7f162006bcf0 0x7f16200ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:56.776 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161effd640 1 -- 172.21.15.40:0/2007034909 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 919371005 0 0) 0x7f16200b4bb0 con 0x7f16200b0690 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161effd640 1 -- 172.21.15.40:0/2007034909 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1608003520 con 0x7f16200b0690 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161f7fe640 1 -- 172.21.15.40:0/2007034909 >> v1:172.21.15.136:6789/0 conn(0x7f1620161b80 legacy=0x7f1620073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161f7fe640 1 -- 172.21.15.40:0/2007034909 >> v1:172.21.15.40:6789/0 conn(0x7f16200b0690 legacy=0x7f162006e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.775+0000 7f161f7fe640 1 -- 172.21.15.40:0/2007034909 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1620072850 con 0x7f162006bcf0 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.776+0000 7f161f7fe640 1 --2- 172.21.15.40:0/2007034909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f162006bcf0 0x7f16200ad8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16100097a0 tx=0x7f161002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bc5cc119e9b45e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.776+0000 7f161effd640 1 -- 172.21.15.40:0/2007034909 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610035020 con 0x7f162006bcf0 2024-04-14T10:00:56.777 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.776+0000 7f161effd640 1 -- 172.21.15.40:0/2007034909 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1610031830 con 0x7f162006bcf0 2024-04-14T10:00:56.778 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.776+0000 7f161effd640 1 -- 172.21.15.40:0/2007034909 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1610031be0 con 0x7f162006bcf0 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 -- 172.21.15.40:0/2007034909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f162006bcf0 msgr2=0x7f16200ad8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 --2- 172.21.15.40:0/2007034909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f162006bcf0 0x7f16200ad8b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f16100097a0 tx=0x7f161002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 -- 172.21.15.40:0/2007034909 shutdown_connections 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 --2- 172.21.15.40:0/2007034909 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f162006bcf0 0x7f16200ad8b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 -- 172.21.15.40:0/2007034909 >> 172.21.15.40:0/2007034909 conn(0x7f16200b6540 msgr2=0x7f16200b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 -- 172.21.15.40:0/2007034909 shutdown_connections 2024-04-14T10:00:56.781 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.777+0000 7f16267aa640 1 -- 172.21.15.40:0/2007034909 wait complete. 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.778+0000 7f16267aa640 1 Processor -- start 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.778+0000 7f16267aa640 1 -- start start 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16200b0690 0x7f16201f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 0x7f1620152c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f1620073760 con 0x7f162006bcf0 2024-04-14T10:00:56.782 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f16200b01e0 con 0x7f1620161b80 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f16267aa640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f16200738e0 con 0x7f16200b0690 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:60328/0 (socket says 172.21.15.40:60328) 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 -- 172.21.15.40:0/2681680966 learned_addr learned my addr 172.21.15.40:0/2681680966 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161f7fe640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16200b0690 0x7f16201f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f1624d47640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 0x7f1620152c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 -- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16200b0690 msgr2=0x7f16201f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.783 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16200b0690 0x7f16201f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 -- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 msgr2=0x7f1620152c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.779+0000 7f161ffff640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 0x7f1620152c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f161ffff640 1 -- 172.21.15.40:0/2681680966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162015c660 con 0x7f162006bcf0 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f1624d47640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 0x7f1620152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f161ffff640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f161400c3c0 tx=0x7f161400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16140052d0 con 0x7f162006bcf0 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1614005490 con 0x7f162006bcf0 2024-04-14T10:00:56.784 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1614007260 con 0x7f162006bcf0 2024-04-14T10:00:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1620150e10 con 0x7f162006bcf0 2024-04-14T10:00:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.780+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1620151900 con 0x7f162006bcf0 2024-04-14T10:00:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.781+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16200756f0 con 0x7f162006bcf0 2024-04-14T10:00:56.785 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.781+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1614007400 con 0x7f162006bcf0 2024-04-14T10:00:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.782+0000 7f161cff9640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 0x7f160c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:00:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.782+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f161408b0c0 con 0x7f162006bcf0 2024-04-14T10:00:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.782+0000 7f161f7fe640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 0x7f160c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:00:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.782+0000 7f161f7fe640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 0x7f160c06edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1610036000 tx=0x7f161003d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:00:56.786 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.786+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f1614058d80 con 0x7f162006bcf0 2024-04-14T10:00:56.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.967+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f162006cc40 con 0x7f160c06c8f0 2024-04-14T10:00:56.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.979+0000 7f161cff9640 1 -- 172.21.15.40:0/2681680966 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f1610088810 con 0x7f160c06c8f0 2024-04-14T10:00:56.982 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:00:56.983 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 msgr2=0x7f160c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 0x7f160c06edb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1610036000 tx=0x7f161003d040 comp rx=0 tx=0).stop 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 msgr2=0x7f16201508d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f161400c3c0 tx=0x7f161400c880 comp rx=0 tx=0).stop 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 shutdown_connections 2024-04-14T10:00:56.985 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f160c06c8f0 0x7f160c06edb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1620161b80 0x7f1620152c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f16200b0690 0x7f16201f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 --2- 172.21.15.40:0/2681680966 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f162006bcf0 0x7f16201508d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 >> 172.21.15.40:0/2681680966 conn(0x7f16200b6540 msgr2=0x7f16200b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 shutdown_connections 2024-04-14T10:00:56.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:00:56.982+0000 7f16267aa640 1 -- 172.21.15.40:0/2681680966 wait complete. 2024-04-14T10:00:56.992 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2024-04-14T10:00:56.836836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001773"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427720+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427720+0000","last_peered":"2024-04-14T10:00:05.427720+0000","last_clean":"2024-04-14T10:00:05.427720+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427720+0000","last_undegraded":"2024-04-14T10:00:05.427720+0000","last_fullsized":"2024-04-14T10:00:05.427720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428742+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428742+0000","last_peered":"2024-04-14T10:00:06.428742+0000","last_clean":"2024-04-14T10:00:06.428742+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428742+0000","last_undegraded":"2024-04-14T10:00:06.428742+0000","last_fullsized":"2024-04-14T10:00:06.428742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939148+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939148+0000","last_peered":"2024-04-14T10:00:04.939148+0000","last_clean":"2024-04-14T10:00:04.939148+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939148+0000","last_undegraded":"2024-04-14T10:00:04.939148+0000","last_fullsized":"2024-04-14T10:00:04.939148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071145+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071145+0000","last_peered":"2024-04-14T10:00:05.071145+0000","last_clean":"2024-04-14T10:00:05.071145+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071145+0000","last_undegraded":"2024-04-14T10:00:05.071145+0000","last_fullsized":"2024-04-14T10:00:05.071145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937828+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937828+0000","last_peered":"2024-04-14T10:00:04.937828+0000","last_clean":"2024-04-14T10:00:04.937828+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937828+0000","last_undegraded":"2024-04-14T10:00:04.937828+0000","last_fullsized":"2024-04-14T10:00:04.937828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651006+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651006+0000","last_peered":"2024-04-14T10:00:05.651006+0000","last_clean":"2024-04-14T10:00:05.651006+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651006+0000","last_undegraded":"2024-04-14T10:00:05.651006+0000","last_fullsized":"2024-04-14T10:00:05.651006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651731+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651731+0000","last_peered":"2024-04-14T10:00:05.651731+0000","last_clean":"2024-04-14T10:00:05.651731+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651731+0000","last_undegraded":"2024-04-14T10:00:05.651731+0000","last_fullsized":"2024-04-14T10:00:05.651731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042369+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042369+0000","last_peered":"2024-04-14T10:00:09.042369+0000","last_clean":"2024-04-14T10:00:09.042369+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042369+0000","last_undegraded":"2024-04-14T10:00:09.042369+0000","last_fullsized":"2024-04-14T10:00:09.042369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070925+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070925+0000","last_peered":"2024-04-14T10:00:05.070925+0000","last_clean":"2024-04-14T10:00:05.070925+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070925+0000","last_undegraded":"2024-04-14T10:00:05.070925+0000","last_fullsized":"2024-04-14T10:00:05.070925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937981+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.937981+0000","last_peered":"2024-04-14T10:00:04.937981+0000","last_clean":"2024-04-14T10:00:04.937981+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.937981+0000","last_undegraded":"2024-04-14T10:00:04.937981+0000","last_fullsized":"2024-04-14T10:00:04.937981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650493+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650493+0000","last_peered":"2024-04-14T10:00:05.650493+0000","last_clean":"2024-04-14T10:00:05.650493+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650493+0000","last_undegraded":"2024-04-14T10:00:05.650493+0000","last_fullsized":"2024-04-14T10:00:05.650493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937857+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937857+0000","last_peered":"2024-04-14T10:00:04.937857+0000","last_clean":"2024-04-14T10:00:04.937857+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937857+0000","last_undegraded":"2024-04-14T10:00:04.937857+0000","last_fullsized":"2024-04-14T10:00:04.937857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236614+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236614+0000","last_peered":"2024-04-14T10:00:06.236614+0000","last_clean":"2024-04-14T10:00:06.236614+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236614+0000","last_undegraded":"2024-04-14T10:00:06.236614+0000","last_fullsized":"2024-04-14T10:00:06.236614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937552+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937552+0000","last_peered":"2024-04-14T10:00:04.937552+0000","last_clean":"2024-04-14T10:00:04.937552+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937552+0000","last_undegraded":"2024-04-14T10:00:04.937552+0000","last_fullsized":"2024-04-14T10:00:04.937552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937929+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937929+0000","last_peered":"2024-04-14T10:00:04.937929+0000","last_clean":"2024-04-14T10:00:04.937929+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937929+0000","last_undegraded":"2024-04-14T10:00:04.937929+0000","last_fullsized":"2024-04-14T10:00:04.937929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011831+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011831+0000","last_peered":"2024-04-14T10:00:10.011831+0000","last_clean":"2024-04-14T10:00:10.011831+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011831+0000","last_undegraded":"2024-04-14T10:00:10.011831+0000","last_fullsized":"2024-04-14T10:00:10.011831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650163+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650163+0000","last_peered":"2024-04-14T10:00:05.650163+0000","last_clean":"2024-04-14T10:00:05.650163+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650163+0000","last_undegraded":"2024-04-14T10:00:05.650163+0000","last_fullsized":"2024-04-14T10:00:05.650163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937990+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.937990+0000","last_peered":"2024-04-14T10:00:04.937990+0000","last_clean":"2024-04-14T10:00:04.937990+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.937990+0000","last_undegraded":"2024-04-14T10:00:04.937990+0000","last_fullsized":"2024-04-14T10:00:04.937990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939180+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939180+0000","last_peered":"2024-04-14T10:00:04.939180+0000","last_clean":"2024-04-14T10:00:04.939180+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939180+0000","last_undegraded":"2024-04-14T10:00:04.939180+0000","last_fullsized":"2024-04-14T10:00:04.939180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651519+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651519+0000","last_peered":"2024-04-14T10:00:05.651519+0000","last_clean":"2024-04-14T10:00:05.651519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651519+0000","last_undegraded":"2024-04-14T10:00:05.651519+0000","last_fullsized":"2024-04-14T10:00:05.651519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427763+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427763+0000","last_peered":"2024-04-14T10:00:05.427763+0000","last_clean":"2024-04-14T10:00:05.427763+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427763+0000","last_undegraded":"2024-04-14T10:00:05.427763+0000","last_fullsized":"2024-04-14T10:00:05.427763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427515+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427515+0000","last_peered":"2024-04-14T10:00:05.427515+0000","last_clean":"2024-04-14T10:00:05.427515+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427515+0000","last_undegraded":"2024-04-14T10:00:05.427515+0000","last_fullsized":"2024-04-14T10:00:05.427515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651342+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651342+0000","last_peered":"2024-04-14T10:00:05.651342+0000","last_clean":"2024-04-14T10:00:05.651342+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651342+0000","last_undegraded":"2024-04-14T10:00:05.651342+0000","last_fullsized":"2024-04-14T10:00:05.651342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651049+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651049+0000","last_peered":"2024-04-14T10:00:05.651049+0000","last_clean":"2024-04-14T10:00:05.651049+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651049+0000","last_undegraded":"2024-04-14T10:00:05.651049+0000","last_fullsized":"2024-04-14T10:00:05.651049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651599+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651599+0000","last_peered":"2024-04-14T10:00:05.651599+0000","last_clean":"2024-04-14T10:00:05.651599+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651599+0000","last_undegraded":"2024-04-14T10:00:05.651599+0000","last_fullsized":"2024-04-14T10:00:05.651599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071192+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071192+0000","last_peered":"2024-04-14T10:00:05.071192+0000","last_clean":"2024-04-14T10:00:05.071192+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071192+0000","last_undegraded":"2024-04-14T10:00:05.071192+0000","last_fullsized":"2024-04-14T10:00:05.071192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071347+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071347+0000","last_peered":"2024-04-14T10:00:05.071347+0000","last_clean":"2024-04-14T10:00:05.071347+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071347+0000","last_undegraded":"2024-04-14T10:00:05.071347+0000","last_fullsized":"2024-04-14T10:00:05.071347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650343+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650343+0000","last_peered":"2024-04-14T10:00:05.650343+0000","last_clean":"2024-04-14T10:00:05.650343+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650343+0000","last_undegraded":"2024-04-14T10:00:05.650343+0000","last_fullsized":"2024-04-14T10:00:05.650343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070210+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070210+0000","last_peered":"2024-04-14T10:00:05.070210+0000","last_clean":"2024-04-14T10:00:05.070210+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070210+0000","last_undegraded":"2024-04-14T10:00:05.070210+0000","last_fullsized":"2024-04-14T10:00:05.070210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071050+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071050+0000","last_peered":"2024-04-14T10:00:05.071050+0000","last_clean":"2024-04-14T10:00:05.071050+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071050+0000","last_undegraded":"2024-04-14T10:00:05.071050+0000","last_fullsized":"2024-04-14T10:00:05.071050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938921+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938921+0000","last_peered":"2024-04-14T10:00:04.938921+0000","last_clean":"2024-04-14T10:00:04.938921+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938921+0000","last_undegraded":"2024-04-14T10:00:04.938921+0000","last_fullsized":"2024-04-14T10:00:04.938921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070938+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070938+0000","last_peered":"2024-04-14T10:00:05.070938+0000","last_clean":"2024-04-14T10:00:05.070938+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070938+0000","last_undegraded":"2024-04-14T10:00:05.070938+0000","last_fullsized":"2024-04-14T10:00:05.070938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200970+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200970+0000","last_peered":"2024-04-14T10:00:08.200970+0000","last_clean":"2024-04-14T10:00:08.200970+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200970+0000","last_undegraded":"2024-04-14T10:00:08.200970+0000","last_fullsized":"2024-04-14T10:00:08.200970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936963+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.936963+0000","last_peered":"2024-04-14T10:00:04.936963+0000","last_clean":"2024-04-14T10:00:04.936963+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.936963+0000","last_undegraded":"2024-04-14T10:00:04.936963+0000","last_fullsized":"2024-04-14T10:00:04.936963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427631+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427631+0000","last_peered":"2024-04-14T10:00:05.427631+0000","last_clean":"2024-04-14T10:00:05.427631+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427631+0000","last_undegraded":"2024-04-14T10:00:05.427631+0000","last_fullsized":"2024-04-14T10:00:05.427631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070926+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.070926+0000","last_peered":"2024-04-14T10:00:05.070926+0000","last_clean":"2024-04-14T10:00:05.070926+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.070926+0000","last_undegraded":"2024-04-14T10:00:05.070926+0000","last_fullsized":"2024-04-14T10:00:05.070926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650250+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650250+0000","last_peered":"2024-04-14T10:00:05.650250+0000","last_clean":"2024-04-14T10:00:05.650250+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650250+0000","last_undegraded":"2024-04-14T10:00:05.650250+0000","last_fullsized":"2024-04-14T10:00:05.650250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651414+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651414+0000","last_peered":"2024-04-14T10:00:05.651414+0000","last_clean":"2024-04-14T10:00:05.651414+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651414+0000","last_undegraded":"2024-04-14T10:00:05.651414+0000","last_fullsized":"2024-04-14T10:00:05.651414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992247+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992247+0000","last_peered":"2024-04-14T10:00:07.992247+0000","last_clean":"2024-04-14T10:00:07.992247+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992247+0000","last_undegraded":"2024-04-14T10:00:07.992247+0000","last_fullsized":"2024-04-14T10:00:07.992247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071273+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071273+0000","last_peered":"2024-04-14T10:00:05.071273+0000","last_clean":"2024-04-14T10:00:05.071273+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071273+0000","last_undegraded":"2024-04-14T10:00:05.071273+0000","last_fullsized":"2024-04-14T10:00:05.071273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394004+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394004+0000","last_peered":"2024-04-14T10:00:07.394004+0000","last_clean":"2024-04-14T10:00:07.394004+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394004+0000","last_undegraded":"2024-04-14T10:00:07.394004+0000","last_fullsized":"2024-04-14T10:00:07.394004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939187+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939187+0000","last_peered":"2024-04-14T10:00:04.939187+0000","last_clean":"2024-04-14T10:00:04.939187+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939187+0000","last_undegraded":"2024-04-14T10:00:04.939187+0000","last_fullsized":"2024-04-14T10:00:04.939187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939207+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939207+0000","last_peered":"2024-04-14T10:00:04.939207+0000","last_clean":"2024-04-14T10:00:04.939207+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939207+0000","last_undegraded":"2024-04-14T10:00:04.939207+0000","last_fullsized":"2024-04-14T10:00:04.939207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939175+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939175+0000","last_peered":"2024-04-14T10:00:04.939175+0000","last_clean":"2024-04-14T10:00:04.939175+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939175+0000","last_undegraded":"2024-04-14T10:00:04.939175+0000","last_fullsized":"2024-04-14T10:00:04.939175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650090+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650090+0000","last_peered":"2024-04-14T10:00:05.650090+0000","last_clean":"2024-04-14T10:00:05.650090+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650090+0000","last_undegraded":"2024-04-14T10:00:05.650090+0000","last_fullsized":"2024-04-14T10:00:05.650090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937784+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937784+0000","last_peered":"2024-04-14T10:00:04.937784+0000","last_clean":"2024-04-14T10:00:04.937784+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937784+0000","last_undegraded":"2024-04-14T10:00:04.937784+0000","last_fullsized":"2024-04-14T10:00:04.937784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651591+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651591+0000","last_peered":"2024-04-14T10:00:05.651591+0000","last_clean":"2024-04-14T10:00:05.651591+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651591+0000","last_undegraded":"2024-04-14T10:00:05.651591+0000","last_fullsized":"2024-04-14T10:00:05.651591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650877+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650877+0000","last_peered":"2024-04-14T10:00:05.650877+0000","last_clean":"2024-04-14T10:00:05.650877+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650877+0000","last_undegraded":"2024-04-14T10:00:05.650877+0000","last_fullsized":"2024-04-14T10:00:05.650877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937149+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937149+0000","last_peered":"2024-04-14T10:00:04.937149+0000","last_clean":"2024-04-14T10:00:04.937149+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937149+0000","last_undegraded":"2024-04-14T10:00:04.937149+0000","last_fullsized":"2024-04-14T10:00:04.937149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427207+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427207+0000","last_peered":"2024-04-14T10:00:05.427207+0000","last_clean":"2024-04-14T10:00:05.427207+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427207+0000","last_undegraded":"2024-04-14T10:00:05.427207+0000","last_fullsized":"2024-04-14T10:00:05.427207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937371+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937371+0000","last_peered":"2024-04-14T10:00:04.937371+0000","last_clean":"2024-04-14T10:00:04.937371+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937371+0000","last_undegraded":"2024-04-14T10:00:04.937371+0000","last_fullsized":"2024-04-14T10:00:04.937371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936876+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936876+0000","last_peered":"2024-04-14T10:00:04.936876+0000","last_clean":"2024-04-14T10:00:04.936876+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936876+0000","last_undegraded":"2024-04-14T10:00:04.936876+0000","last_fullsized":"2024-04-14T10:00:04.936876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574885,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574885,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574883,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574883,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:00:56.997 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:00:56.998 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:01:16.999 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:01:17.113 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.114+0000 7fafde460640 1 Processor -- start 2024-04-14T10:01:17.114 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.114+0000 7fafde460640 1 -- start start 2024-04-14T10:01:17.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafde460640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 0x7fafd815b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafde460640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fafd80b22d0 0x7fafd815e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafde460640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd815bc50 con 0x7fafd815e2b0 2024-04-14T10:01:17.115 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafde460640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fafd815acc0 con 0x7fafd80b22d0 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafde460640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fafd815ed10 con 0x7fafd81584a0 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafdc9fd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fafd80b22d0 0x7fafd815e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd7fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 0x7fafd815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd77fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fafd815e2b0 0x7fafd80b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.40:58158/0 (socket says 172.21.15.40:58158) 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd77fe640 1 -- 172.21.15.40:0/2047852398 learned_addr learned my addr 172.21.15.40:0/2047852398 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd6ffd640 1 -- 172.21.15.40:0/2047852398 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657176059 0 0) 0x7fafd815bc50 con 0x7fafd815e2b0 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd7fff640 1 -- 172.21.15.40:0/2047852398 >> v2:172.21.15.136:3300/0 conn(0x7fafd80b22d0 msgr2=0x7fafd815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd7fff640 1 --2- 172.21.15.40:0/2047852398 >> v2:172.21.15.136:3300/0 conn(0x7fafd80b22d0 0x7fafd815e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.116 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd7fff640 1 -- 172.21.15.40:0/2047852398 >> v1:172.21.15.136:6789/0 conn(0x7fafd815e2b0 legacy=0x7fafd80b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.117 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.115+0000 7fafd7fff640 1 -- 172.21.15.40:0/2047852398 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd815eff0 con 0x7fafd81584a0 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.116+0000 7fafd7fff640 1 --2- 172.21.15.40:0/2047852398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 0x7fafd815b710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097a0 tx=0x7fafc002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a89813d28e24190 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.116+0000 7fafd6ffd640 1 -- 172.21.15.40:0/2047852398 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc00315a0 con 0x7fafd81584a0 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.116+0000 7fafd6ffd640 1 -- 172.21.15.40:0/2047852398 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc0037070 con 0x7fafd81584a0 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.116+0000 7fafd6ffd640 1 -- 172.21.15.40:0/2047852398 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031960 con 0x7fafd81584a0 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 -- 172.21.15.40:0/2047852398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 msgr2=0x7fafd815b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.120 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 --2- 172.21.15.40:0/2047852398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 0x7fafd815b710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fafc00097a0 tx=0x7fafc002b840 comp rx=0 tx=0).stop 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 -- 172.21.15.40:0/2047852398 shutdown_connections 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 --2- 172.21.15.40:0/2047852398 >> v2:172.21.15.136:3300/0 conn(0x7fafd80b22d0 0x7fafd815e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 --2- 172.21.15.40:0/2047852398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd81584a0 0x7fafd815b710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 -- 172.21.15.40:0/2047852398 >> 172.21.15.40:0/2047852398 conn(0x7fafd806ebf0 msgr2=0x7fafd806b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 -- 172.21.15.40:0/2047852398 shutdown_connections 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.117+0000 7fafde460640 1 -- 172.21.15.40:0/2047852398 wait complete. 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.118+0000 7fafde460640 1 Processor -- start 2024-04-14T10:01:17.121 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.118+0000 7fafde460640 1 -- start start 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 0x7fafd8145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd81584a0 0x7fafd8145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fafd80b4a80 con 0x7fafd815e2b0 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fafd815b1f0 con 0x7fafd81584a0 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafde460640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fafd8145aa0 con 0x7fafd80b22d0 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafdc9fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.122 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafdc9fd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:55460/0 (socket says 172.21.15.40:55460) 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafdc9fd640 1 -- 172.21.15.40:0/1475327439 learned_addr learned my addr 172.21.15.40:0/1475327439 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 0x7fafd8145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.119+0000 7fafd77fe640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd81584a0 0x7fafd8145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 -- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 msgr2=0x7fafd8145e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 0x7fafd8145e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 -- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd81584a0 msgr2=0x7fafd8145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd81584a0 0x7fafd8145560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 -- 172.21.15.40:0/1475327439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd814f790 con 0x7fafd815e2b0 2024-04-14T10:01:17.123 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 0x7fafd8145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafdc9fd640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafd000efc0 tx=0x7fafd000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0018020 con 0x7fafd815e2b0 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafd0014480 con 0x7fafd815e2b0 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0014870 con 0x7fafd815e2b0 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd8146530 con 0x7fafd815e2b0 2024-04-14T10:01:17.124 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.120+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd8144d60 con 0x7fafd815e2b0 2024-04-14T10:01:17.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.121+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd81448b0 con 0x7fafd815e2b0 2024-04-14T10:01:17.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.122+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafd0005d10 con 0x7fafd815e2b0 2024-04-14T10:01:17.125 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.122+0000 7fafd4ff9640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 0x7fafb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:17.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.122+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fafd008c9b0 con 0x7fafd815e2b0 2024-04-14T10:01:17.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.122+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 0x7fafb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:17.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.123+0000 7fafd7fff640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 0x7fafb806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fafc0036000 tx=0x7fafc0008030 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:17.126 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.127+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fafd0022030 con 0x7fafd815e2b0 2024-04-14T10:01:17.308 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.309+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafd80756f0 con 0x7fafb806c8f0 2024-04-14T10:01:17.315 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.315+0000 7fafd4ff9640 1 -- 172.21.15.40:0/1475327439 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7fafd80756f0 con 0x7fafb806c8f0 2024-04-14T10:01:17.317 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:01:17.319 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:01:17.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 msgr2=0x7fafb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 0x7fafb806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fafc0036000 tx=0x7fafc0008030 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 msgr2=0x7fafd815cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fafd000efc0 tx=0x7fafd000c490 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 shutdown_connections 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fafb806c8f0 0x7fafb806edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fafd815e2b0 0x7fafd815cc20 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fafd81584a0 0x7fafd8145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 --2- 172.21.15.40:0/1475327439 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fafd80b22d0 0x7fafd8145e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:17.321 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 >> 172.21.15.40:0/1475327439 conn(0x7fafd806ebf0 msgr2=0x7fafd814fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 shutdown_connections 2024-04-14T10:01:17.322 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:17.318+0000 7fafde460640 1 -- 172.21.15.40:0/1475327439 wait complete. 2024-04-14T10:01:17.328 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":128,"stamp":"2024-04-14T10:01:16.840349+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001994"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427720+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427720+0000","last_peered":"2024-04-14T10:00:05.427720+0000","last_clean":"2024-04-14T10:00:05.427720+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427720+0000","last_undegraded":"2024-04-14T10:00:05.427720+0000","last_fullsized":"2024-04-14T10:00:05.427720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428742+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428742+0000","last_peered":"2024-04-14T10:00:06.428742+0000","last_clean":"2024-04-14T10:00:06.428742+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428742+0000","last_undegraded":"2024-04-14T10:00:06.428742+0000","last_fullsized":"2024-04-14T10:00:06.428742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939148+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939148+0000","last_peered":"2024-04-14T10:00:04.939148+0000","last_clean":"2024-04-14T10:00:04.939148+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939148+0000","last_undegraded":"2024-04-14T10:00:04.939148+0000","last_fullsized":"2024-04-14T10:00:04.939148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071145+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071145+0000","last_peered":"2024-04-14T10:00:05.071145+0000","last_clean":"2024-04-14T10:00:05.071145+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071145+0000","last_undegraded":"2024-04-14T10:00:05.071145+0000","last_fullsized":"2024-04-14T10:00:05.071145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937828+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937828+0000","last_peered":"2024-04-14T10:00:04.937828+0000","last_clean":"2024-04-14T10:00:04.937828+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937828+0000","last_undegraded":"2024-04-14T10:00:04.937828+0000","last_fullsized":"2024-04-14T10:00:04.937828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651006+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651006+0000","last_peered":"2024-04-14T10:00:05.651006+0000","last_clean":"2024-04-14T10:00:05.651006+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651006+0000","last_undegraded":"2024-04-14T10:00:05.651006+0000","last_fullsized":"2024-04-14T10:00:05.651006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651731+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651731+0000","last_peered":"2024-04-14T10:00:05.651731+0000","last_clean":"2024-04-14T10:00:05.651731+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651731+0000","last_undegraded":"2024-04-14T10:00:05.651731+0000","last_fullsized":"2024-04-14T10:00:05.651731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042369+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042369+0000","last_peered":"2024-04-14T10:00:09.042369+0000","last_clean":"2024-04-14T10:00:09.042369+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042369+0000","last_undegraded":"2024-04-14T10:00:09.042369+0000","last_fullsized":"2024-04-14T10:00:09.042369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070925+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070925+0000","last_peered":"2024-04-14T10:00:05.070925+0000","last_clean":"2024-04-14T10:00:05.070925+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070925+0000","last_undegraded":"2024-04-14T10:00:05.070925+0000","last_fullsized":"2024-04-14T10:00:05.070925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937981+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.937981+0000","last_peered":"2024-04-14T10:00:04.937981+0000","last_clean":"2024-04-14T10:00:04.937981+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.937981+0000","last_undegraded":"2024-04-14T10:00:04.937981+0000","last_fullsized":"2024-04-14T10:00:04.937981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650493+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650493+0000","last_peered":"2024-04-14T10:00:05.650493+0000","last_clean":"2024-04-14T10:00:05.650493+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650493+0000","last_undegraded":"2024-04-14T10:00:05.650493+0000","last_fullsized":"2024-04-14T10:00:05.650493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937857+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937857+0000","last_peered":"2024-04-14T10:00:04.937857+0000","last_clean":"2024-04-14T10:00:04.937857+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937857+0000","last_undegraded":"2024-04-14T10:00:04.937857+0000","last_fullsized":"2024-04-14T10:00:04.937857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236614+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236614+0000","last_peered":"2024-04-14T10:00:06.236614+0000","last_clean":"2024-04-14T10:00:06.236614+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236614+0000","last_undegraded":"2024-04-14T10:00:06.236614+0000","last_fullsized":"2024-04-14T10:00:06.236614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937552+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937552+0000","last_peered":"2024-04-14T10:00:04.937552+0000","last_clean":"2024-04-14T10:00:04.937552+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937552+0000","last_undegraded":"2024-04-14T10:00:04.937552+0000","last_fullsized":"2024-04-14T10:00:04.937552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937929+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937929+0000","last_peered":"2024-04-14T10:00:04.937929+0000","last_clean":"2024-04-14T10:00:04.937929+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937929+0000","last_undegraded":"2024-04-14T10:00:04.937929+0000","last_fullsized":"2024-04-14T10:00:04.937929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011831+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011831+0000","last_peered":"2024-04-14T10:00:10.011831+0000","last_clean":"2024-04-14T10:00:10.011831+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011831+0000","last_undegraded":"2024-04-14T10:00:10.011831+0000","last_fullsized":"2024-04-14T10:00:10.011831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650163+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650163+0000","last_peered":"2024-04-14T10:00:05.650163+0000","last_clean":"2024-04-14T10:00:05.650163+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650163+0000","last_undegraded":"2024-04-14T10:00:05.650163+0000","last_fullsized":"2024-04-14T10:00:05.650163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937990+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.937990+0000","last_peered":"2024-04-14T10:00:04.937990+0000","last_clean":"2024-04-14T10:00:04.937990+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.937990+0000","last_undegraded":"2024-04-14T10:00:04.937990+0000","last_fullsized":"2024-04-14T10:00:04.937990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939180+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939180+0000","last_peered":"2024-04-14T10:00:04.939180+0000","last_clean":"2024-04-14T10:00:04.939180+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939180+0000","last_undegraded":"2024-04-14T10:00:04.939180+0000","last_fullsized":"2024-04-14T10:00:04.939180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651519+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651519+0000","last_peered":"2024-04-14T10:00:05.651519+0000","last_clean":"2024-04-14T10:00:05.651519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651519+0000","last_undegraded":"2024-04-14T10:00:05.651519+0000","last_fullsized":"2024-04-14T10:00:05.651519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427763+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427763+0000","last_peered":"2024-04-14T10:00:05.427763+0000","last_clean":"2024-04-14T10:00:05.427763+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427763+0000","last_undegraded":"2024-04-14T10:00:05.427763+0000","last_fullsized":"2024-04-14T10:00:05.427763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427515+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427515+0000","last_peered":"2024-04-14T10:00:05.427515+0000","last_clean":"2024-04-14T10:00:05.427515+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427515+0000","last_undegraded":"2024-04-14T10:00:05.427515+0000","last_fullsized":"2024-04-14T10:00:05.427515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651342+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651342+0000","last_peered":"2024-04-14T10:00:05.651342+0000","last_clean":"2024-04-14T10:00:05.651342+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651342+0000","last_undegraded":"2024-04-14T10:00:05.651342+0000","last_fullsized":"2024-04-14T10:00:05.651342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651049+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651049+0000","last_peered":"2024-04-14T10:00:05.651049+0000","last_clean":"2024-04-14T10:00:05.651049+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651049+0000","last_undegraded":"2024-04-14T10:00:05.651049+0000","last_fullsized":"2024-04-14T10:00:05.651049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651599+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651599+0000","last_peered":"2024-04-14T10:00:05.651599+0000","last_clean":"2024-04-14T10:00:05.651599+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651599+0000","last_undegraded":"2024-04-14T10:00:05.651599+0000","last_fullsized":"2024-04-14T10:00:05.651599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071192+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071192+0000","last_peered":"2024-04-14T10:00:05.071192+0000","last_clean":"2024-04-14T10:00:05.071192+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071192+0000","last_undegraded":"2024-04-14T10:00:05.071192+0000","last_fullsized":"2024-04-14T10:00:05.071192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071347+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071347+0000","last_peered":"2024-04-14T10:00:05.071347+0000","last_clean":"2024-04-14T10:00:05.071347+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071347+0000","last_undegraded":"2024-04-14T10:00:05.071347+0000","last_fullsized":"2024-04-14T10:00:05.071347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650343+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650343+0000","last_peered":"2024-04-14T10:00:05.650343+0000","last_clean":"2024-04-14T10:00:05.650343+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650343+0000","last_undegraded":"2024-04-14T10:00:05.650343+0000","last_fullsized":"2024-04-14T10:00:05.650343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070210+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070210+0000","last_peered":"2024-04-14T10:00:05.070210+0000","last_clean":"2024-04-14T10:00:05.070210+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070210+0000","last_undegraded":"2024-04-14T10:00:05.070210+0000","last_fullsized":"2024-04-14T10:00:05.070210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071050+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071050+0000","last_peered":"2024-04-14T10:00:05.071050+0000","last_clean":"2024-04-14T10:00:05.071050+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071050+0000","last_undegraded":"2024-04-14T10:00:05.071050+0000","last_fullsized":"2024-04-14T10:00:05.071050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938921+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938921+0000","last_peered":"2024-04-14T10:00:04.938921+0000","last_clean":"2024-04-14T10:00:04.938921+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938921+0000","last_undegraded":"2024-04-14T10:00:04.938921+0000","last_fullsized":"2024-04-14T10:00:04.938921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070938+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070938+0000","last_peered":"2024-04-14T10:00:05.070938+0000","last_clean":"2024-04-14T10:00:05.070938+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070938+0000","last_undegraded":"2024-04-14T10:00:05.070938+0000","last_fullsized":"2024-04-14T10:00:05.070938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200970+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200970+0000","last_peered":"2024-04-14T10:00:08.200970+0000","last_clean":"2024-04-14T10:00:08.200970+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200970+0000","last_undegraded":"2024-04-14T10:00:08.200970+0000","last_fullsized":"2024-04-14T10:00:08.200970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936963+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.936963+0000","last_peered":"2024-04-14T10:00:04.936963+0000","last_clean":"2024-04-14T10:00:04.936963+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.936963+0000","last_undegraded":"2024-04-14T10:00:04.936963+0000","last_fullsized":"2024-04-14T10:00:04.936963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427631+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427631+0000","last_peered":"2024-04-14T10:00:05.427631+0000","last_clean":"2024-04-14T10:00:05.427631+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427631+0000","last_undegraded":"2024-04-14T10:00:05.427631+0000","last_fullsized":"2024-04-14T10:00:05.427631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070926+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.070926+0000","last_peered":"2024-04-14T10:00:05.070926+0000","last_clean":"2024-04-14T10:00:05.070926+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.070926+0000","last_undegraded":"2024-04-14T10:00:05.070926+0000","last_fullsized":"2024-04-14T10:00:05.070926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650250+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650250+0000","last_peered":"2024-04-14T10:00:05.650250+0000","last_clean":"2024-04-14T10:00:05.650250+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650250+0000","last_undegraded":"2024-04-14T10:00:05.650250+0000","last_fullsized":"2024-04-14T10:00:05.650250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651414+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651414+0000","last_peered":"2024-04-14T10:00:05.651414+0000","last_clean":"2024-04-14T10:00:05.651414+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651414+0000","last_undegraded":"2024-04-14T10:00:05.651414+0000","last_fullsized":"2024-04-14T10:00:05.651414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992247+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992247+0000","last_peered":"2024-04-14T10:00:07.992247+0000","last_clean":"2024-04-14T10:00:07.992247+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992247+0000","last_undegraded":"2024-04-14T10:00:07.992247+0000","last_fullsized":"2024-04-14T10:00:07.992247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071273+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071273+0000","last_peered":"2024-04-14T10:00:05.071273+0000","last_clean":"2024-04-14T10:00:05.071273+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071273+0000","last_undegraded":"2024-04-14T10:00:05.071273+0000","last_fullsized":"2024-04-14T10:00:05.071273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394004+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394004+0000","last_peered":"2024-04-14T10:00:07.394004+0000","last_clean":"2024-04-14T10:00:07.394004+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394004+0000","last_undegraded":"2024-04-14T10:00:07.394004+0000","last_fullsized":"2024-04-14T10:00:07.394004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939187+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939187+0000","last_peered":"2024-04-14T10:00:04.939187+0000","last_clean":"2024-04-14T10:00:04.939187+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939187+0000","last_undegraded":"2024-04-14T10:00:04.939187+0000","last_fullsized":"2024-04-14T10:00:04.939187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939207+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939207+0000","last_peered":"2024-04-14T10:00:04.939207+0000","last_clean":"2024-04-14T10:00:04.939207+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939207+0000","last_undegraded":"2024-04-14T10:00:04.939207+0000","last_fullsized":"2024-04-14T10:00:04.939207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939175+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939175+0000","last_peered":"2024-04-14T10:00:04.939175+0000","last_clean":"2024-04-14T10:00:04.939175+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939175+0000","last_undegraded":"2024-04-14T10:00:04.939175+0000","last_fullsized":"2024-04-14T10:00:04.939175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650090+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650090+0000","last_peered":"2024-04-14T10:00:05.650090+0000","last_clean":"2024-04-14T10:00:05.650090+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650090+0000","last_undegraded":"2024-04-14T10:00:05.650090+0000","last_fullsized":"2024-04-14T10:00:05.650090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937784+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937784+0000","last_peered":"2024-04-14T10:00:04.937784+0000","last_clean":"2024-04-14T10:00:04.937784+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937784+0000","last_undegraded":"2024-04-14T10:00:04.937784+0000","last_fullsized":"2024-04-14T10:00:04.937784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651591+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651591+0000","last_peered":"2024-04-14T10:00:05.651591+0000","last_clean":"2024-04-14T10:00:05.651591+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651591+0000","last_undegraded":"2024-04-14T10:00:05.651591+0000","last_fullsized":"2024-04-14T10:00:05.651591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650877+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650877+0000","last_peered":"2024-04-14T10:00:05.650877+0000","last_clean":"2024-04-14T10:00:05.650877+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650877+0000","last_undegraded":"2024-04-14T10:00:05.650877+0000","last_fullsized":"2024-04-14T10:00:05.650877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937149+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937149+0000","last_peered":"2024-04-14T10:00:04.937149+0000","last_clean":"2024-04-14T10:00:04.937149+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937149+0000","last_undegraded":"2024-04-14T10:00:04.937149+0000","last_fullsized":"2024-04-14T10:00:04.937149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427207+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427207+0000","last_peered":"2024-04-14T10:00:05.427207+0000","last_clean":"2024-04-14T10:00:05.427207+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427207+0000","last_undegraded":"2024-04-14T10:00:05.427207+0000","last_fullsized":"2024-04-14T10:00:05.427207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937371+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937371+0000","last_peered":"2024-04-14T10:00:04.937371+0000","last_clean":"2024-04-14T10:00:04.937371+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937371+0000","last_undegraded":"2024-04-14T10:00:04.937371+0000","last_fullsized":"2024-04-14T10:00:04.937371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936876+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936876+0000","last_peered":"2024-04-14T10:00:04.936876+0000","last_clean":"2024-04-14T10:00:04.936876+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936876+0000","last_undegraded":"2024-04-14T10:00:04.936876+0000","last_fullsized":"2024-04-14T10:00:04.936876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:01:17.335 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:01:17.335 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:01:22.918 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:01:22.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:01:37.337 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:01:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.452+0000 7f84d38de640 1 Processor -- start 2024-04-14T10:01:37.453 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.452+0000 7f84d38de640 1 -- start start 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f84cc09aa40 0x7f84cc0cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84cc0b45b0 0x7f84cc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc09ae20 0x7f84cc070700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f84cc0b4a40 con 0x7f84cc0b45b0 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f84cc070270 con 0x7f84cc09aa40 2024-04-14T10:01:37.455 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d38de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc0af1d0 con 0x7f84cc09ae20 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d0e79640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84cc0b45b0 0x7f84cc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d0e79640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f84cc0b45b0 0x7f84cc0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46004/0 (socket says 172.21.15.40:46004) 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d0e79640 1 -- 172.21.15.40:0/1552424854 learned_addr learned my addr 172.21.15.40:0/1552424854 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d167a640 1 --2- 172.21.15.40:0/1552424854 >> v2:172.21.15.136:3300/0 conn(0x7f84cc09aa40 0x7f84cc0cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.453+0000 7f84d1e7b640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc09ae20 0x7f84cc070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 -- 172.21.15.40:0/1552424854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc09ae20 msgr2=0x7f84cc070700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:01:37.456 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc09ae20 0x7f84cc070700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 -- 172.21.15.40:0/1552424854 >> v2:172.21.15.136:3300/0 conn(0x7f84cc09aa40 msgr2=0x7f84cc0cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 --2- 172.21.15.40:0/1552424854 >> v2:172.21.15.136:3300/0 conn(0x7f84cc09aa40 0x7f84cc0cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 -- 172.21.15.40:0/1552424854 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc06f6a0 con 0x7f84cc0b45b0 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.454+0000 7f84d0e79640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc0b45b0 0x7f84cc0aec90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f84cc073ac0 tx=0x7f84bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5121d84d457988b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84c3fff640 1 -- 172.21.15.40:0/1552424854 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc035020 con 0x7f84cc0b45b0 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84c3fff640 1 -- 172.21.15.40:0/1552424854 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc031870 con 0x7f84cc0b45b0 2024-04-14T10:01:37.457 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84c3fff640 1 -- 172.21.15.40:0/1552424854 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc031c40 con 0x7f84cc0b45b0 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 -- 172.21.15.40:0/1552424854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc0b45b0 msgr2=0x7f84cc0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc0b45b0 0x7f84cc0aec90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f84cc073ac0 tx=0x7f84bc02b910 comp rx=0 tx=0).stop 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 -- 172.21.15.40:0/1552424854 shutdown_connections 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc09ae20 0x7f84cc070700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 --2- 172.21.15.40:0/1552424854 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc0b45b0 0x7f84cc0aec90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.461 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 --2- 172.21.15.40:0/1552424854 >> v2:172.21.15.136:3300/0 conn(0x7f84cc09aa40 0x7f84cc0cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 -- 172.21.15.40:0/1552424854 >> 172.21.15.40:0/1552424854 conn(0x7f84cc0b3a90 msgr2=0x7f84cc0b3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 -- 172.21.15.40:0/1552424854 shutdown_connections 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.455+0000 7f84d38de640 1 -- 172.21.15.40:0/1552424854 wait complete. 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 Processor -- start 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 -- start start 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84cc09aa40 0x7f84cc0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.462 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc0b45b0 0x7f84cc0cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc06ff00 con 0x7f84cc09ae20 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f84cc06fc20 con 0x7f84cc09aa40 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.457+0000 7f84d38de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f84cc09b2b0 con 0x7f84cc0b45b0 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:46010/0 (socket says 172.21.15.40:46010) 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 -- 172.21.15.40:0/3079908596 learned_addr learned my addr 172.21.15.40:0/3079908596 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d1e7b640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc0b45b0 0x7f84cc0cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d167a640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84cc09aa40 0x7f84cc0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 -- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc0b45b0 msgr2=0x7f84cc0cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc0b45b0 0x7f84cc0cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 -- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84cc09aa40 msgr2=0x7f84cc0c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84cc09aa40 0x7f84cc0c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 -- 172.21.15.40:0/3079908596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84cc0ca7b0 con 0x7f84cc09ae20 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d0e79640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02b950 tx=0x7f84bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:37.464 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc040070 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84bc031e10 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84bc035040 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.458+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84cc153a20 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.459+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84cc0b4f20 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.460+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84cc0756f0 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.460+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f84bc04b060 con 0x7f84cc09ae20 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.461+0000 7f84c1ffb640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:37.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.461+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f84bc0ad7b0 con 0x7f84cc09ae20 2024-04-14T10:01:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.461+0000 7f84d167a640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.461+0000 7f84d167a640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 0x7f84b006ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84c4011340 tx=0x7f84c400b040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:37.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.465+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f84cc153a20 con 0x7f84cc09ae20 2024-04-14T10:01:37.649 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.649+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84cc0d0360 con 0x7f84b006c920 2024-04-14T10:01:37.656 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.655+0000 7f84c1ffb640 1 -- 172.21.15.40:0/3079908596 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f84cc0d0360 con 0x7f84b006c920 2024-04-14T10:01:37.659 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:01:37.660 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.658+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 msgr2=0x7f84b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.658+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 0x7f84b006ede0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f84c4011340 tx=0x7f84c400b040 comp rx=0 tx=0).stop 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.658+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 msgr2=0x7f84cc153000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.658+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f84bc02b950 tx=0x7f84bc0046c0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 shutdown_connections 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f84b006c920 0x7f84b006ede0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.662 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84cc0b45b0 0x7f84cc0cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f84cc09ae20 0x7f84cc153000 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 --2- 172.21.15.40:0/3079908596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84cc09aa40 0x7f84cc0c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 >> 172.21.15.40:0/3079908596 conn(0x7f84cc0b3a90 msgr2=0x7f84cc070700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 shutdown_connections 2024-04-14T10:01:37.663 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:37.659+0000 7f84d38de640 1 -- 172.21.15.40:0/3079908596 wait complete. 2024-04-14T10:01:37.670 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":138,"stamp":"2024-04-14T10:01:36.843888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002185"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427720+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427720+0000","last_peered":"2024-04-14T10:00:05.427720+0000","last_clean":"2024-04-14T10:00:05.427720+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427720+0000","last_undegraded":"2024-04-14T10:00:05.427720+0000","last_fullsized":"2024-04-14T10:00:05.427720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428742+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428742+0000","last_peered":"2024-04-14T10:00:06.428742+0000","last_clean":"2024-04-14T10:00:06.428742+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428742+0000","last_undegraded":"2024-04-14T10:00:06.428742+0000","last_fullsized":"2024-04-14T10:00:06.428742+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939148+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939148+0000","last_peered":"2024-04-14T10:00:04.939148+0000","last_clean":"2024-04-14T10:00:04.939148+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939148+0000","last_undegraded":"2024-04-14T10:00:04.939148+0000","last_fullsized":"2024-04-14T10:00:04.939148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071145+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071145+0000","last_peered":"2024-04-14T10:00:05.071145+0000","last_clean":"2024-04-14T10:00:05.071145+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071145+0000","last_undegraded":"2024-04-14T10:00:05.071145+0000","last_fullsized":"2024-04-14T10:00:05.071145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937828+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937828+0000","last_peered":"2024-04-14T10:00:04.937828+0000","last_clean":"2024-04-14T10:00:04.937828+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937828+0000","last_undegraded":"2024-04-14T10:00:04.937828+0000","last_fullsized":"2024-04-14T10:00:04.937828+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651006+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651006+0000","last_peered":"2024-04-14T10:00:05.651006+0000","last_clean":"2024-04-14T10:00:05.651006+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651006+0000","last_undegraded":"2024-04-14T10:00:05.651006+0000","last_fullsized":"2024-04-14T10:00:05.651006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651731+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651731+0000","last_peered":"2024-04-14T10:00:05.651731+0000","last_clean":"2024-04-14T10:00:05.651731+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651731+0000","last_undegraded":"2024-04-14T10:00:05.651731+0000","last_fullsized":"2024-04-14T10:00:05.651731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042369+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042369+0000","last_peered":"2024-04-14T10:00:09.042369+0000","last_clean":"2024-04-14T10:00:09.042369+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042369+0000","last_undegraded":"2024-04-14T10:00:09.042369+0000","last_fullsized":"2024-04-14T10:00:09.042369+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070925+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070925+0000","last_peered":"2024-04-14T10:00:05.070925+0000","last_clean":"2024-04-14T10:00:05.070925+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070925+0000","last_undegraded":"2024-04-14T10:00:05.070925+0000","last_fullsized":"2024-04-14T10:00:05.070925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937981+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.937981+0000","last_peered":"2024-04-14T10:00:04.937981+0000","last_clean":"2024-04-14T10:00:04.937981+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.937981+0000","last_undegraded":"2024-04-14T10:00:04.937981+0000","last_fullsized":"2024-04-14T10:00:04.937981+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650493+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650493+0000","last_peered":"2024-04-14T10:00:05.650493+0000","last_clean":"2024-04-14T10:00:05.650493+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650493+0000","last_undegraded":"2024-04-14T10:00:05.650493+0000","last_fullsized":"2024-04-14T10:00:05.650493+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937857+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937857+0000","last_peered":"2024-04-14T10:00:04.937857+0000","last_clean":"2024-04-14T10:00:04.937857+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937857+0000","last_undegraded":"2024-04-14T10:00:04.937857+0000","last_fullsized":"2024-04-14T10:00:04.937857+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236614+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236614+0000","last_peered":"2024-04-14T10:00:06.236614+0000","last_clean":"2024-04-14T10:00:06.236614+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236614+0000","last_undegraded":"2024-04-14T10:00:06.236614+0000","last_fullsized":"2024-04-14T10:00:06.236614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937552+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937552+0000","last_peered":"2024-04-14T10:00:04.937552+0000","last_clean":"2024-04-14T10:00:04.937552+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937552+0000","last_undegraded":"2024-04-14T10:00:04.937552+0000","last_fullsized":"2024-04-14T10:00:04.937552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937929+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937929+0000","last_peered":"2024-04-14T10:00:04.937929+0000","last_clean":"2024-04-14T10:00:04.937929+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937929+0000","last_undegraded":"2024-04-14T10:00:04.937929+0000","last_fullsized":"2024-04-14T10:00:04.937929+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011831+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011831+0000","last_peered":"2024-04-14T10:00:10.011831+0000","last_clean":"2024-04-14T10:00:10.011831+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011831+0000","last_undegraded":"2024-04-14T10:00:10.011831+0000","last_fullsized":"2024-04-14T10:00:10.011831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650163+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650163+0000","last_peered":"2024-04-14T10:00:05.650163+0000","last_clean":"2024-04-14T10:00:05.650163+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650163+0000","last_undegraded":"2024-04-14T10:00:05.650163+0000","last_fullsized":"2024-04-14T10:00:05.650163+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937990+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.937990+0000","last_peered":"2024-04-14T10:00:04.937990+0000","last_clean":"2024-04-14T10:00:04.937990+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.937990+0000","last_undegraded":"2024-04-14T10:00:04.937990+0000","last_fullsized":"2024-04-14T10:00:04.937990+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939180+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939180+0000","last_peered":"2024-04-14T10:00:04.939180+0000","last_clean":"2024-04-14T10:00:04.939180+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939180+0000","last_undegraded":"2024-04-14T10:00:04.939180+0000","last_fullsized":"2024-04-14T10:00:04.939180+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651519+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651519+0000","last_peered":"2024-04-14T10:00:05.651519+0000","last_clean":"2024-04-14T10:00:05.651519+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651519+0000","last_undegraded":"2024-04-14T10:00:05.651519+0000","last_fullsized":"2024-04-14T10:00:05.651519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427763+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427763+0000","last_peered":"2024-04-14T10:00:05.427763+0000","last_clean":"2024-04-14T10:00:05.427763+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427763+0000","last_undegraded":"2024-04-14T10:00:05.427763+0000","last_fullsized":"2024-04-14T10:00:05.427763+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427515+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427515+0000","last_peered":"2024-04-14T10:00:05.427515+0000","last_clean":"2024-04-14T10:00:05.427515+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427515+0000","last_undegraded":"2024-04-14T10:00:05.427515+0000","last_fullsized":"2024-04-14T10:00:05.427515+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651342+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651342+0000","last_peered":"2024-04-14T10:00:05.651342+0000","last_clean":"2024-04-14T10:00:05.651342+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651342+0000","last_undegraded":"2024-04-14T10:00:05.651342+0000","last_fullsized":"2024-04-14T10:00:05.651342+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651049+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651049+0000","last_peered":"2024-04-14T10:00:05.651049+0000","last_clean":"2024-04-14T10:00:05.651049+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651049+0000","last_undegraded":"2024-04-14T10:00:05.651049+0000","last_fullsized":"2024-04-14T10:00:05.651049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651599+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651599+0000","last_peered":"2024-04-14T10:00:05.651599+0000","last_clean":"2024-04-14T10:00:05.651599+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651599+0000","last_undegraded":"2024-04-14T10:00:05.651599+0000","last_fullsized":"2024-04-14T10:00:05.651599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071192+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071192+0000","last_peered":"2024-04-14T10:00:05.071192+0000","last_clean":"2024-04-14T10:00:05.071192+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071192+0000","last_undegraded":"2024-04-14T10:00:05.071192+0000","last_fullsized":"2024-04-14T10:00:05.071192+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071347+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071347+0000","last_peered":"2024-04-14T10:00:05.071347+0000","last_clean":"2024-04-14T10:00:05.071347+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071347+0000","last_undegraded":"2024-04-14T10:00:05.071347+0000","last_fullsized":"2024-04-14T10:00:05.071347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650343+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650343+0000","last_peered":"2024-04-14T10:00:05.650343+0000","last_clean":"2024-04-14T10:00:05.650343+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650343+0000","last_undegraded":"2024-04-14T10:00:05.650343+0000","last_fullsized":"2024-04-14T10:00:05.650343+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070210+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070210+0000","last_peered":"2024-04-14T10:00:05.070210+0000","last_clean":"2024-04-14T10:00:05.070210+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070210+0000","last_undegraded":"2024-04-14T10:00:05.070210+0000","last_fullsized":"2024-04-14T10:00:05.070210+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071050+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071050+0000","last_peered":"2024-04-14T10:00:05.071050+0000","last_clean":"2024-04-14T10:00:05.071050+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071050+0000","last_undegraded":"2024-04-14T10:00:05.071050+0000","last_fullsized":"2024-04-14T10:00:05.071050+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938921+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938921+0000","last_peered":"2024-04-14T10:00:04.938921+0000","last_clean":"2024-04-14T10:00:04.938921+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938921+0000","last_undegraded":"2024-04-14T10:00:04.938921+0000","last_fullsized":"2024-04-14T10:00:04.938921+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070938+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070938+0000","last_peered":"2024-04-14T10:00:05.070938+0000","last_clean":"2024-04-14T10:00:05.070938+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070938+0000","last_undegraded":"2024-04-14T10:00:05.070938+0000","last_fullsized":"2024-04-14T10:00:05.070938+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200970+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200970+0000","last_peered":"2024-04-14T10:00:08.200970+0000","last_clean":"2024-04-14T10:00:08.200970+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200970+0000","last_undegraded":"2024-04-14T10:00:08.200970+0000","last_fullsized":"2024-04-14T10:00:08.200970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936963+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.936963+0000","last_peered":"2024-04-14T10:00:04.936963+0000","last_clean":"2024-04-14T10:00:04.936963+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.936963+0000","last_undegraded":"2024-04-14T10:00:04.936963+0000","last_fullsized":"2024-04-14T10:00:04.936963+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427631+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427631+0000","last_peered":"2024-04-14T10:00:05.427631+0000","last_clean":"2024-04-14T10:00:05.427631+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427631+0000","last_undegraded":"2024-04-14T10:00:05.427631+0000","last_fullsized":"2024-04-14T10:00:05.427631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070926+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.070926+0000","last_peered":"2024-04-14T10:00:05.070926+0000","last_clean":"2024-04-14T10:00:05.070926+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.070926+0000","last_undegraded":"2024-04-14T10:00:05.070926+0000","last_fullsized":"2024-04-14T10:00:05.070926+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650250+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650250+0000","last_peered":"2024-04-14T10:00:05.650250+0000","last_clean":"2024-04-14T10:00:05.650250+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650250+0000","last_undegraded":"2024-04-14T10:00:05.650250+0000","last_fullsized":"2024-04-14T10:00:05.650250+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651414+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651414+0000","last_peered":"2024-04-14T10:00:05.651414+0000","last_clean":"2024-04-14T10:00:05.651414+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651414+0000","last_undegraded":"2024-04-14T10:00:05.651414+0000","last_fullsized":"2024-04-14T10:00:05.651414+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992247+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992247+0000","last_peered":"2024-04-14T10:00:07.992247+0000","last_clean":"2024-04-14T10:00:07.992247+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992247+0000","last_undegraded":"2024-04-14T10:00:07.992247+0000","last_fullsized":"2024-04-14T10:00:07.992247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071273+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071273+0000","last_peered":"2024-04-14T10:00:05.071273+0000","last_clean":"2024-04-14T10:00:05.071273+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071273+0000","last_undegraded":"2024-04-14T10:00:05.071273+0000","last_fullsized":"2024-04-14T10:00:05.071273+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394004+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394004+0000","last_peered":"2024-04-14T10:00:07.394004+0000","last_clean":"2024-04-14T10:00:07.394004+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394004+0000","last_undegraded":"2024-04-14T10:00:07.394004+0000","last_fullsized":"2024-04-14T10:00:07.394004+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939187+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939187+0000","last_peered":"2024-04-14T10:00:04.939187+0000","last_clean":"2024-04-14T10:00:04.939187+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939187+0000","last_undegraded":"2024-04-14T10:00:04.939187+0000","last_fullsized":"2024-04-14T10:00:04.939187+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939207+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939207+0000","last_peered":"2024-04-14T10:00:04.939207+0000","last_clean":"2024-04-14T10:00:04.939207+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939207+0000","last_undegraded":"2024-04-14T10:00:04.939207+0000","last_fullsized":"2024-04-14T10:00:04.939207+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939175+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939175+0000","last_peered":"2024-04-14T10:00:04.939175+0000","last_clean":"2024-04-14T10:00:04.939175+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939175+0000","last_undegraded":"2024-04-14T10:00:04.939175+0000","last_fullsized":"2024-04-14T10:00:04.939175+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650090+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650090+0000","last_peered":"2024-04-14T10:00:05.650090+0000","last_clean":"2024-04-14T10:00:05.650090+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650090+0000","last_undegraded":"2024-04-14T10:00:05.650090+0000","last_fullsized":"2024-04-14T10:00:05.650090+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937784+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937784+0000","last_peered":"2024-04-14T10:00:04.937784+0000","last_clean":"2024-04-14T10:00:04.937784+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937784+0000","last_undegraded":"2024-04-14T10:00:04.937784+0000","last_fullsized":"2024-04-14T10:00:04.937784+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651591+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651591+0000","last_peered":"2024-04-14T10:00:05.651591+0000","last_clean":"2024-04-14T10:00:05.651591+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651591+0000","last_undegraded":"2024-04-14T10:00:05.651591+0000","last_fullsized":"2024-04-14T10:00:05.651591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650877+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650877+0000","last_peered":"2024-04-14T10:00:05.650877+0000","last_clean":"2024-04-14T10:00:05.650877+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650877+0000","last_undegraded":"2024-04-14T10:00:05.650877+0000","last_fullsized":"2024-04-14T10:00:05.650877+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937149+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937149+0000","last_peered":"2024-04-14T10:00:04.937149+0000","last_clean":"2024-04-14T10:00:04.937149+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937149+0000","last_undegraded":"2024-04-14T10:00:04.937149+0000","last_fullsized":"2024-04-14T10:00:04.937149+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427207+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427207+0000","last_peered":"2024-04-14T10:00:05.427207+0000","last_clean":"2024-04-14T10:00:05.427207+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427207+0000","last_undegraded":"2024-04-14T10:00:05.427207+0000","last_fullsized":"2024-04-14T10:00:05.427207+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937371+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937371+0000","last_peered":"2024-04-14T10:00:04.937371+0000","last_clean":"2024-04-14T10:00:04.937371+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937371+0000","last_undegraded":"2024-04-14T10:00:04.937371+0000","last_fullsized":"2024-04-14T10:00:04.937371+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936876+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936876+0000","last_peered":"2024-04-14T10:00:04.936876+0000","last_clean":"2024-04-14T10:00:04.936876+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936876+0000","last_undegraded":"2024-04-14T10:00:04.936876+0000","last_fullsized":"2024-04-14T10:00:04.936876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:01:37.676 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:01:37.676 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:01:53.050 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:01:53.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:01:57.678 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:01:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.791+0000 7f50ff698640 1 Processor -- start 2024-04-14T10:01:57.791 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.791+0000 7f50ff698640 1 -- start start 2024-04-14T10:01:57.793 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f815e510 0x7f50f80cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50f80d2800 0x7f50f80d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f50f80d0e90 0x7f50f80d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f50f80d31c0 con 0x7f50f80d2800 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f50f80ceda0 con 0x7f50f80d0e90 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50ff698640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f50f80cf040 con 0x7f50f815e510 2024-04-14T10:01:57.794 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50fcc33640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50f80d2800 0x7f50f80d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50fcc33640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f50f80d2800 0x7f50f80d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49480/0 (socket says 172.21.15.40:49480) 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50fcc33640 1 -- 172.21.15.40:0/1360045632 learned_addr learned my addr 172.21.15.40:0/1360045632 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50fdc35640 1 --2- 172.21.15.40:0/1360045632 >> v2:172.21.15.136:3300/0 conn(0x7f50f80d0e90 0x7f50f80d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.792+0000 7f50fd434640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f815e510 0x7f50f80cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 -- 172.21.15.40:0/1360045632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f815e510 msgr2=0x7f50f80cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f815e510 0x7f50f80cfe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 -- 172.21.15.40:0/1360045632 >> v2:172.21.15.136:3300/0 conn(0x7f50f80d0e90 msgr2=0x7f50f80d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:01:57.795 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 --2- 172.21.15.40:0/1360045632 >> v2:172.21.15.136:3300/0 conn(0x7f50f80d0e90 0x7f50f80d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 -- 172.21.15.40:0/1360045632 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f80cf320 con 0x7f50f80d2800 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.793+0000 7f50fcc33640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d2800 0x7f50f80d2c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f50f808d6a0 tx=0x7f50ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8201debd09876a88 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50f7fff640 1 -- 172.21.15.40:0/1360045632 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec02e070 con 0x7f50f80d2800 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50f7fff640 1 -- 172.21.15.40:0/1360045632 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50ec037070 con 0x7f50f80d2800 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50f7fff640 1 -- 172.21.15.40:0/1360045632 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50ec031a00 con 0x7f50f80d2800 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 -- 172.21.15.40:0/1360045632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d2800 msgr2=0x7f50f80d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d2800 0x7f50f80d2c80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f50f808d6a0 tx=0x7f50ec02b880 comp rx=0 tx=0).stop 2024-04-14T10:01:57.796 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 -- 172.21.15.40:0/1360045632 shutdown_connections 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 --2- 172.21.15.40:0/1360045632 >> v2:172.21.15.136:3300/0 conn(0x7f50f80d0e90 0x7f50f80d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d2800 0x7f50f80d2c80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 --2- 172.21.15.40:0/1360045632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f815e510 0x7f50f80cfe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 -- 172.21.15.40:0/1360045632 >> 172.21.15.40:0/1360045632 conn(0x7f50f809d570 msgr2=0x7f50f80d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 -- 172.21.15.40:0/1360045632 shutdown_connections 2024-04-14T10:01:57.797 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.794+0000 7f50ff698640 1 -- 172.21.15.40:0/1360045632 wait complete. 2024-04-14T10:01:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 Processor -- start 2024-04-14T10:01:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 -- start start 2024-04-14T10:01:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.800 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f80d2800 0x7f50f814e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f815e510 0x7f50f80b7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f50f80d1840 con 0x7f50f80d0e90 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f50f815e8f0 con 0x7f50f815e510 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50ff698640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f50f80d19c0 con 0x7f50f80d2800 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50fd434640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50fd434640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:49494/0 (socket says 172.21.15.40:49494) 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.796+0000 7f50fd434640 1 -- 172.21.15.40:0/2982496340 learned_addr learned my addr 172.21.15.40:0/2982496340 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:01:57.801 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fdc35640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f815e510 0x7f50f80b7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fcc33640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f80d2800 0x7f50f814e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 -- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f80d2800 msgr2=0x7f50f814e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f80d2800 0x7f50f814e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 -- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f815e510 msgr2=0x7f50f80b7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f815e510 0x7f50f80b7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 -- 172.21.15.40:0/2982496340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f80b8000 con 0x7f50f80d0e90 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50fd434640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50f000e8a0 tx=0x7f50f000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:57.802 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f0017070 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f000c940 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f000cd30 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50f80cd340 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.797+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50f80b72c0 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.798+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50f80756f0 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.799+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f50f001a070 con 0x7f50f80d0e90 2024-04-14T10:01:57.803 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.799+0000 7f50f5ffb640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 0x7f50e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:01:57.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.799+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f50f008ba50 con 0x7f50f80d0e90 2024-04-14T10:01:57.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.799+0000 7f50fcc33640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 0x7f50e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:01:57.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.800+0000 7f50fcc33640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 0x7f50e406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f50ec036000 tx=0x7f50ec03d040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:01:57.804 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.804+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f50f0059710 con 0x7f50f80d0e90 2024-04-14T10:01:57.986 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.986+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50f80cd620 con 0x7f50e406c8f0 2024-04-14T10:01:57.992 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.993+0000 7f50f5ffb640 1 -- 172.21.15.40:0/2982496340 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f50f80cd620 con 0x7f50e406c8f0 2024-04-14T10:01:57.996 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:01:57.997 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:01:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 msgr2=0x7f50e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:57.999 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 0x7f50e406edb0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f50ec036000 tx=0x7f50ec03d040 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 msgr2=0x7f50f8157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50f000e8a0 tx=0x7f50f000ed60 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 shutdown_connections 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f50e406c8f0 0x7f50e406edb0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50f815e510 0x7f50f80b7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f50f80d2800 0x7f50f814e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 --2- 172.21.15.40:0/2982496340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f50f80d0e90 0x7f50f8157d50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:01:58.000 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 >> 172.21.15.40:0/2982496340 conn(0x7f50f809d570 msgr2=0x7f50f8161300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:01:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 shutdown_connections 2024-04-14T10:01:58.001 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:01:57.996+0000 7f50ff698640 1 -- 172.21.15.40:0/2982496340 wait complete. 2024-04-14T10:01:58.006 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-14T10:01:56.847300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002084"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427762+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427762+0000","last_peered":"2024-04-14T10:00:05.427762+0000","last_clean":"2024-04-14T10:00:05.427762+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427762+0000","last_undegraded":"2024-04-14T10:00:05.427762+0000","last_fullsized":"2024-04-14T10:00:05.427762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428778+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428778+0000","last_peered":"2024-04-14T10:00:06.428778+0000","last_clean":"2024-04-14T10:00:06.428778+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428778+0000","last_undegraded":"2024-04-14T10:00:06.428778+0000","last_fullsized":"2024-04-14T10:00:06.428778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939293+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939293+0000","last_peered":"2024-04-14T10:00:04.939293+0000","last_clean":"2024-04-14T10:00:04.939293+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939293+0000","last_undegraded":"2024-04-14T10:00:04.939293+0000","last_fullsized":"2024-04-14T10:00:04.939293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071225+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071225+0000","last_peered":"2024-04-14T10:00:05.071225+0000","last_clean":"2024-04-14T10:00:05.071225+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071225+0000","last_undegraded":"2024-04-14T10:00:05.071225+0000","last_fullsized":"2024-04-14T10:00:05.071225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071186+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071186+0000","last_peered":"2024-04-14T10:00:05.071186+0000","last_clean":"2024-04-14T10:00:05.071186+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071186+0000","last_undegraded":"2024-04-14T10:00:05.071186+0000","last_fullsized":"2024-04-14T10:00:05.071186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650119+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650119+0000","last_peered":"2024-04-14T10:00:05.650119+0000","last_clean":"2024-04-14T10:00:05.650119+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650119+0000","last_undegraded":"2024-04-14T10:00:05.650119+0000","last_fullsized":"2024-04-14T10:00:05.650119+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208368+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208368+0000","last_peered":"2024-04-14T10:00:07.208368+0000","last_clean":"2024-04-14T10:00:07.208368+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208368+0000","last_undegraded":"2024-04-14T10:00:07.208368+0000","last_fullsized":"2024-04-14T10:00:07.208368+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427062+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427062+0000","last_peered":"2024-04-14T10:00:05.427062+0000","last_clean":"2024-04-14T10:00:05.427062+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427062+0000","last_undegraded":"2024-04-14T10:00:05.427062+0000","last_fullsized":"2024-04-14T10:00:05.427062+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939353+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939353+0000","last_peered":"2024-04-14T10:00:04.939353+0000","last_clean":"2024-04-14T10:00:04.939353+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939353+0000","last_undegraded":"2024-04-14T10:00:04.939353+0000","last_fullsized":"2024-04-14T10:00:04.939353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651139+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651139+0000","last_peered":"2024-04-14T10:00:05.651139+0000","last_clean":"2024-04-14T10:00:05.651139+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651139+0000","last_undegraded":"2024-04-14T10:00:05.651139+0000","last_fullsized":"2024-04-14T10:00:05.651139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232903+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232903+0000","last_peered":"2024-04-14T10:00:09.232903+0000","last_clean":"2024-04-14T10:00:09.232903+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232903+0000","last_undegraded":"2024-04-14T10:00:09.232903+0000","last_fullsized":"2024-04-14T10:00:09.232903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939027+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939027+0000","last_peered":"2024-04-14T10:00:04.939027+0000","last_clean":"2024-04-14T10:00:04.939027+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939027+0000","last_undegraded":"2024-04-14T10:00:04.939027+0000","last_fullsized":"2024-04-14T10:00:04.939027+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651132+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651132+0000","last_peered":"2024-04-14T10:00:05.651132+0000","last_clean":"2024-04-14T10:00:05.651132+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651132+0000","last_undegraded":"2024-04-14T10:00:05.651132+0000","last_fullsized":"2024-04-14T10:00:05.651132+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651498+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651498+0000","last_peered":"2024-04-14T10:00:05.651498+0000","last_clean":"2024-04-14T10:00:05.651498+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651498+0000","last_undegraded":"2024-04-14T10:00:05.651498+0000","last_fullsized":"2024-04-14T10:00:05.651498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650908+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650908+0000","last_peered":"2024-04-14T10:00:05.650908+0000","last_clean":"2024-04-14T10:00:05.650908+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650908+0000","last_undegraded":"2024-04-14T10:00:05.650908+0000","last_fullsized":"2024-04-14T10:00:05.650908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936689+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936689+0000","last_peered":"2024-04-14T10:00:04.936689+0000","last_clean":"2024-04-14T10:00:04.936689+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936689+0000","last_undegraded":"2024-04-14T10:00:04.936689+0000","last_fullsized":"2024-04-14T10:00:04.936689+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937707+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937707+0000","last_peered":"2024-04-14T10:00:04.937707+0000","last_clean":"2024-04-14T10:00:04.937707+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937707+0000","last_undegraded":"2024-04-14T10:00:04.937707+0000","last_fullsized":"2024-04-14T10:00:04.937707+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937928+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937928+0000","last_peered":"2024-04-14T10:00:04.937928+0000","last_clean":"2024-04-14T10:00:04.937928+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937928+0000","last_undegraded":"2024-04-14T10:00:04.937928+0000","last_fullsized":"2024-04-14T10:00:04.937928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071266+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071266+0000","last_peered":"2024-04-14T10:00:05.071266+0000","last_clean":"2024-04-14T10:00:05.071266+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071266+0000","last_undegraded":"2024-04-14T10:00:05.071266+0000","last_fullsized":"2024-04-14T10:00:05.071266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937869+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937869+0000","last_peered":"2024-04-14T10:00:04.937869+0000","last_clean":"2024-04-14T10:00:04.937869+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937869+0000","last_undegraded":"2024-04-14T10:00:04.937869+0000","last_fullsized":"2024-04-14T10:00:04.937869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651216+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651216+0000","last_peered":"2024-04-14T10:00:05.651216+0000","last_clean":"2024-04-14T10:00:05.651216+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651216+0000","last_undegraded":"2024-04-14T10:00:05.651216+0000","last_fullsized":"2024-04-14T10:00:05.651216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651764+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651764+0000","last_peered":"2024-04-14T10:00:05.651764+0000","last_clean":"2024-04-14T10:00:05.651764+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651764+0000","last_undegraded":"2024-04-14T10:00:05.651764+0000","last_fullsized":"2024-04-14T10:00:05.651764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042391+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042391+0000","last_peered":"2024-04-14T10:00:09.042391+0000","last_clean":"2024-04-14T10:00:09.042391+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042391+0000","last_undegraded":"2024-04-14T10:00:09.042391+0000","last_fullsized":"2024-04-14T10:00:09.042391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070989+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070989+0000","last_peered":"2024-04-14T10:00:05.070989+0000","last_clean":"2024-04-14T10:00:05.070989+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070989+0000","last_undegraded":"2024-04-14T10:00:05.070989+0000","last_fullsized":"2024-04-14T10:00:05.070989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938019+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.938019+0000","last_peered":"2024-04-14T10:00:04.938019+0000","last_clean":"2024-04-14T10:00:04.938019+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.938019+0000","last_undegraded":"2024-04-14T10:00:04.938019+0000","last_fullsized":"2024-04-14T10:00:04.938019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650549+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650549+0000","last_peered":"2024-04-14T10:00:05.650549+0000","last_clean":"2024-04-14T10:00:05.650549+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650549+0000","last_undegraded":"2024-04-14T10:00:05.650549+0000","last_fullsized":"2024-04-14T10:00:05.650549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937896+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937896+0000","last_peered":"2024-04-14T10:00:04.937896+0000","last_clean":"2024-04-14T10:00:04.937896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937896+0000","last_undegraded":"2024-04-14T10:00:04.937896+0000","last_fullsized":"2024-04-14T10:00:04.937896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236650+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236650+0000","last_peered":"2024-04-14T10:00:06.236650+0000","last_clean":"2024-04-14T10:00:06.236650+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236650+0000","last_undegraded":"2024-04-14T10:00:06.236650+0000","last_fullsized":"2024-04-14T10:00:06.236650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937590+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937590+0000","last_peered":"2024-04-14T10:00:04.937590+0000","last_clean":"2024-04-14T10:00:04.937590+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937590+0000","last_undegraded":"2024-04-14T10:00:04.937590+0000","last_fullsized":"2024-04-14T10:00:04.937590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937977+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937977+0000","last_peered":"2024-04-14T10:00:04.937977+0000","last_clean":"2024-04-14T10:00:04.937977+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937977+0000","last_undegraded":"2024-04-14T10:00:04.937977+0000","last_fullsized":"2024-04-14T10:00:04.937977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011850+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011850+0000","last_peered":"2024-04-14T10:00:10.011850+0000","last_clean":"2024-04-14T10:00:10.011850+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011850+0000","last_undegraded":"2024-04-14T10:00:10.011850+0000","last_fullsized":"2024-04-14T10:00:10.011850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650234+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650234+0000","last_peered":"2024-04-14T10:00:05.650234+0000","last_clean":"2024-04-14T10:00:05.650234+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650234+0000","last_undegraded":"2024-04-14T10:00:05.650234+0000","last_fullsized":"2024-04-14T10:00:05.650234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937287+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937287+0000","last_peered":"2024-04-14T10:00:04.937287+0000","last_clean":"2024-04-14T10:00:04.937287+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937287+0000","last_undegraded":"2024-04-14T10:00:04.937287+0000","last_fullsized":"2024-04-14T10:00:04.937287+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938022+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.938022+0000","last_peered":"2024-04-14T10:00:04.938022+0000","last_clean":"2024-04-14T10:00:04.938022+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.938022+0000","last_undegraded":"2024-04-14T10:00:04.938022+0000","last_fullsized":"2024-04-14T10:00:04.938022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650497+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650497+0000","last_peered":"2024-04-14T10:00:05.650497+0000","last_clean":"2024-04-14T10:00:05.650497+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650497+0000","last_undegraded":"2024-04-14T10:00:05.650497+0000","last_fullsized":"2024-04-14T10:00:05.650497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939251+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939251+0000","last_peered":"2024-04-14T10:00:04.939251+0000","last_clean":"2024-04-14T10:00:04.939251+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939251+0000","last_undegraded":"2024-04-14T10:00:04.939251+0000","last_fullsized":"2024-04-14T10:00:04.939251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651557+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651557+0000","last_peered":"2024-04-14T10:00:05.651557+0000","last_clean":"2024-04-14T10:00:05.651557+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651557+0000","last_undegraded":"2024-04-14T10:00:05.651557+0000","last_fullsized":"2024-04-14T10:00:05.651557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650568+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650568+0000","last_peered":"2024-04-14T10:00:05.650568+0000","last_clean":"2024-04-14T10:00:05.650568+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650568+0000","last_undegraded":"2024-04-14T10:00:05.650568+0000","last_fullsized":"2024-04-14T10:00:05.650568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427798+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427798+0000","last_peered":"2024-04-14T10:00:05.427798+0000","last_clean":"2024-04-14T10:00:05.427798+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427798+0000","last_undegraded":"2024-04-14T10:00:05.427798+0000","last_fullsized":"2024-04-14T10:00:05.427798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651215+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651215+0000","last_peered":"2024-04-14T10:00:05.651215+0000","last_clean":"2024-04-14T10:00:05.651215+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651215+0000","last_undegraded":"2024-04-14T10:00:05.651215+0000","last_fullsized":"2024-04-14T10:00:05.651215+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938831+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938831+0000","last_peered":"2024-04-14T10:00:04.938831+0000","last_clean":"2024-04-14T10:00:04.938831+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938831+0000","last_undegraded":"2024-04-14T10:00:04.938831+0000","last_fullsized":"2024-04-14T10:00:04.938831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651221+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651221+0000","last_peered":"2024-04-14T10:00:05.651221+0000","last_clean":"2024-04-14T10:00:05.651221+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651221+0000","last_undegraded":"2024-04-14T10:00:05.651221+0000","last_fullsized":"2024-04-14T10:00:05.651221+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651002+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651002+0000","last_peered":"2024-04-14T10:00:05.651002+0000","last_clean":"2024-04-14T10:00:05.651002+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651002+0000","last_undegraded":"2024-04-14T10:00:05.651002+0000","last_fullsized":"2024-04-14T10:00:05.651002+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937018+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937018+0000","last_peered":"2024-04-14T10:00:04.937018+0000","last_clean":"2024-04-14T10:00:04.937018+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937018+0000","last_undegraded":"2024-04-14T10:00:04.937018+0000","last_fullsized":"2024-04-14T10:00:04.937018+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651639+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651639+0000","last_peered":"2024-04-14T10:00:05.651639+0000","last_clean":"2024-04-14T10:00:05.651639+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651639+0000","last_undegraded":"2024-04-14T10:00:05.651639+0000","last_fullsized":"2024-04-14T10:00:05.651639+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650205+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650205+0000","last_peered":"2024-04-14T10:00:05.650205+0000","last_clean":"2024-04-14T10:00:05.650205+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650205+0000","last_undegraded":"2024-04-14T10:00:05.650205+0000","last_fullsized":"2024-04-14T10:00:05.650205+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427367+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427367+0000","last_peered":"2024-04-14T10:00:05.427367+0000","last_clean":"2024-04-14T10:00:05.427367+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427367+0000","last_undegraded":"2024-04-14T10:00:05.427367+0000","last_fullsized":"2024-04-14T10:00:05.427367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651003+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651003+0000","last_peered":"2024-04-14T10:00:05.651003+0000","last_clean":"2024-04-14T10:00:05.651003+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651003+0000","last_undegraded":"2024-04-14T10:00:05.651003+0000","last_fullsized":"2024-04-14T10:00:05.651003+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071150+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071150+0000","last_peered":"2024-04-14T10:00:05.071150+0000","last_clean":"2024-04-14T10:00:05.071150+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071150+0000","last_undegraded":"2024-04-14T10:00:05.071150+0000","last_fullsized":"2024-04-14T10:00:05.071150+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427802+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427802+0000","last_peered":"2024-04-14T10:00:05.427802+0000","last_clean":"2024-04-14T10:00:05.427802+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427802+0000","last_undegraded":"2024-04-14T10:00:05.427802+0000","last_fullsized":"2024-04-14T10:00:05.427802+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029431+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029431+0000","last_peered":"2024-04-14T10:00:07.029431+0000","last_clean":"2024-04-14T10:00:07.029431+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029431+0000","last_undegraded":"2024-04-14T10:00:07.029431+0000","last_fullsized":"2024-04-14T10:00:07.029431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651329+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651329+0000","last_peered":"2024-04-14T10:00:05.651329+0000","last_clean":"2024-04-14T10:00:05.651329+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651329+0000","last_undegraded":"2024-04-14T10:00:05.651329+0000","last_fullsized":"2024-04-14T10:00:05.651329+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939255+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939255+0000","last_peered":"2024-04-14T10:00:04.939255+0000","last_clean":"2024-04-14T10:00:04.939255+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939255+0000","last_undegraded":"2024-04-14T10:00:04.939255+0000","last_fullsized":"2024-04-14T10:00:04.939255+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651135+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651135+0000","last_peered":"2024-04-14T10:00:05.651135+0000","last_clean":"2024-04-14T10:00:05.651135+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651135+0000","last_undegraded":"2024-04-14T10:00:05.651135+0000","last_fullsized":"2024-04-14T10:00:05.651135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651035+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651035+0000","last_peered":"2024-04-14T10:00:05.651035+0000","last_clean":"2024-04-14T10:00:05.651035+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651035+0000","last_undegraded":"2024-04-14T10:00:05.651035+0000","last_fullsized":"2024-04-14T10:00:05.651035+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":37,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427593+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427593+0000","last_peered":"2024-04-14T10:00:05.427593+0000","last_clean":"2024-04-14T10:00:05.427593+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427593+0000","last_undegraded":"2024-04-14T10:00:05.427593+0000","last_fullsized":"2024-04-14T10:00:05.427593+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938843+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938843+0000","last_peered":"2024-04-14T10:00:04.938843+0000","last_clean":"2024-04-14T10:00:04.938843+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938843+0000","last_undegraded":"2024-04-14T10:00:04.938843+0000","last_fullsized":"2024-04-14T10:00:04.938843+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427646+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427646+0000","last_peered":"2024-04-14T10:00:05.427646+0000","last_clean":"2024-04-14T10:00:05.427646+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427646+0000","last_undegraded":"2024-04-14T10:00:05.427646+0000","last_fullsized":"2024-04-14T10:00:05.427646+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427194+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427194+0000","last_peered":"2024-04-14T10:00:05.427194+0000","last_clean":"2024-04-14T10:00:05.427194+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427194+0000","last_undegraded":"2024-04-14T10:00:05.427194+0000","last_fullsized":"2024-04-14T10:00:05.427194+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650136+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650136+0000","last_peered":"2024-04-14T10:00:05.650136+0000","last_clean":"2024-04-14T10:00:05.650136+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650136+0000","last_undegraded":"2024-04-14T10:00:05.650136+0000","last_fullsized":"2024-04-14T10:00:05.650136+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024665+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024665+0000","last_peered":"2024-04-14T10:00:06.024665+0000","last_clean":"2024-04-14T10:00:06.024665+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024665+0000","last_undegraded":"2024-04-14T10:00:06.024665+0000","last_fullsized":"2024-04-14T10:00:06.024665+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937362+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937362+0000","last_peered":"2024-04-14T10:00:04.937362+0000","last_clean":"2024-04-14T10:00:04.937362+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937362+0000","last_undegraded":"2024-04-14T10:00:04.937362+0000","last_fullsized":"2024-04-14T10:00:04.937362+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":25,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427348+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427348+0000","last_peered":"2024-04-14T10:00:05.427348+0000","last_clean":"2024-04-14T10:00:05.427348+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427348+0000","last_undegraded":"2024-04-14T10:00:05.427348+0000","last_fullsized":"2024-04-14T10:00:05.427348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":35,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936735+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936735+0000","last_peered":"2024-04-14T10:00:04.936735+0000","last_clean":"2024-04-14T10:00:04.936735+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936735+0000","last_undegraded":"2024-04-14T10:00:04.936735+0000","last_fullsized":"2024-04-14T10:00:04.936735+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427588+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427588+0000","last_peered":"2024-04-14T10:00:05.427588+0000","last_clean":"2024-04-14T10:00:05.427588+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427588+0000","last_undegraded":"2024-04-14T10:00:05.427588+0000","last_fullsized":"2024-04-14T10:00:05.427588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651389+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651389+0000","last_peered":"2024-04-14T10:00:05.651389+0000","last_clean":"2024-04-14T10:00:05.651389+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651389+0000","last_undegraded":"2024-04-14T10:00:05.651389+0000","last_fullsized":"2024-04-14T10:00:05.651389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651089+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651089+0000","last_peered":"2024-04-14T10:00:05.651089+0000","last_clean":"2024-04-14T10:00:05.651089+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651089+0000","last_undegraded":"2024-04-14T10:00:05.651089+0000","last_fullsized":"2024-04-14T10:00:05.651089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651643+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651643+0000","last_peered":"2024-04-14T10:00:05.651643+0000","last_clean":"2024-04-14T10:00:05.651643+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651643+0000","last_undegraded":"2024-04-14T10:00:05.651643+0000","last_fullsized":"2024-04-14T10:00:05.651643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651478+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651478+0000","last_peered":"2024-04-14T10:00:05.651478+0000","last_clean":"2024-04-14T10:00:05.651478+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651478+0000","last_undegraded":"2024-04-14T10:00:05.651478+0000","last_fullsized":"2024-04-14T10:00:05.651478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071269+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071269+0000","last_peered":"2024-04-14T10:00:05.071269+0000","last_clean":"2024-04-14T10:00:05.071269+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071269+0000","last_undegraded":"2024-04-14T10:00:05.071269+0000","last_fullsized":"2024-04-14T10:00:05.071269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071394+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071394+0000","last_peered":"2024-04-14T10:00:05.071394+0000","last_clean":"2024-04-14T10:00:05.071394+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071394+0000","last_undegraded":"2024-04-14T10:00:05.071394+0000","last_fullsized":"2024-04-14T10:00:05.071394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650406+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650406+0000","last_peered":"2024-04-14T10:00:05.650406+0000","last_clean":"2024-04-14T10:00:05.650406+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650406+0000","last_undegraded":"2024-04-14T10:00:05.650406+0000","last_fullsized":"2024-04-14T10:00:05.650406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070233+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070233+0000","last_peered":"2024-04-14T10:00:05.070233+0000","last_clean":"2024-04-14T10:00:05.070233+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070233+0000","last_undegraded":"2024-04-14T10:00:05.070233+0000","last_fullsized":"2024-04-14T10:00:05.070233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938986+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938986+0000","last_peered":"2024-04-14T10:00:04.938986+0000","last_clean":"2024-04-14T10:00:04.938986+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938986+0000","last_undegraded":"2024-04-14T10:00:04.938986+0000","last_fullsized":"2024-04-14T10:00:04.938986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070983+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070983+0000","last_peered":"2024-04-14T10:00:05.070983+0000","last_clean":"2024-04-14T10:00:05.070983+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070983+0000","last_undegraded":"2024-04-14T10:00:05.070983+0000","last_fullsized":"2024-04-14T10:00:05.070983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200991+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200991+0000","last_peered":"2024-04-14T10:00:08.200991+0000","last_clean":"2024-04-14T10:00:08.200991+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200991+0000","last_undegraded":"2024-04-14T10:00:08.200991+0000","last_fullsized":"2024-04-14T10:00:08.200991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937010+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.937010+0000","last_peered":"2024-04-14T10:00:04.937010+0000","last_clean":"2024-04-14T10:00:04.937010+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.937010+0000","last_undegraded":"2024-04-14T10:00:04.937010+0000","last_fullsized":"2024-04-14T10:00:04.937010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427690+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427690+0000","last_peered":"2024-04-14T10:00:05.427690+0000","last_clean":"2024-04-14T10:00:05.427690+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427690+0000","last_undegraded":"2024-04-14T10:00:05.427690+0000","last_fullsized":"2024-04-14T10:00:05.427690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071008+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.071008+0000","last_peered":"2024-04-14T10:00:05.071008+0000","last_clean":"2024-04-14T10:00:05.071008+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.071008+0000","last_undegraded":"2024-04-14T10:00:05.071008+0000","last_fullsized":"2024-04-14T10:00:05.071008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650297+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650297+0000","last_peered":"2024-04-14T10:00:05.650297+0000","last_clean":"2024-04-14T10:00:05.650297+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650297+0000","last_undegraded":"2024-04-14T10:00:05.650297+0000","last_fullsized":"2024-04-14T10:00:05.650297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992266+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992266+0000","last_peered":"2024-04-14T10:00:07.992266+0000","last_clean":"2024-04-14T10:00:07.992266+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992266+0000","last_undegraded":"2024-04-14T10:00:07.992266+0000","last_fullsized":"2024-04-14T10:00:07.992266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071339+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071339+0000","last_peered":"2024-04-14T10:00:05.071339+0000","last_clean":"2024-04-14T10:00:05.071339+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071339+0000","last_undegraded":"2024-04-14T10:00:05.071339+0000","last_fullsized":"2024-04-14T10:00:05.071339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394029+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394029+0000","last_peered":"2024-04-14T10:00:07.394029+0000","last_clean":"2024-04-14T10:00:07.394029+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394029+0000","last_undegraded":"2024-04-14T10:00:07.394029+0000","last_fullsized":"2024-04-14T10:00:07.394029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939257+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939257+0000","last_peered":"2024-04-14T10:00:04.939257+0000","last_clean":"2024-04-14T10:00:04.939257+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939257+0000","last_undegraded":"2024-04-14T10:00:04.939257+0000","last_fullsized":"2024-04-14T10:00:04.939257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939267+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939267+0000","last_peered":"2024-04-14T10:00:04.939267+0000","last_clean":"2024-04-14T10:00:04.939267+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939267+0000","last_undegraded":"2024-04-14T10:00:04.939267+0000","last_fullsized":"2024-04-14T10:00:04.939267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939238+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939238+0000","last_peered":"2024-04-14T10:00:04.939238+0000","last_clean":"2024-04-14T10:00:04.939238+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939238+0000","last_undegraded":"2024-04-14T10:00:04.939238+0000","last_fullsized":"2024-04-14T10:00:04.939238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650147+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650147+0000","last_peered":"2024-04-14T10:00:05.650147+0000","last_clean":"2024-04-14T10:00:05.650147+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650147+0000","last_undegraded":"2024-04-14T10:00:05.650147+0000","last_fullsized":"2024-04-14T10:00:05.650147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937822+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937822+0000","last_peered":"2024-04-14T10:00:04.937822+0000","last_clean":"2024-04-14T10:00:04.937822+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937822+0000","last_undegraded":"2024-04-14T10:00:04.937822+0000","last_fullsized":"2024-04-14T10:00:04.937822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651632+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651632+0000","last_peered":"2024-04-14T10:00:05.651632+0000","last_clean":"2024-04-14T10:00:05.651632+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651632+0000","last_undegraded":"2024-04-14T10:00:05.651632+0000","last_fullsized":"2024-04-14T10:00:05.651632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650921+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650921+0000","last_peered":"2024-04-14T10:00:05.650921+0000","last_clean":"2024-04-14T10:00:05.650921+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650921+0000","last_undegraded":"2024-04-14T10:00:05.650921+0000","last_fullsized":"2024-04-14T10:00:05.650921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937188+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937188+0000","last_peered":"2024-04-14T10:00:04.937188+0000","last_clean":"2024-04-14T10:00:04.937188+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937188+0000","last_undegraded":"2024-04-14T10:00:04.937188+0000","last_fullsized":"2024-04-14T10:00:04.937188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427262+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427262+0000","last_peered":"2024-04-14T10:00:05.427262+0000","last_clean":"2024-04-14T10:00:05.427262+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427262+0000","last_undegraded":"2024-04-14T10:00:05.427262+0000","last_fullsized":"2024-04-14T10:00:05.427262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.430632+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.430632+0000","last_peered":"2024-04-14T10:00:05.430632+0000","last_clean":"2024-04-14T10:00:05.430632+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.430632+0000","last_undegraded":"2024-04-14T10:00:05.430632+0000","last_fullsized":"2024-04-14T10:00:05.430632+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937407+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937407+0000","last_peered":"2024-04-14T10:00:04.937407+0000","last_clean":"2024-04-14T10:00:04.937407+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937407+0000","last_undegraded":"2024-04-14T10:00:04.937407+0000","last_fullsized":"2024-04-14T10:00:04.937407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":219,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936876+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:04.936876+0000","last_peered":"2024-04-14T10:00:04.936876+0000","last_clean":"2024-04-14T10:00:04.936876+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:04.936876+0000","last_undegraded":"2024-04-14T10:00:04.936876+0000","last_fullsized":"2024-04-14T10:00:04.936876+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:01:58.013 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:01:58.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:02:18.014 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:02:18.128 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.129+0000 7f785b11e640 1 Processor -- start 2024-04-14T10:02:18.129 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.129+0000 7f785b11e640 1 -- start start 2024-04-14T10:02:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f785b11e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f78540d2770 0x7f78540d2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f785b11e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78540cf0a0 0x7f78540cf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f785b11e640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78540b4c70 con 0x7f785415e650 2024-04-14T10:02:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f785b11e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f78540d3110 con 0x7f78540cf0a0 2024-04-14T10:02:18.130 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f785b11e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f78540b5880 con 0x7f78540d2770 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78596bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f78540cf0a0 0x7f78540cf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f7858eba640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f785415e650 0x7f78540b4220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:60602/0 (socket says 172.21.15.40:60602) 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f7858eba640 1 -- 172.21.15.40:0/4030441373 learned_addr learned my addr 172.21.15.40:0/4030441373 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f7853fff640 1 --2- 172.21.15.40:0/4030441373 >> v2:172.21.15.136:3300/0 conn(0x7f78540d2770 0x7f78540d2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78596bb640 1 -- 172.21.15.40:0/4030441373 >> v2:172.21.15.136:3300/0 conn(0x7f78540d2770 msgr2=0x7f78540d2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78596bb640 1 --2- 172.21.15.40:0/4030441373 >> v2:172.21.15.136:3300/0 conn(0x7f78540d2770 0x7f78540d2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78596bb640 1 -- 172.21.15.40:0/4030441373 >> v1:172.21.15.40:6789/0 conn(0x7f785415e650 legacy=0x7f78540b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.131 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78596bb640 1 -- 172.21.15.40:0/4030441373 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78540b4f50 con 0x7f78540cf0a0 2024-04-14T10:02:18.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.130+0000 7f78537fe640 1 -- 172.21.15.40:0/4030441373 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012312864 0 0) 0x7f78540b4c70 con 0x7f785415e650 2024-04-14T10:02:18.132 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.131+0000 7f78596bb640 1 --2- 172.21.15.40:0/4030441373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f78540cf510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7854162240 tx=0x7f784c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c6e76815eb6dc0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.131+0000 7f78537fe640 1 -- 172.21.15.40:0/4030441373 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c039070 con 0x7f78540cf0a0 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.131+0000 7f78537fe640 1 -- 172.21.15.40:0/4030441373 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f784c02cc80 con 0x7f78540cf0a0 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.131+0000 7f78537fe640 1 -- 172.21.15.40:0/4030441373 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f784c034660 con 0x7f78540cf0a0 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 -- 172.21.15.40:0/4030441373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 msgr2=0x7f78540cf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 --2- 172.21.15.40:0/4030441373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f78540cf510 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7854162240 tx=0x7f784c02bed0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 -- 172.21.15.40:0/4030441373 shutdown_connections 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 --2- 172.21.15.40:0/4030441373 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f78540cf510 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.135 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 --2- 172.21.15.40:0/4030441373 >> v2:172.21.15.136:3300/0 conn(0x7f78540d2770 0x7f78540d2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 -- 172.21.15.40:0/4030441373 >> 172.21.15.40:0/4030441373 conn(0x7f785409d580 msgr2=0x7f78540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 -- 172.21.15.40:0/4030441373 shutdown_connections 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.132+0000 7f785b11e640 1 -- 172.21.15.40:0/4030441373 wait complete. 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.133+0000 7f785b11e640 1 Processor -- start 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.133+0000 7f785b11e640 1 -- start start 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78540d2770 0x7f78540cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.136 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f785415e650 0x7f78540b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f78540b4930 con 0x7f78540cf0a0 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f78540b5510 con 0x7f78540d2770 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f785b11e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f78540d2270 con 0x7f785415e650 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:52088/0 (socket says 172.21.15.40:52088) 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 -- 172.21.15.40:0/1980406307 learned_addr learned my addr 172.21.15.40:0/1980406307 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7853fff640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78540d2770 0x7f78540cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.137 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f78596bb640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f785415e650 0x7f78540b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 -- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f785415e650 msgr2=0x7f78540b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f785415e650 0x7f78540b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 -- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78540d2770 msgr2=0x7f78540cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78540d2770 0x7f78540cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.134+0000 7f7858eba640 1 -- 172.21.15.40:0/1980406307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7854152d70 con 0x7f78540cf0a0 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f7858eba640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f784800c4d0 tx=0x7f784800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:18.138 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848018070 con 0x7f78540cf0a0 2024-04-14T10:02:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7848007500 con 0x7f78540cf0a0 2024-04-14T10:02:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78540b8600 con 0x7f78540cf0a0 2024-04-14T10:02:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7848004a20 con 0x7f78540cf0a0 2024-04-14T10:02:18.139 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.135+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78540b8bc0 con 0x7f78540cf0a0 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.136+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78540d32a0 con 0x7f78540cf0a0 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.136+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f784801b070 con 0x7f78540cf0a0 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.137+0000 7f78517fa640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 0x7f783806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.137+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f784808afb0 con 0x7f78540cf0a0 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.137+0000 7f7853fff640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 0x7f783806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:18.140 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.137+0000 7f7853fff640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 0x7f783806edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7854158870 tx=0x7f7840009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:18.141 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.141+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f78540d32a0 con 0x7f78540cf0a0 2024-04-14T10:02:18.320 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.321+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78540756f0 con 0x7f783806c8f0 2024-04-14T10:02:18.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.327+0000 7f78517fa640 1 -- 172.21.15.40:0/1980406307 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7f78540756f0 con 0x7f783806c8f0 2024-04-14T10:02:18.330 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:02:18.331 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:02:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.330+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 msgr2=0x7f783806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.330+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 0x7f783806edb0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7854158870 tx=0x7f7840009190 comp rx=0 tx=0).stop 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.330+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 msgr2=0x7f7854152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.330+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f784800c4d0 tx=0x7f784800c990 comp rx=0 tx=0).stop 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 shutdown_connections 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f783806c8f0 0x7f783806edb0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f785415e650 0x7f78540b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f78540d2770 0x7f78540cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 --2- 172.21.15.40:0/1980406307 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f78540cf0a0 0x7f7854152830 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:18.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 >> 172.21.15.40:0/1980406307 conn(0x7f785409d580 msgr2=0x7f78540d0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:18.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 shutdown_connections 2024-04-14T10:02:18.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:18.331+0000 7f785b11e640 1 -- 172.21.15.40:0/1980406307 wait complete. 2024-04-14T10:02:18.340 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2024-04-14T10:02:16.850957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002202"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427762+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427762+0000","last_peered":"2024-04-14T10:00:05.427762+0000","last_clean":"2024-04-14T10:00:05.427762+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427762+0000","last_undegraded":"2024-04-14T10:00:05.427762+0000","last_fullsized":"2024-04-14T10:00:05.427762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428778+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428778+0000","last_peered":"2024-04-14T10:00:06.428778+0000","last_clean":"2024-04-14T10:00:06.428778+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428778+0000","last_undegraded":"2024-04-14T10:00:06.428778+0000","last_fullsized":"2024-04-14T10:00:06.428778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939293+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939293+0000","last_peered":"2024-04-14T10:00:04.939293+0000","last_clean":"2024-04-14T10:00:04.939293+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939293+0000","last_undegraded":"2024-04-14T10:00:04.939293+0000","last_fullsized":"2024-04-14T10:00:04.939293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071225+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071225+0000","last_peered":"2024-04-14T10:00:05.071225+0000","last_clean":"2024-04-14T10:00:05.071225+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071225+0000","last_undegraded":"2024-04-14T10:00:05.071225+0000","last_fullsized":"2024-04-14T10:00:05.071225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071240+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071240+0000","last_peered":"2024-04-14T10:00:05.071240+0000","last_clean":"2024-04-14T10:00:05.071240+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071240+0000","last_undegraded":"2024-04-14T10:00:05.071240+0000","last_fullsized":"2024-04-14T10:00:05.071240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650186+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650186+0000","last_peered":"2024-04-14T10:00:05.650186+0000","last_clean":"2024-04-14T10:00:05.650186+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650186+0000","last_undegraded":"2024-04-14T10:00:05.650186+0000","last_fullsized":"2024-04-14T10:00:05.650186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208386+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208386+0000","last_peered":"2024-04-14T10:00:07.208386+0000","last_clean":"2024-04-14T10:00:07.208386+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208386+0000","last_undegraded":"2024-04-14T10:00:07.208386+0000","last_fullsized":"2024-04-14T10:00:07.208386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427211+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427211+0000","last_peered":"2024-04-14T10:00:05.427211+0000","last_clean":"2024-04-14T10:00:05.427211+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427211+0000","last_undegraded":"2024-04-14T10:00:05.427211+0000","last_fullsized":"2024-04-14T10:00:05.427211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939402+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939402+0000","last_peered":"2024-04-14T10:00:04.939402+0000","last_clean":"2024-04-14T10:00:04.939402+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939402+0000","last_undegraded":"2024-04-14T10:00:04.939402+0000","last_fullsized":"2024-04-14T10:00:04.939402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651181+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651181+0000","last_peered":"2024-04-14T10:00:05.651181+0000","last_clean":"2024-04-14T10:00:05.651181+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651181+0000","last_undegraded":"2024-04-14T10:00:05.651181+0000","last_fullsized":"2024-04-14T10:00:05.651181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232939+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232939+0000","last_peered":"2024-04-14T10:00:09.232939+0000","last_clean":"2024-04-14T10:00:09.232939+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232939+0000","last_undegraded":"2024-04-14T10:00:09.232939+0000","last_fullsized":"2024-04-14T10:00:09.232939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939092+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939092+0000","last_peered":"2024-04-14T10:00:04.939092+0000","last_clean":"2024-04-14T10:00:04.939092+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939092+0000","last_undegraded":"2024-04-14T10:00:04.939092+0000","last_fullsized":"2024-04-14T10:00:04.939092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651173+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651173+0000","last_peered":"2024-04-14T10:00:05.651173+0000","last_clean":"2024-04-14T10:00:05.651173+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651173+0000","last_undegraded":"2024-04-14T10:00:05.651173+0000","last_fullsized":"2024-04-14T10:00:05.651173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651542+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651542+0000","last_peered":"2024-04-14T10:00:05.651542+0000","last_clean":"2024-04-14T10:00:05.651542+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651542+0000","last_undegraded":"2024-04-14T10:00:05.651542+0000","last_fullsized":"2024-04-14T10:00:05.651542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650953+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650953+0000","last_peered":"2024-04-14T10:00:05.650953+0000","last_clean":"2024-04-14T10:00:05.650953+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650953+0000","last_undegraded":"2024-04-14T10:00:05.650953+0000","last_fullsized":"2024-04-14T10:00:05.650953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936736+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936736+0000","last_peered":"2024-04-14T10:00:04.936736+0000","last_clean":"2024-04-14T10:00:04.936736+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936736+0000","last_undegraded":"2024-04-14T10:00:04.936736+0000","last_fullsized":"2024-04-14T10:00:04.936736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937743+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937743+0000","last_peered":"2024-04-14T10:00:04.937743+0000","last_clean":"2024-04-14T10:00:04.937743+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937743+0000","last_undegraded":"2024-04-14T10:00:04.937743+0000","last_fullsized":"2024-04-14T10:00:04.937743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937985+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937985+0000","last_peered":"2024-04-14T10:00:04.937985+0000","last_clean":"2024-04-14T10:00:04.937985+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937985+0000","last_undegraded":"2024-04-14T10:00:04.937985+0000","last_fullsized":"2024-04-14T10:00:04.937985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071266+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071266+0000","last_peered":"2024-04-14T10:00:05.071266+0000","last_clean":"2024-04-14T10:00:05.071266+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071266+0000","last_undegraded":"2024-04-14T10:00:05.071266+0000","last_fullsized":"2024-04-14T10:00:05.071266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937869+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937869+0000","last_peered":"2024-04-14T10:00:04.937869+0000","last_clean":"2024-04-14T10:00:04.937869+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937869+0000","last_undegraded":"2024-04-14T10:00:04.937869+0000","last_fullsized":"2024-04-14T10:00:04.937869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651216+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651216+0000","last_peered":"2024-04-14T10:00:05.651216+0000","last_clean":"2024-04-14T10:00:05.651216+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651216+0000","last_undegraded":"2024-04-14T10:00:05.651216+0000","last_fullsized":"2024-04-14T10:00:05.651216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651764+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651764+0000","last_peered":"2024-04-14T10:00:05.651764+0000","last_clean":"2024-04-14T10:00:05.651764+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651764+0000","last_undegraded":"2024-04-14T10:00:05.651764+0000","last_fullsized":"2024-04-14T10:00:05.651764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042391+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042391+0000","last_peered":"2024-04-14T10:00:09.042391+0000","last_clean":"2024-04-14T10:00:09.042391+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042391+0000","last_undegraded":"2024-04-14T10:00:09.042391+0000","last_fullsized":"2024-04-14T10:00:09.042391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070989+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070989+0000","last_peered":"2024-04-14T10:00:05.070989+0000","last_clean":"2024-04-14T10:00:05.070989+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070989+0000","last_undegraded":"2024-04-14T10:00:05.070989+0000","last_fullsized":"2024-04-14T10:00:05.070989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938019+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.938019+0000","last_peered":"2024-04-14T10:00:04.938019+0000","last_clean":"2024-04-14T10:00:04.938019+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.938019+0000","last_undegraded":"2024-04-14T10:00:04.938019+0000","last_fullsized":"2024-04-14T10:00:04.938019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650549+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650549+0000","last_peered":"2024-04-14T10:00:05.650549+0000","last_clean":"2024-04-14T10:00:05.650549+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650549+0000","last_undegraded":"2024-04-14T10:00:05.650549+0000","last_fullsized":"2024-04-14T10:00:05.650549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937896+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937896+0000","last_peered":"2024-04-14T10:00:04.937896+0000","last_clean":"2024-04-14T10:00:04.937896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937896+0000","last_undegraded":"2024-04-14T10:00:04.937896+0000","last_fullsized":"2024-04-14T10:00:04.937896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236650+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236650+0000","last_peered":"2024-04-14T10:00:06.236650+0000","last_clean":"2024-04-14T10:00:06.236650+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236650+0000","last_undegraded":"2024-04-14T10:00:06.236650+0000","last_fullsized":"2024-04-14T10:00:06.236650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937590+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937590+0000","last_peered":"2024-04-14T10:00:04.937590+0000","last_clean":"2024-04-14T10:00:04.937590+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937590+0000","last_undegraded":"2024-04-14T10:00:04.937590+0000","last_fullsized":"2024-04-14T10:00:04.937590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937977+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937977+0000","last_peered":"2024-04-14T10:00:04.937977+0000","last_clean":"2024-04-14T10:00:04.937977+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937977+0000","last_undegraded":"2024-04-14T10:00:04.937977+0000","last_fullsized":"2024-04-14T10:00:04.937977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011850+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011850+0000","last_peered":"2024-04-14T10:00:10.011850+0000","last_clean":"2024-04-14T10:00:10.011850+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011850+0000","last_undegraded":"2024-04-14T10:00:10.011850+0000","last_fullsized":"2024-04-14T10:00:10.011850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650234+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650234+0000","last_peered":"2024-04-14T10:00:05.650234+0000","last_clean":"2024-04-14T10:00:05.650234+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650234+0000","last_undegraded":"2024-04-14T10:00:05.650234+0000","last_fullsized":"2024-04-14T10:00:05.650234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937324+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937324+0000","last_peered":"2024-04-14T10:00:04.937324+0000","last_clean":"2024-04-14T10:00:04.937324+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937324+0000","last_undegraded":"2024-04-14T10:00:04.937324+0000","last_fullsized":"2024-04-14T10:00:04.937324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938022+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.938022+0000","last_peered":"2024-04-14T10:00:04.938022+0000","last_clean":"2024-04-14T10:00:04.938022+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.938022+0000","last_undegraded":"2024-04-14T10:00:04.938022+0000","last_fullsized":"2024-04-14T10:00:04.938022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650546+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650546+0000","last_peered":"2024-04-14T10:00:05.650546+0000","last_clean":"2024-04-14T10:00:05.650546+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650546+0000","last_undegraded":"2024-04-14T10:00:05.650546+0000","last_fullsized":"2024-04-14T10:00:05.650546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939251+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939251+0000","last_peered":"2024-04-14T10:00:04.939251+0000","last_clean":"2024-04-14T10:00:04.939251+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939251+0000","last_undegraded":"2024-04-14T10:00:04.939251+0000","last_fullsized":"2024-04-14T10:00:04.939251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651557+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651557+0000","last_peered":"2024-04-14T10:00:05.651557+0000","last_clean":"2024-04-14T10:00:05.651557+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651557+0000","last_undegraded":"2024-04-14T10:00:05.651557+0000","last_fullsized":"2024-04-14T10:00:05.651557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650599+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650599+0000","last_peered":"2024-04-14T10:00:05.650599+0000","last_clean":"2024-04-14T10:00:05.650599+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650599+0000","last_undegraded":"2024-04-14T10:00:05.650599+0000","last_fullsized":"2024-04-14T10:00:05.650599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427798+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427798+0000","last_peered":"2024-04-14T10:00:05.427798+0000","last_clean":"2024-04-14T10:00:05.427798+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427798+0000","last_undegraded":"2024-04-14T10:00:05.427798+0000","last_fullsized":"2024-04-14T10:00:05.427798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651268+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651268+0000","last_peered":"2024-04-14T10:00:05.651268+0000","last_clean":"2024-04-14T10:00:05.651268+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651268+0000","last_undegraded":"2024-04-14T10:00:05.651268+0000","last_fullsized":"2024-04-14T10:00:05.651268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938923+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938923+0000","last_peered":"2024-04-14T10:00:04.938923+0000","last_clean":"2024-04-14T10:00:04.938923+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938923+0000","last_undegraded":"2024-04-14T10:00:04.938923+0000","last_fullsized":"2024-04-14T10:00:04.938923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651264+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651264+0000","last_peered":"2024-04-14T10:00:05.651264+0000","last_clean":"2024-04-14T10:00:05.651264+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651264+0000","last_undegraded":"2024-04-14T10:00:05.651264+0000","last_fullsized":"2024-04-14T10:00:05.651264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651042+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651042+0000","last_peered":"2024-04-14T10:00:05.651042+0000","last_clean":"2024-04-14T10:00:05.651042+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651042+0000","last_undegraded":"2024-04-14T10:00:05.651042+0000","last_fullsized":"2024-04-14T10:00:05.651042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937061+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937061+0000","last_peered":"2024-04-14T10:00:04.937061+0000","last_clean":"2024-04-14T10:00:04.937061+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937061+0000","last_undegraded":"2024-04-14T10:00:04.937061+0000","last_fullsized":"2024-04-14T10:00:04.937061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651678+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651678+0000","last_peered":"2024-04-14T10:00:05.651678+0000","last_clean":"2024-04-14T10:00:05.651678+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651678+0000","last_undegraded":"2024-04-14T10:00:05.651678+0000","last_fullsized":"2024-04-14T10:00:05.651678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650259+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650259+0000","last_peered":"2024-04-14T10:00:05.650259+0000","last_clean":"2024-04-14T10:00:05.650259+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650259+0000","last_undegraded":"2024-04-14T10:00:05.650259+0000","last_fullsized":"2024-04-14T10:00:05.650259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427435+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427435+0000","last_peered":"2024-04-14T10:00:05.427435+0000","last_clean":"2024-04-14T10:00:05.427435+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427435+0000","last_undegraded":"2024-04-14T10:00:05.427435+0000","last_fullsized":"2024-04-14T10:00:05.427435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651041+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651041+0000","last_peered":"2024-04-14T10:00:05.651041+0000","last_clean":"2024-04-14T10:00:05.651041+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651041+0000","last_undegraded":"2024-04-14T10:00:05.651041+0000","last_fullsized":"2024-04-14T10:00:05.651041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071200+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071200+0000","last_peered":"2024-04-14T10:00:05.071200+0000","last_clean":"2024-04-14T10:00:05.071200+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071200+0000","last_undegraded":"2024-04-14T10:00:05.071200+0000","last_fullsized":"2024-04-14T10:00:05.071200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427828+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427828+0000","last_peered":"2024-04-14T10:00:05.427828+0000","last_clean":"2024-04-14T10:00:05.427828+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427828+0000","last_undegraded":"2024-04-14T10:00:05.427828+0000","last_fullsized":"2024-04-14T10:00:05.427828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029473+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029473+0000","last_peered":"2024-04-14T10:00:07.029473+0000","last_clean":"2024-04-14T10:00:07.029473+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029473+0000","last_undegraded":"2024-04-14T10:00:07.029473+0000","last_fullsized":"2024-04-14T10:00:07.029473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651374+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651374+0000","last_peered":"2024-04-14T10:00:05.651374+0000","last_clean":"2024-04-14T10:00:05.651374+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651374+0000","last_undegraded":"2024-04-14T10:00:05.651374+0000","last_fullsized":"2024-04-14T10:00:05.651374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939303+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939303+0000","last_peered":"2024-04-14T10:00:04.939303+0000","last_clean":"2024-04-14T10:00:04.939303+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939303+0000","last_undegraded":"2024-04-14T10:00:04.939303+0000","last_fullsized":"2024-04-14T10:00:04.939303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651178+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651178+0000","last_peered":"2024-04-14T10:00:05.651178+0000","last_clean":"2024-04-14T10:00:05.651178+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651178+0000","last_undegraded":"2024-04-14T10:00:05.651178+0000","last_fullsized":"2024-04-14T10:00:05.651178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651071+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651071+0000","last_peered":"2024-04-14T10:00:05.651071+0000","last_clean":"2024-04-14T10:00:05.651071+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651071+0000","last_undegraded":"2024-04-14T10:00:05.651071+0000","last_fullsized":"2024-04-14T10:00:05.651071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427656+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427656+0000","last_peered":"2024-04-14T10:00:05.427656+0000","last_clean":"2024-04-14T10:00:05.427656+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427656+0000","last_undegraded":"2024-04-14T10:00:05.427656+0000","last_fullsized":"2024-04-14T10:00:05.427656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938976+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938976+0000","last_peered":"2024-04-14T10:00:04.938976+0000","last_clean":"2024-04-14T10:00:04.938976+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938976+0000","last_undegraded":"2024-04-14T10:00:04.938976+0000","last_fullsized":"2024-04-14T10:00:04.938976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427697+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427697+0000","last_peered":"2024-04-14T10:00:05.427697+0000","last_clean":"2024-04-14T10:00:05.427697+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427697+0000","last_undegraded":"2024-04-14T10:00:05.427697+0000","last_fullsized":"2024-04-14T10:00:05.427697+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427256+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427256+0000","last_peered":"2024-04-14T10:00:05.427256+0000","last_clean":"2024-04-14T10:00:05.427256+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427256+0000","last_undegraded":"2024-04-14T10:00:05.427256+0000","last_fullsized":"2024-04-14T10:00:05.427256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650195+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650195+0000","last_peered":"2024-04-14T10:00:05.650195+0000","last_clean":"2024-04-14T10:00:05.650195+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650195+0000","last_undegraded":"2024-04-14T10:00:05.650195+0000","last_fullsized":"2024-04-14T10:00:05.650195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024685+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024685+0000","last_peered":"2024-04-14T10:00:06.024685+0000","last_clean":"2024-04-14T10:00:06.024685+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024685+0000","last_undegraded":"2024-04-14T10:00:06.024685+0000","last_fullsized":"2024-04-14T10:00:06.024685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937403+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937403+0000","last_peered":"2024-04-14T10:00:04.937403+0000","last_clean":"2024-04-14T10:00:04.937403+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937403+0000","last_undegraded":"2024-04-14T10:00:04.937403+0000","last_fullsized":"2024-04-14T10:00:04.937403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427444+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427444+0000","last_peered":"2024-04-14T10:00:05.427444+0000","last_clean":"2024-04-14T10:00:05.427444+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427444+0000","last_undegraded":"2024-04-14T10:00:05.427444+0000","last_fullsized":"2024-04-14T10:00:05.427444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936785+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936785+0000","last_peered":"2024-04-14T10:00:04.936785+0000","last_clean":"2024-04-14T10:00:04.936785+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936785+0000","last_undegraded":"2024-04-14T10:00:04.936785+0000","last_fullsized":"2024-04-14T10:00:04.936785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427588+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427588+0000","last_peered":"2024-04-14T10:00:05.427588+0000","last_clean":"2024-04-14T10:00:05.427588+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427588+0000","last_undegraded":"2024-04-14T10:00:05.427588+0000","last_fullsized":"2024-04-14T10:00:05.427588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651389+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651389+0000","last_peered":"2024-04-14T10:00:05.651389+0000","last_clean":"2024-04-14T10:00:05.651389+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651389+0000","last_undegraded":"2024-04-14T10:00:05.651389+0000","last_fullsized":"2024-04-14T10:00:05.651389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651089+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651089+0000","last_peered":"2024-04-14T10:00:05.651089+0000","last_clean":"2024-04-14T10:00:05.651089+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651089+0000","last_undegraded":"2024-04-14T10:00:05.651089+0000","last_fullsized":"2024-04-14T10:00:05.651089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651643+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651643+0000","last_peered":"2024-04-14T10:00:05.651643+0000","last_clean":"2024-04-14T10:00:05.651643+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651643+0000","last_undegraded":"2024-04-14T10:00:05.651643+0000","last_fullsized":"2024-04-14T10:00:05.651643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651478+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651478+0000","last_peered":"2024-04-14T10:00:05.651478+0000","last_clean":"2024-04-14T10:00:05.651478+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651478+0000","last_undegraded":"2024-04-14T10:00:05.651478+0000","last_fullsized":"2024-04-14T10:00:05.651478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071269+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071269+0000","last_peered":"2024-04-14T10:00:05.071269+0000","last_clean":"2024-04-14T10:00:05.071269+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071269+0000","last_undegraded":"2024-04-14T10:00:05.071269+0000","last_fullsized":"2024-04-14T10:00:05.071269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071394+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071394+0000","last_peered":"2024-04-14T10:00:05.071394+0000","last_clean":"2024-04-14T10:00:05.071394+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071394+0000","last_undegraded":"2024-04-14T10:00:05.071394+0000","last_fullsized":"2024-04-14T10:00:05.071394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650406+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650406+0000","last_peered":"2024-04-14T10:00:05.650406+0000","last_clean":"2024-04-14T10:00:05.650406+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650406+0000","last_undegraded":"2024-04-14T10:00:05.650406+0000","last_fullsized":"2024-04-14T10:00:05.650406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070233+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070233+0000","last_peered":"2024-04-14T10:00:05.070233+0000","last_clean":"2024-04-14T10:00:05.070233+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070233+0000","last_undegraded":"2024-04-14T10:00:05.070233+0000","last_fullsized":"2024-04-14T10:00:05.070233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938986+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938986+0000","last_peered":"2024-04-14T10:00:04.938986+0000","last_clean":"2024-04-14T10:00:04.938986+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938986+0000","last_undegraded":"2024-04-14T10:00:04.938986+0000","last_fullsized":"2024-04-14T10:00:04.938986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070983+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070983+0000","last_peered":"2024-04-14T10:00:05.070983+0000","last_clean":"2024-04-14T10:00:05.070983+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070983+0000","last_undegraded":"2024-04-14T10:00:05.070983+0000","last_fullsized":"2024-04-14T10:00:05.070983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200991+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200991+0000","last_peered":"2024-04-14T10:00:08.200991+0000","last_clean":"2024-04-14T10:00:08.200991+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200991+0000","last_undegraded":"2024-04-14T10:00:08.200991+0000","last_fullsized":"2024-04-14T10:00:08.200991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937010+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.937010+0000","last_peered":"2024-04-14T10:00:04.937010+0000","last_clean":"2024-04-14T10:00:04.937010+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.937010+0000","last_undegraded":"2024-04-14T10:00:04.937010+0000","last_fullsized":"2024-04-14T10:00:04.937010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427690+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427690+0000","last_peered":"2024-04-14T10:00:05.427690+0000","last_clean":"2024-04-14T10:00:05.427690+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427690+0000","last_undegraded":"2024-04-14T10:00:05.427690+0000","last_fullsized":"2024-04-14T10:00:05.427690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071008+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.071008+0000","last_peered":"2024-04-14T10:00:05.071008+0000","last_clean":"2024-04-14T10:00:05.071008+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.071008+0000","last_undegraded":"2024-04-14T10:00:05.071008+0000","last_fullsized":"2024-04-14T10:00:05.071008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650297+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650297+0000","last_peered":"2024-04-14T10:00:05.650297+0000","last_clean":"2024-04-14T10:00:05.650297+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650297+0000","last_undegraded":"2024-04-14T10:00:05.650297+0000","last_fullsized":"2024-04-14T10:00:05.650297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992266+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992266+0000","last_peered":"2024-04-14T10:00:07.992266+0000","last_clean":"2024-04-14T10:00:07.992266+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992266+0000","last_undegraded":"2024-04-14T10:00:07.992266+0000","last_fullsized":"2024-04-14T10:00:07.992266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071339+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071339+0000","last_peered":"2024-04-14T10:00:05.071339+0000","last_clean":"2024-04-14T10:00:05.071339+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071339+0000","last_undegraded":"2024-04-14T10:00:05.071339+0000","last_fullsized":"2024-04-14T10:00:05.071339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394029+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394029+0000","last_peered":"2024-04-14T10:00:07.394029+0000","last_clean":"2024-04-14T10:00:07.394029+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394029+0000","last_undegraded":"2024-04-14T10:00:07.394029+0000","last_fullsized":"2024-04-14T10:00:07.394029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939257+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939257+0000","last_peered":"2024-04-14T10:00:04.939257+0000","last_clean":"2024-04-14T10:00:04.939257+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939257+0000","last_undegraded":"2024-04-14T10:00:04.939257+0000","last_fullsized":"2024-04-14T10:00:04.939257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939267+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939267+0000","last_peered":"2024-04-14T10:00:04.939267+0000","last_clean":"2024-04-14T10:00:04.939267+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939267+0000","last_undegraded":"2024-04-14T10:00:04.939267+0000","last_fullsized":"2024-04-14T10:00:04.939267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939238+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939238+0000","last_peered":"2024-04-14T10:00:04.939238+0000","last_clean":"2024-04-14T10:00:04.939238+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939238+0000","last_undegraded":"2024-04-14T10:00:04.939238+0000","last_fullsized":"2024-04-14T10:00:04.939238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650147+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650147+0000","last_peered":"2024-04-14T10:00:05.650147+0000","last_clean":"2024-04-14T10:00:05.650147+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650147+0000","last_undegraded":"2024-04-14T10:00:05.650147+0000","last_fullsized":"2024-04-14T10:00:05.650147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937822+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937822+0000","last_peered":"2024-04-14T10:00:04.937822+0000","last_clean":"2024-04-14T10:00:04.937822+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937822+0000","last_undegraded":"2024-04-14T10:00:04.937822+0000","last_fullsized":"2024-04-14T10:00:04.937822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651632+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651632+0000","last_peered":"2024-04-14T10:00:05.651632+0000","last_clean":"2024-04-14T10:00:05.651632+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651632+0000","last_undegraded":"2024-04-14T10:00:05.651632+0000","last_fullsized":"2024-04-14T10:00:05.651632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650921+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650921+0000","last_peered":"2024-04-14T10:00:05.650921+0000","last_clean":"2024-04-14T10:00:05.650921+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650921+0000","last_undegraded":"2024-04-14T10:00:05.650921+0000","last_fullsized":"2024-04-14T10:00:05.650921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937188+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937188+0000","last_peered":"2024-04-14T10:00:04.937188+0000","last_clean":"2024-04-14T10:00:04.937188+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937188+0000","last_undegraded":"2024-04-14T10:00:04.937188+0000","last_fullsized":"2024-04-14T10:00:04.937188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427262+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427262+0000","last_peered":"2024-04-14T10:00:05.427262+0000","last_clean":"2024-04-14T10:00:05.427262+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427262+0000","last_undegraded":"2024-04-14T10:00:05.427262+0000","last_fullsized":"2024-04-14T10:00:05.427262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.435394+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.435394+0000","last_peered":"2024-04-14T10:00:05.435394+0000","last_clean":"2024-04-14T10:00:05.435394+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.435394+0000","last_undegraded":"2024-04-14T10:00:05.435394+0000","last_fullsized":"2024-04-14T10:00:05.435394+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937407+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937407+0000","last_peered":"2024-04-14T10:00:04.937407+0000","last_clean":"2024-04-14T10:00:04.937407+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937407+0000","last_undegraded":"2024-04-14T10:00:04.937407+0000","last_fullsized":"2024-04-14T10:00:04.937407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:14.837176+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:14.837176+0000","last_peered":"2024-04-14T10:00:14.837176+0000","last_clean":"2024-04-14T10:00:14.837176+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:14.837176+0000","last_undegraded":"2024-04-14T10:00:14.837176+0000","last_fullsized":"2024-04-14T10:00:14.837176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:02:18.346 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:02:18.347 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:02:23.122 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:02:23.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:02:38.348 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:02:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.463+0000 7fb5665c8640 1 Processor -- start 2024-04-14T10:02:38.463 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.463+0000 7fb5665c8640 1 -- start start 2024-04-14T10:02:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb5665c8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb5600b22d0 0x7fb56015b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb5665c8640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56015fb10 con 0x7fb56013dfb0 2024-04-14T10:02:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb5665c8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb56013e390 con 0x7fb56015bd70 2024-04-14T10:02:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb5665c8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb56015ed50 con 0x7fb5600b22d0 2024-04-14T10:02:38.465 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb55ffff640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fb56013dfb0 0x7fb5600b1bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:43540/0 (socket says 172.21.15.40:43540) 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb55ffff640 1 -- 172.21.15.40:0/819049406 learned_addr learned my addr 172.21.15.40:0/819049406 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb55f7fe640 1 --2- 172.21.15.40:0/819049406 >> v2:172.21.15.136:3300/0 conn(0x7fb5600b22d0 0x7fb56015b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274188317 0 0) 0x7fb56015fb10 con 0x7fb56013dfb0 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.464+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb548003520 con 0x7fb56013dfb0 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756004724 0 0) 0x7fb56013e390 con 0x7fb56015bd70 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb56015fb10 con 0x7fb56015bd70 2024-04-14T10:02:38.466 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55f7fe640 1 -- 172.21.15.40:0/819049406 >> v1:172.21.15.136:6789/0 conn(0x7fb56015bd70 legacy=0x7fb5600ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55f7fe640 1 -- 172.21.15.40:0/819049406 >> v1:172.21.15.40:6789/0 conn(0x7fb56013dfb0 legacy=0x7fb5600b1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55f7fe640 1 -- 172.21.15.40:0/819049406 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56015f030 con 0x7fb5600b22d0 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.465+0000 7fb55f7fe640 1 --2- 172.21.15.40:0/819049406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5600b22d0 0x7fb56015b830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5500097a0 tx=0x7fb55002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e741e93f136c688f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550035020 con 0x7fb5600b22d0 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb550031830 con 0x7fb5600b22d0 2024-04-14T10:02:38.467 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb55effd640 1 -- 172.21.15.40:0/819049406 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb550031c00 con 0x7fb5600b22d0 2024-04-14T10:02:38.470 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 -- 172.21.15.40:0/819049406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5600b22d0 msgr2=0x7fb56015b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 --2- 172.21.15.40:0/819049406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5600b22d0 0x7fb56015b830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb5500097a0 tx=0x7fb55002b8d0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 -- 172.21.15.40:0/819049406 shutdown_connections 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 --2- 172.21.15.40:0/819049406 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb5600b22d0 0x7fb56015b830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 -- 172.21.15.40:0/819049406 >> 172.21.15.40:0/819049406 conn(0x7fb56006ebf0 msgr2=0x7fb56006b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 -- 172.21.15.40:0/819049406 shutdown_connections 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.466+0000 7fb5665c8640 1 -- 172.21.15.40:0/819049406 wait complete. 2024-04-14T10:02:38.471 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.467+0000 7fb5665c8640 1 Processor -- start 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 -- start start 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5600b22d0 0x7fb5601f4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb56013dfb0 0x7fb560158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fb56015c1a0 con 0x7fb56015bd70 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb56015f5f0 con 0x7fb56013dfb0 2024-04-14T10:02:38.472 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb5665c8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb56015c320 con 0x7fb5600b22d0 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.468+0000 7fb564b65640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53740/0 (socket says 172.21.15.40:53740) 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 -- 172.21.15.40:0/1628280863 learned_addr learned my addr 172.21.15.40:0/1628280863 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb55ffff640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5600b22d0 0x7fb5601f4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb55f7fe640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb56013dfb0 0x7fb560158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 -- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5600b22d0 msgr2=0x7fb5601f4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5600b22d0 0x7fb5601f4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.473 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 -- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb56013dfb0 msgr2=0x7fb560158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb56013dfb0 0x7fb560158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 -- 172.21.15.40:0/1628280863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb560159430 con 0x7fb56015bd70 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb564b65640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb55800c6e0 tx=0x7fb55800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb558003b70 con 0x7fb56015bd70 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb558003d10 con 0x7fb56015bd70 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb560159710 con 0x7fb56015bd70 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5580052d0 con 0x7fb56015bd70 2024-04-14T10:02:38.474 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.469+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb560072fa0 con 0x7fb56015bd70 2024-04-14T10:02:38.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.471+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5600756f0 con 0x7fb56015bd70 2024-04-14T10:02:38.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.471+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb558005470 con 0x7fb56015bd70 2024-04-14T10:02:38.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.471+0000 7fb55cff9640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.471+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fb55808b9e0 con 0x7fb56015bd70 2024-04-14T10:02:38.475 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.472+0000 7fb55ffff640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.472+0000 7fb55ffff640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5540011e0 tx=0x7fb554007d30 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.476 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.476+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fb5580596a0 con 0x7fb56015bd70 2024-04-14T10:02:38.657 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.658+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb56006c210 con 0x7fb54c06c8f0 2024-04-14T10:02:38.664 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.664+0000 7fb55cff9640 1 -- 172.21.15.40:0/1628280863 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7fb56006c210 con 0x7fb54c06c8f0 2024-04-14T10:02:38.667 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:02:38.668 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:02:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 msgr2=0x7fb54c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 0x7fb54c06edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb5540011e0 tx=0x7fb554007d30 comp rx=0 tx=0).stop 2024-04-14T10:02:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 msgr2=0x7fb56013a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb55800c6e0 tx=0x7fb55800cba0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.670 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 shutdown_connections 2024-04-14T10:02:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fb54c06c8f0 0x7fb54c06edb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fb56015bd70 0x7fb56013a6a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb56013dfb0 0x7fb560158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.671 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 --2- 172.21.15.40:0/1628280863 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb5600b22d0 0x7fb5601f4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 >> 172.21.15.40:0/1628280863 conn(0x7fb56006ebf0 msgr2=0x7fb560138020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 shutdown_connections 2024-04-14T10:02:38.672 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.667+0000 7fb5665c8640 1 -- 172.21.15.40:0/1628280863 wait complete. 2024-04-14T10:02:38.678 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-04-14T10:02:36.854202+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002037"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427762+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427762+0000","last_peered":"2024-04-14T10:00:05.427762+0000","last_clean":"2024-04-14T10:00:05.427762+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427762+0000","last_undegraded":"2024-04-14T10:00:05.427762+0000","last_fullsized":"2024-04-14T10:00:05.427762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428778+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428778+0000","last_peered":"2024-04-14T10:00:06.428778+0000","last_clean":"2024-04-14T10:00:06.428778+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428778+0000","last_undegraded":"2024-04-14T10:00:06.428778+0000","last_fullsized":"2024-04-14T10:00:06.428778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939293+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939293+0000","last_peered":"2024-04-14T10:00:04.939293+0000","last_clean":"2024-04-14T10:00:04.939293+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939293+0000","last_undegraded":"2024-04-14T10:00:04.939293+0000","last_fullsized":"2024-04-14T10:00:04.939293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071225+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071225+0000","last_peered":"2024-04-14T10:00:05.071225+0000","last_clean":"2024-04-14T10:00:05.071225+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071225+0000","last_undegraded":"2024-04-14T10:00:05.071225+0000","last_fullsized":"2024-04-14T10:00:05.071225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071240+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071240+0000","last_peered":"2024-04-14T10:00:05.071240+0000","last_clean":"2024-04-14T10:00:05.071240+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071240+0000","last_undegraded":"2024-04-14T10:00:05.071240+0000","last_fullsized":"2024-04-14T10:00:05.071240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650186+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650186+0000","last_peered":"2024-04-14T10:00:05.650186+0000","last_clean":"2024-04-14T10:00:05.650186+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650186+0000","last_undegraded":"2024-04-14T10:00:05.650186+0000","last_fullsized":"2024-04-14T10:00:05.650186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208386+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208386+0000","last_peered":"2024-04-14T10:00:07.208386+0000","last_clean":"2024-04-14T10:00:07.208386+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208386+0000","last_undegraded":"2024-04-14T10:00:07.208386+0000","last_fullsized":"2024-04-14T10:00:07.208386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427211+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427211+0000","last_peered":"2024-04-14T10:00:05.427211+0000","last_clean":"2024-04-14T10:00:05.427211+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427211+0000","last_undegraded":"2024-04-14T10:00:05.427211+0000","last_fullsized":"2024-04-14T10:00:05.427211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939402+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939402+0000","last_peered":"2024-04-14T10:00:04.939402+0000","last_clean":"2024-04-14T10:00:04.939402+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939402+0000","last_undegraded":"2024-04-14T10:00:04.939402+0000","last_fullsized":"2024-04-14T10:00:04.939402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651181+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651181+0000","last_peered":"2024-04-14T10:00:05.651181+0000","last_clean":"2024-04-14T10:00:05.651181+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651181+0000","last_undegraded":"2024-04-14T10:00:05.651181+0000","last_fullsized":"2024-04-14T10:00:05.651181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232939+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232939+0000","last_peered":"2024-04-14T10:00:09.232939+0000","last_clean":"2024-04-14T10:00:09.232939+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232939+0000","last_undegraded":"2024-04-14T10:00:09.232939+0000","last_fullsized":"2024-04-14T10:00:09.232939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939092+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939092+0000","last_peered":"2024-04-14T10:00:04.939092+0000","last_clean":"2024-04-14T10:00:04.939092+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939092+0000","last_undegraded":"2024-04-14T10:00:04.939092+0000","last_fullsized":"2024-04-14T10:00:04.939092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651173+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651173+0000","last_peered":"2024-04-14T10:00:05.651173+0000","last_clean":"2024-04-14T10:00:05.651173+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651173+0000","last_undegraded":"2024-04-14T10:00:05.651173+0000","last_fullsized":"2024-04-14T10:00:05.651173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651542+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651542+0000","last_peered":"2024-04-14T10:00:05.651542+0000","last_clean":"2024-04-14T10:00:05.651542+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651542+0000","last_undegraded":"2024-04-14T10:00:05.651542+0000","last_fullsized":"2024-04-14T10:00:05.651542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650953+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650953+0000","last_peered":"2024-04-14T10:00:05.650953+0000","last_clean":"2024-04-14T10:00:05.650953+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650953+0000","last_undegraded":"2024-04-14T10:00:05.650953+0000","last_fullsized":"2024-04-14T10:00:05.650953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936736+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936736+0000","last_peered":"2024-04-14T10:00:04.936736+0000","last_clean":"2024-04-14T10:00:04.936736+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936736+0000","last_undegraded":"2024-04-14T10:00:04.936736+0000","last_fullsized":"2024-04-14T10:00:04.936736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937743+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937743+0000","last_peered":"2024-04-14T10:00:04.937743+0000","last_clean":"2024-04-14T10:00:04.937743+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937743+0000","last_undegraded":"2024-04-14T10:00:04.937743+0000","last_fullsized":"2024-04-14T10:00:04.937743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937985+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937985+0000","last_peered":"2024-04-14T10:00:04.937985+0000","last_clean":"2024-04-14T10:00:04.937985+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937985+0000","last_undegraded":"2024-04-14T10:00:04.937985+0000","last_fullsized":"2024-04-14T10:00:04.937985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071266+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071266+0000","last_peered":"2024-04-14T10:00:05.071266+0000","last_clean":"2024-04-14T10:00:05.071266+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071266+0000","last_undegraded":"2024-04-14T10:00:05.071266+0000","last_fullsized":"2024-04-14T10:00:05.071266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937869+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937869+0000","last_peered":"2024-04-14T10:00:04.937869+0000","last_clean":"2024-04-14T10:00:04.937869+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937869+0000","last_undegraded":"2024-04-14T10:00:04.937869+0000","last_fullsized":"2024-04-14T10:00:04.937869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651216+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651216+0000","last_peered":"2024-04-14T10:00:05.651216+0000","last_clean":"2024-04-14T10:00:05.651216+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651216+0000","last_undegraded":"2024-04-14T10:00:05.651216+0000","last_fullsized":"2024-04-14T10:00:05.651216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651764+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651764+0000","last_peered":"2024-04-14T10:00:05.651764+0000","last_clean":"2024-04-14T10:00:05.651764+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651764+0000","last_undegraded":"2024-04-14T10:00:05.651764+0000","last_fullsized":"2024-04-14T10:00:05.651764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042391+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042391+0000","last_peered":"2024-04-14T10:00:09.042391+0000","last_clean":"2024-04-14T10:00:09.042391+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042391+0000","last_undegraded":"2024-04-14T10:00:09.042391+0000","last_fullsized":"2024-04-14T10:00:09.042391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070989+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070989+0000","last_peered":"2024-04-14T10:00:05.070989+0000","last_clean":"2024-04-14T10:00:05.070989+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070989+0000","last_undegraded":"2024-04-14T10:00:05.070989+0000","last_fullsized":"2024-04-14T10:00:05.070989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938019+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.938019+0000","last_peered":"2024-04-14T10:00:04.938019+0000","last_clean":"2024-04-14T10:00:04.938019+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.938019+0000","last_undegraded":"2024-04-14T10:00:04.938019+0000","last_fullsized":"2024-04-14T10:00:04.938019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650549+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650549+0000","last_peered":"2024-04-14T10:00:05.650549+0000","last_clean":"2024-04-14T10:00:05.650549+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650549+0000","last_undegraded":"2024-04-14T10:00:05.650549+0000","last_fullsized":"2024-04-14T10:00:05.650549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937896+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937896+0000","last_peered":"2024-04-14T10:00:04.937896+0000","last_clean":"2024-04-14T10:00:04.937896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937896+0000","last_undegraded":"2024-04-14T10:00:04.937896+0000","last_fullsized":"2024-04-14T10:00:04.937896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236650+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236650+0000","last_peered":"2024-04-14T10:00:06.236650+0000","last_clean":"2024-04-14T10:00:06.236650+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236650+0000","last_undegraded":"2024-04-14T10:00:06.236650+0000","last_fullsized":"2024-04-14T10:00:06.236650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937590+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937590+0000","last_peered":"2024-04-14T10:00:04.937590+0000","last_clean":"2024-04-14T10:00:04.937590+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937590+0000","last_undegraded":"2024-04-14T10:00:04.937590+0000","last_fullsized":"2024-04-14T10:00:04.937590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937977+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937977+0000","last_peered":"2024-04-14T10:00:04.937977+0000","last_clean":"2024-04-14T10:00:04.937977+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937977+0000","last_undegraded":"2024-04-14T10:00:04.937977+0000","last_fullsized":"2024-04-14T10:00:04.937977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011850+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011850+0000","last_peered":"2024-04-14T10:00:10.011850+0000","last_clean":"2024-04-14T10:00:10.011850+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011850+0000","last_undegraded":"2024-04-14T10:00:10.011850+0000","last_fullsized":"2024-04-14T10:00:10.011850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650234+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650234+0000","last_peered":"2024-04-14T10:00:05.650234+0000","last_clean":"2024-04-14T10:00:05.650234+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650234+0000","last_undegraded":"2024-04-14T10:00:05.650234+0000","last_fullsized":"2024-04-14T10:00:05.650234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937324+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937324+0000","last_peered":"2024-04-14T10:00:04.937324+0000","last_clean":"2024-04-14T10:00:04.937324+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937324+0000","last_undegraded":"2024-04-14T10:00:04.937324+0000","last_fullsized":"2024-04-14T10:00:04.937324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938022+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.938022+0000","last_peered":"2024-04-14T10:00:04.938022+0000","last_clean":"2024-04-14T10:00:04.938022+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.938022+0000","last_undegraded":"2024-04-14T10:00:04.938022+0000","last_fullsized":"2024-04-14T10:00:04.938022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650546+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650546+0000","last_peered":"2024-04-14T10:00:05.650546+0000","last_clean":"2024-04-14T10:00:05.650546+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650546+0000","last_undegraded":"2024-04-14T10:00:05.650546+0000","last_fullsized":"2024-04-14T10:00:05.650546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939251+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939251+0000","last_peered":"2024-04-14T10:00:04.939251+0000","last_clean":"2024-04-14T10:00:04.939251+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939251+0000","last_undegraded":"2024-04-14T10:00:04.939251+0000","last_fullsized":"2024-04-14T10:00:04.939251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651557+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651557+0000","last_peered":"2024-04-14T10:00:05.651557+0000","last_clean":"2024-04-14T10:00:05.651557+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651557+0000","last_undegraded":"2024-04-14T10:00:05.651557+0000","last_fullsized":"2024-04-14T10:00:05.651557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650599+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650599+0000","last_peered":"2024-04-14T10:00:05.650599+0000","last_clean":"2024-04-14T10:00:05.650599+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650599+0000","last_undegraded":"2024-04-14T10:00:05.650599+0000","last_fullsized":"2024-04-14T10:00:05.650599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427798+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427798+0000","last_peered":"2024-04-14T10:00:05.427798+0000","last_clean":"2024-04-14T10:00:05.427798+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427798+0000","last_undegraded":"2024-04-14T10:00:05.427798+0000","last_fullsized":"2024-04-14T10:00:05.427798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651268+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651268+0000","last_peered":"2024-04-14T10:00:05.651268+0000","last_clean":"2024-04-14T10:00:05.651268+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651268+0000","last_undegraded":"2024-04-14T10:00:05.651268+0000","last_fullsized":"2024-04-14T10:00:05.651268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938923+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938923+0000","last_peered":"2024-04-14T10:00:04.938923+0000","last_clean":"2024-04-14T10:00:04.938923+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938923+0000","last_undegraded":"2024-04-14T10:00:04.938923+0000","last_fullsized":"2024-04-14T10:00:04.938923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651264+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651264+0000","last_peered":"2024-04-14T10:00:05.651264+0000","last_clean":"2024-04-14T10:00:05.651264+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651264+0000","last_undegraded":"2024-04-14T10:00:05.651264+0000","last_fullsized":"2024-04-14T10:00:05.651264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651042+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651042+0000","last_peered":"2024-04-14T10:00:05.651042+0000","last_clean":"2024-04-14T10:00:05.651042+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651042+0000","last_undegraded":"2024-04-14T10:00:05.651042+0000","last_fullsized":"2024-04-14T10:00:05.651042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937061+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937061+0000","last_peered":"2024-04-14T10:00:04.937061+0000","last_clean":"2024-04-14T10:00:04.937061+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937061+0000","last_undegraded":"2024-04-14T10:00:04.937061+0000","last_fullsized":"2024-04-14T10:00:04.937061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651678+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651678+0000","last_peered":"2024-04-14T10:00:05.651678+0000","last_clean":"2024-04-14T10:00:05.651678+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651678+0000","last_undegraded":"2024-04-14T10:00:05.651678+0000","last_fullsized":"2024-04-14T10:00:05.651678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650259+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650259+0000","last_peered":"2024-04-14T10:00:05.650259+0000","last_clean":"2024-04-14T10:00:05.650259+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650259+0000","last_undegraded":"2024-04-14T10:00:05.650259+0000","last_fullsized":"2024-04-14T10:00:05.650259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427435+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427435+0000","last_peered":"2024-04-14T10:00:05.427435+0000","last_clean":"2024-04-14T10:00:05.427435+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427435+0000","last_undegraded":"2024-04-14T10:00:05.427435+0000","last_fullsized":"2024-04-14T10:00:05.427435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651041+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651041+0000","last_peered":"2024-04-14T10:00:05.651041+0000","last_clean":"2024-04-14T10:00:05.651041+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651041+0000","last_undegraded":"2024-04-14T10:00:05.651041+0000","last_fullsized":"2024-04-14T10:00:05.651041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071200+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071200+0000","last_peered":"2024-04-14T10:00:05.071200+0000","last_clean":"2024-04-14T10:00:05.071200+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071200+0000","last_undegraded":"2024-04-14T10:00:05.071200+0000","last_fullsized":"2024-04-14T10:00:05.071200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427828+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427828+0000","last_peered":"2024-04-14T10:00:05.427828+0000","last_clean":"2024-04-14T10:00:05.427828+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427828+0000","last_undegraded":"2024-04-14T10:00:05.427828+0000","last_fullsized":"2024-04-14T10:00:05.427828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029473+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029473+0000","last_peered":"2024-04-14T10:00:07.029473+0000","last_clean":"2024-04-14T10:00:07.029473+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029473+0000","last_undegraded":"2024-04-14T10:00:07.029473+0000","last_fullsized":"2024-04-14T10:00:07.029473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651374+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651374+0000","last_peered":"2024-04-14T10:00:05.651374+0000","last_clean":"2024-04-14T10:00:05.651374+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651374+0000","last_undegraded":"2024-04-14T10:00:05.651374+0000","last_fullsized":"2024-04-14T10:00:05.651374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939303+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939303+0000","last_peered":"2024-04-14T10:00:04.939303+0000","last_clean":"2024-04-14T10:00:04.939303+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939303+0000","last_undegraded":"2024-04-14T10:00:04.939303+0000","last_fullsized":"2024-04-14T10:00:04.939303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651178+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651178+0000","last_peered":"2024-04-14T10:00:05.651178+0000","last_clean":"2024-04-14T10:00:05.651178+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651178+0000","last_undegraded":"2024-04-14T10:00:05.651178+0000","last_fullsized":"2024-04-14T10:00:05.651178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651071+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651071+0000","last_peered":"2024-04-14T10:00:05.651071+0000","last_clean":"2024-04-14T10:00:05.651071+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651071+0000","last_undegraded":"2024-04-14T10:00:05.651071+0000","last_fullsized":"2024-04-14T10:00:05.651071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427656+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427656+0000","last_peered":"2024-04-14T10:00:05.427656+0000","last_clean":"2024-04-14T10:00:05.427656+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427656+0000","last_undegraded":"2024-04-14T10:00:05.427656+0000","last_fullsized":"2024-04-14T10:00:05.427656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938976+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938976+0000","last_peered":"2024-04-14T10:00:04.938976+0000","last_clean":"2024-04-14T10:00:04.938976+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938976+0000","last_undegraded":"2024-04-14T10:00:04.938976+0000","last_fullsized":"2024-04-14T10:00:04.938976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427697+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427697+0000","last_peered":"2024-04-14T10:00:05.427697+0000","last_clean":"2024-04-14T10:00:05.427697+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427697+0000","last_undegraded":"2024-04-14T10:00:05.427697+0000","last_fullsized":"2024-04-14T10:00:05.427697+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427256+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427256+0000","last_peered":"2024-04-14T10:00:05.427256+0000","last_clean":"2024-04-14T10:00:05.427256+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427256+0000","last_undegraded":"2024-04-14T10:00:05.427256+0000","last_fullsized":"2024-04-14T10:00:05.427256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650195+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650195+0000","last_peered":"2024-04-14T10:00:05.650195+0000","last_clean":"2024-04-14T10:00:05.650195+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650195+0000","last_undegraded":"2024-04-14T10:00:05.650195+0000","last_fullsized":"2024-04-14T10:00:05.650195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024685+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024685+0000","last_peered":"2024-04-14T10:00:06.024685+0000","last_clean":"2024-04-14T10:00:06.024685+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024685+0000","last_undegraded":"2024-04-14T10:00:06.024685+0000","last_fullsized":"2024-04-14T10:00:06.024685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937403+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937403+0000","last_peered":"2024-04-14T10:00:04.937403+0000","last_clean":"2024-04-14T10:00:04.937403+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937403+0000","last_undegraded":"2024-04-14T10:00:04.937403+0000","last_fullsized":"2024-04-14T10:00:04.937403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427444+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427444+0000","last_peered":"2024-04-14T10:00:05.427444+0000","last_clean":"2024-04-14T10:00:05.427444+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427444+0000","last_undegraded":"2024-04-14T10:00:05.427444+0000","last_fullsized":"2024-04-14T10:00:05.427444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936785+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936785+0000","last_peered":"2024-04-14T10:00:04.936785+0000","last_clean":"2024-04-14T10:00:04.936785+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936785+0000","last_undegraded":"2024-04-14T10:00:04.936785+0000","last_fullsized":"2024-04-14T10:00:04.936785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427588+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427588+0000","last_peered":"2024-04-14T10:00:05.427588+0000","last_clean":"2024-04-14T10:00:05.427588+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427588+0000","last_undegraded":"2024-04-14T10:00:05.427588+0000","last_fullsized":"2024-04-14T10:00:05.427588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651389+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651389+0000","last_peered":"2024-04-14T10:00:05.651389+0000","last_clean":"2024-04-14T10:00:05.651389+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651389+0000","last_undegraded":"2024-04-14T10:00:05.651389+0000","last_fullsized":"2024-04-14T10:00:05.651389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651089+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651089+0000","last_peered":"2024-04-14T10:00:05.651089+0000","last_clean":"2024-04-14T10:00:05.651089+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651089+0000","last_undegraded":"2024-04-14T10:00:05.651089+0000","last_fullsized":"2024-04-14T10:00:05.651089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651643+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651643+0000","last_peered":"2024-04-14T10:00:05.651643+0000","last_clean":"2024-04-14T10:00:05.651643+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651643+0000","last_undegraded":"2024-04-14T10:00:05.651643+0000","last_fullsized":"2024-04-14T10:00:05.651643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651478+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651478+0000","last_peered":"2024-04-14T10:00:05.651478+0000","last_clean":"2024-04-14T10:00:05.651478+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651478+0000","last_undegraded":"2024-04-14T10:00:05.651478+0000","last_fullsized":"2024-04-14T10:00:05.651478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071269+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071269+0000","last_peered":"2024-04-14T10:00:05.071269+0000","last_clean":"2024-04-14T10:00:05.071269+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071269+0000","last_undegraded":"2024-04-14T10:00:05.071269+0000","last_fullsized":"2024-04-14T10:00:05.071269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071394+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071394+0000","last_peered":"2024-04-14T10:00:05.071394+0000","last_clean":"2024-04-14T10:00:05.071394+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071394+0000","last_undegraded":"2024-04-14T10:00:05.071394+0000","last_fullsized":"2024-04-14T10:00:05.071394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650406+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650406+0000","last_peered":"2024-04-14T10:00:05.650406+0000","last_clean":"2024-04-14T10:00:05.650406+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650406+0000","last_undegraded":"2024-04-14T10:00:05.650406+0000","last_fullsized":"2024-04-14T10:00:05.650406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070233+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070233+0000","last_peered":"2024-04-14T10:00:05.070233+0000","last_clean":"2024-04-14T10:00:05.070233+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070233+0000","last_undegraded":"2024-04-14T10:00:05.070233+0000","last_fullsized":"2024-04-14T10:00:05.070233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938986+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938986+0000","last_peered":"2024-04-14T10:00:04.938986+0000","last_clean":"2024-04-14T10:00:04.938986+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938986+0000","last_undegraded":"2024-04-14T10:00:04.938986+0000","last_fullsized":"2024-04-14T10:00:04.938986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070983+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070983+0000","last_peered":"2024-04-14T10:00:05.070983+0000","last_clean":"2024-04-14T10:00:05.070983+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070983+0000","last_undegraded":"2024-04-14T10:00:05.070983+0000","last_fullsized":"2024-04-14T10:00:05.070983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200991+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200991+0000","last_peered":"2024-04-14T10:00:08.200991+0000","last_clean":"2024-04-14T10:00:08.200991+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200991+0000","last_undegraded":"2024-04-14T10:00:08.200991+0000","last_fullsized":"2024-04-14T10:00:08.200991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937010+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.937010+0000","last_peered":"2024-04-14T10:00:04.937010+0000","last_clean":"2024-04-14T10:00:04.937010+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.937010+0000","last_undegraded":"2024-04-14T10:00:04.937010+0000","last_fullsized":"2024-04-14T10:00:04.937010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427690+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427690+0000","last_peered":"2024-04-14T10:00:05.427690+0000","last_clean":"2024-04-14T10:00:05.427690+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427690+0000","last_undegraded":"2024-04-14T10:00:05.427690+0000","last_fullsized":"2024-04-14T10:00:05.427690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071008+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.071008+0000","last_peered":"2024-04-14T10:00:05.071008+0000","last_clean":"2024-04-14T10:00:05.071008+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.071008+0000","last_undegraded":"2024-04-14T10:00:05.071008+0000","last_fullsized":"2024-04-14T10:00:05.071008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650297+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650297+0000","last_peered":"2024-04-14T10:00:05.650297+0000","last_clean":"2024-04-14T10:00:05.650297+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650297+0000","last_undegraded":"2024-04-14T10:00:05.650297+0000","last_fullsized":"2024-04-14T10:00:05.650297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992266+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992266+0000","last_peered":"2024-04-14T10:00:07.992266+0000","last_clean":"2024-04-14T10:00:07.992266+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992266+0000","last_undegraded":"2024-04-14T10:00:07.992266+0000","last_fullsized":"2024-04-14T10:00:07.992266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071339+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071339+0000","last_peered":"2024-04-14T10:00:05.071339+0000","last_clean":"2024-04-14T10:00:05.071339+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071339+0000","last_undegraded":"2024-04-14T10:00:05.071339+0000","last_fullsized":"2024-04-14T10:00:05.071339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394029+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394029+0000","last_peered":"2024-04-14T10:00:07.394029+0000","last_clean":"2024-04-14T10:00:07.394029+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394029+0000","last_undegraded":"2024-04-14T10:00:07.394029+0000","last_fullsized":"2024-04-14T10:00:07.394029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939257+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939257+0000","last_peered":"2024-04-14T10:00:04.939257+0000","last_clean":"2024-04-14T10:00:04.939257+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939257+0000","last_undegraded":"2024-04-14T10:00:04.939257+0000","last_fullsized":"2024-04-14T10:00:04.939257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939267+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939267+0000","last_peered":"2024-04-14T10:00:04.939267+0000","last_clean":"2024-04-14T10:00:04.939267+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939267+0000","last_undegraded":"2024-04-14T10:00:04.939267+0000","last_fullsized":"2024-04-14T10:00:04.939267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939238+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939238+0000","last_peered":"2024-04-14T10:00:04.939238+0000","last_clean":"2024-04-14T10:00:04.939238+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939238+0000","last_undegraded":"2024-04-14T10:00:04.939238+0000","last_fullsized":"2024-04-14T10:00:04.939238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650147+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650147+0000","last_peered":"2024-04-14T10:00:05.650147+0000","last_clean":"2024-04-14T10:00:05.650147+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650147+0000","last_undegraded":"2024-04-14T10:00:05.650147+0000","last_fullsized":"2024-04-14T10:00:05.650147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937822+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937822+0000","last_peered":"2024-04-14T10:00:04.937822+0000","last_clean":"2024-04-14T10:00:04.937822+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937822+0000","last_undegraded":"2024-04-14T10:00:04.937822+0000","last_fullsized":"2024-04-14T10:00:04.937822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651632+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651632+0000","last_peered":"2024-04-14T10:00:05.651632+0000","last_clean":"2024-04-14T10:00:05.651632+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651632+0000","last_undegraded":"2024-04-14T10:00:05.651632+0000","last_fullsized":"2024-04-14T10:00:05.651632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650921+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650921+0000","last_peered":"2024-04-14T10:00:05.650921+0000","last_clean":"2024-04-14T10:00:05.650921+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650921+0000","last_undegraded":"2024-04-14T10:00:05.650921+0000","last_fullsized":"2024-04-14T10:00:05.650921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937188+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937188+0000","last_peered":"2024-04-14T10:00:04.937188+0000","last_clean":"2024-04-14T10:00:04.937188+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937188+0000","last_undegraded":"2024-04-14T10:00:04.937188+0000","last_fullsized":"2024-04-14T10:00:04.937188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427262+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427262+0000","last_peered":"2024-04-14T10:00:05.427262+0000","last_clean":"2024-04-14T10:00:05.427262+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427262+0000","last_undegraded":"2024-04-14T10:00:05.427262+0000","last_fullsized":"2024-04-14T10:00:05.427262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.435394+0000","last_change":"2024-04-14T10:00:05.430632+0000","last_active":"2024-04-14T10:00:05.435394+0000","last_peered":"2024-04-14T10:00:05.435394+0000","last_clean":"2024-04-14T10:00:05.435394+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:00:05.435394+0000","last_undegraded":"2024-04-14T10:00:05.435394+0000","last_fullsized":"2024-04-14T10:00:05.435394+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:36.634300+0000","last_clean_scrub_stamp":"2024-04-14T09:59:36.634300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:37.370274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937407+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937407+0000","last_peered":"2024-04-14T10:00:04.937407+0000","last_clean":"2024-04-14T10:00:04.937407+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937407+0000","last_undegraded":"2024-04-14T10:00:04.937407+0000","last_fullsized":"2024-04-14T10:00:04.937407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:14.837176+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:14.837176+0000","last_peered":"2024-04-14T10:00:14.837176+0000","last_clean":"2024-04-14T10:00:14.837176+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:14.837176+0000","last_undegraded":"2024-04-14T10:00:14.837176+0000","last_fullsized":"2024-04-14T10:00:14.837176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574903,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:02:38.684 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-14T09:59:36.634300+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=36, tm_wday=6, tm_yday=105, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=14, tm_hour=9, tm_min=59, tm_sec=51, tm_wday=6, tm_yday=105, tm_isdst=0) 2024-04-14T10:02:38.684 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell 6.7 deep-scrub 2024-04-14T10:02:38.820 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.821+0000 7ffa67b1e640 1 Processor -- start 2024-04-14T10:02:38.821 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.821+0000 7ffa67b1e640 1 -- start start 2024-04-14T10:02:38.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60161ca0 0x7ffa600d4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ffa60162bb0 0x7ffa600cfbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa600d0c80 0x7ffa600d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.822 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7ffa600d1610 con 0x7ffa600d0c80 2024-04-14T10:02:38.826 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ffa600d5000 con 0x7ffa60162bb0 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa67b1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600cf0d0 con 0x7ffa60161ca0 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa600d0c80 0x7ffa600d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7ffa600d0c80 0x7ffa600d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53756/0 (socket says 172.21.15.40:53756) 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 -- 172.21.15.40:0/2841762504 learned_addr learned my addr 172.21.15.40:0/2841762504 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa658ba640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60161ca0 0x7ffa600d4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa650b9640 1 --2- 172.21.15.40:0/2841762504 >> v2:172.21.15.136:3300/0 conn(0x7ffa60162bb0 0x7ffa600cfbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 -- 172.21.15.40:0/2841762504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60161ca0 msgr2=0x7ffa600d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:02:38.827 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60161ca0 0x7ffa600d4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 -- 172.21.15.40:0/2841762504 >> v2:172.21.15.136:3300/0 conn(0x7ffa60162bb0 msgr2=0x7ffa600cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:02:38.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2841762504 >> v2:172.21.15.136:3300/0 conn(0x7ffa60162bb0 0x7ffa600cfbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.828 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.822+0000 7ffa660bb640 1 -- 172.21.15.40:0/2841762504 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa600cf3b0 con 0x7ffa600d0c80 2024-04-14T10:02:38.832 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.823+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa600d0c80 0x7ffa600d10d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffa6009dcf0 tx=0x7ffa5002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b029a4c63b67f71 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.823+0000 7ffa648b8640 1 -- 172.21.15.40:0/2841762504 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5002c9e0 con 0x7ffa600d0c80 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.823+0000 7ffa648b8640 1 -- 172.21.15.40:0/2841762504 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5002cb80 con 0x7ffa600d0c80 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.823+0000 7ffa648b8640 1 -- 172.21.15.40:0/2841762504 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa500343f0 con 0x7ffa600d0c80 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2841762504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa600d0c80 msgr2=0x7ffa600d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa600d0c80 0x7ffa600d10d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ffa6009dcf0 tx=0x7ffa5002be40 comp rx=0 tx=0).stop 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2841762504 shutdown_connections 2024-04-14T10:02:38.833 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa600d0c80 0x7ffa600d10d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2841762504 >> v2:172.21.15.136:3300/0 conn(0x7ffa60162bb0 0x7ffa600cfbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2841762504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60161ca0 0x7ffa600d4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2841762504 >> 172.21.15.40:0/2841762504 conn(0x7ffa6009d5c0 msgr2=0x7ffa600d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2841762504 shutdown_connections 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.824+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2841762504 wait complete. 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.825+0000 7ffa67b1e640 1 Processor -- start 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.825+0000 7ffa67b1e640 1 -- start start 2024-04-14T10:02:38.834 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa600d0c80 0x7ffa601590e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 0x7ffa601f8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60162bb0 0x7ffa601e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7ffa600d00f0 con 0x7ffa60161ca0 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffa60163010 con 0x7ffa600d0c80 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa67b1e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffa600ced80 con 0x7ffa60162bb0 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 0x7ffa601f8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 0x7ffa601f8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:53764/0 (socket says 172.21.15.40:53764) 2024-04-14T10:02:38.835 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 -- 172.21.15.40:0/2367825284 learned_addr learned my addr 172.21.15.40:0/2367825284 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa658ba640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa600d0c80 0x7ffa601590e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60162bb0 0x7ffa601e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 -- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60162bb0 msgr2=0x7ffa601e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffa60162bb0 0x7ffa601e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 -- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa600d0c80 msgr2=0x7ffa601590e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffa600d0c80 0x7ffa601590e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa601f8cb0 con 0x7ffa60161ca0 2024-04-14T10:02:38.836 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa650b9640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 0x7ffa601f8770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e9b0 tx=0x7ffa5400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.826+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54017070 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.827+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa5400c9a0 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.827+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa600c9230 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.827+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400cd90 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.827+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa600c9a70 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.827+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa60075760 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.828+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa5401a070 con 0x7ffa60161ca0 2024-04-14T10:02:38.837 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.828+0000 7ffa5e7fc640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa4c06c8f0 0x7ffa4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.828+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7ffa5408bc60 con 0x7ffa60161ca0 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.828+0000 7ffa658ba640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa4c06c8f0 0x7ffa4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa5e7fc640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7ffa4c0751e0 0x7ffa4c0776a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 1: {"prefix": "get_command_descriptions", "pgid": "6.7"}) -- 0x7ffa4c077d70 con 0x7ffa4c0751e0 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_get_version_reply(handle=1 version=41) ==== 24+0+0 (secure 0 0 0) 0x7ffa54091070 con 0x7ffa60161ca0 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7ffa4c0751e0 0x7ffa4c0776a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:38.838 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa658ba640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa4c06c8f0 0x7ffa4c06edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b8ca0 tx=0x7ffa58009190 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.829+0000 7ffa660bb640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7ffa4c0751e0 0x7ffa4c0776a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:38.839 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.830+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== osd.0 v2:172.21.15.40:6800/1123590082 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa4c077d70 con 0x7ffa4c0751e0 2024-04-14T10:02:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.843+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 --> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] -- command(tid 2: {"prefix": "deep-scrub", "pgid": "6.7"}) -- 0x7ffa601ea430 con 0x7ffa4c0751e0 2024-04-14T10:02:38.842 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.843+0000 7ffa5e7fc640 1 -- 172.21.15.40:0/2367825284 <== osd.0 v2:172.21.15.40:6800/1123590082 2 ==== command_reply(tid 2: 0 ) ==== 8+0+64 (crc 0 0 0) 0x7ffa601ea430 con 0x7ffa4c0751e0 2024-04-14T10:02:38.843 INFO:teuthology.orchestra.run.smithi040.stdout:{ 2024-04-14T10:02:38.843 INFO:teuthology.orchestra.run.smithi040.stdout: "deep": true, 2024-04-14T10:02:38.843 INFO:teuthology.orchestra.run.smithi040.stdout: "must": true, 2024-04-14T10:02:38.843 INFO:teuthology.orchestra.run.smithi040.stdout: "stamp": "0.000000" 2024-04-14T10:02:38.843 INFO:teuthology.orchestra.run.smithi040.stdout:} 2024-04-14T10:02:38.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7ffa4c0751e0 msgr2=0x7ffa4c0776a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.844 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:6800/1123590082,v1:172.21.15.40:6801/1123590082] conn(0x7ffa4c0751e0 0x7ffa4c0776a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa4c06c8f0 msgr2=0x7ffa4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7ffa4c06c8f0 0x7ffa4c06edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffa600b8ca0 tx=0x7ffa58009190 comp rx=0 tx=0).stop 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 msgr2=0x7ffa601f8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 --2- 172.21.15.40:0/2367825284 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7ffa60161ca0 0x7ffa601f8770 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400e9b0 tx=0x7ffa5400ee70 comp rx=0 tx=0).stop 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa660bb640 1 -- 172.21.15.40:0/2367825284 reap_dead start 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 shutdown_connections 2024-04-14T10:02:38.845 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 >> 172.21.15.40:0/2367825284 conn(0x7ffa6009d5c0 msgr2=0x7ffa600d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 shutdown_connections 2024-04-14T10:02:38.846 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:38.844+0000 7ffa67b1e640 1 -- 172.21.15.40:0/2367825284 wait complete. 2024-04-14T10:02:38.853 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-14T10:02:53.248 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:02:53.252 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:02:58.853 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-14T10:02:58.967 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.967+0000 7efcc7da3640 1 Processor -- start 2024-04-14T10:02:58.968 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.967+0000 7efcc7da3640 1 -- start start 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc7da3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efcc0159f50 0x7efcc015d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc7da3640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc00ce180 con 0x7efcc00cda00 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc7da3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcc00ce460 con 0x7efcc006e970 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc7da3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efcc00cfe90 con 0x7efcc0159f50 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc533e640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7efcc00cda00 0x7efcc00d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33652/0 (socket says 172.21.15.40:33652) 2024-04-14T10:02:58.970 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc533e640 1 -- 172.21.15.40:0/1097383596 learned_addr learned my addr 172.21.15.40:0/1097383596 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc5b3f640 1 --2- 172.21.15.40:0/1097383596 >> v2:172.21.15.136:3300/0 conn(0x7efcc0159f50 0x7efcc015d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.968+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186059232 0 0) 0x7efcc00ce180 con 0x7efcc00cda00 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 --> v1:172.21.15.40:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efca8003520 con 0x7efcc00cda00 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc5b3f640 1 -- 172.21.15.40:0/1097383596 >> v1:172.21.15.136:6789/0 conn(0x7efcc006e970 legacy=0x7efcc0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699259271 0 0) 0x7efcc00ce460 con 0x7efcc006e970 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc5b3f640 1 -- 172.21.15.40:0/1097383596 >> v1:172.21.15.40:6789/0 conn(0x7efcc00cda00 legacy=0x7efcc00d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:58.971 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc5b3f640 1 -- 172.21.15.40:0/1097383596 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc00d0170 con 0x7efcc0159f50 2024-04-14T10:02:58.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.969+0000 7efcc5b3f640 1 --2- 172.21.15.40:0/1097383596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc0159f50 0x7efcc015d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097a0 tx=0x7efcb802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff25412e51237acb server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:58.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8035020 con 0x7efcc0159f50 2024-04-14T10:02:58.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb8031830 con 0x7efcc0159f50 2024-04-14T10:02:58.972 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc4b3d640 1 -- 172.21.15.40:0/1097383596 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8031c00 con 0x7efcc0159f50 2024-04-14T10:02:58.975 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 -- 172.21.15.40:0/1097383596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc0159f50 msgr2=0x7efcc015d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 --2- 172.21.15.40:0/1097383596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc0159f50 0x7efcc015d360 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7efcb80097a0 tx=0x7efcb802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 -- 172.21.15.40:0/1097383596 shutdown_connections 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 --2- 172.21.15.40:0/1097383596 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc0159f50 0x7efcc015d360 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 -- 172.21.15.40:0/1097383596 >> 172.21.15.40:0/1097383596 conn(0x7efcc00b6540 msgr2=0x7efcc00b6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 -- 172.21.15.40:0/1097383596 shutdown_connections 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.970+0000 7efcc7da3640 1 -- 172.21.15.40:0/1097383596 wait complete. 2024-04-14T10:02:58.976 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.971+0000 7efcc7da3640 1 Processor -- start 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 -- start start 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc00cda00 0x7efcc0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcc0159f50 0x7efcc0145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7efcc0072a30 con 0x7efcc006e970 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efcc00cfb40 con 0x7efcc00cda00 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc7da3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efcc0072bb0 con 0x7efcc0159f50 2024-04-14T10:02:58.977 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc5b3f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc5b3f640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38972/0 (socket says 172.21.15.40:38972) 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc5b3f640 1 -- 172.21.15.40:0/2300107362 learned_addr learned my addr 172.21.15.40:0/2300107362 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc533e640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc00cda00 0x7efcc0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.972+0000 7efcc6340640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcc0159f50 0x7efcc0145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 -- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcc0159f50 msgr2=0x7efcc0145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcc0159f50 0x7efcc0145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 -- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc00cda00 msgr2=0x7efcc0153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:58.978 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc00cda00 0x7efcc0153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 -- 172.21.15.40:0/2300107362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc01544e0 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc5b3f640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034040 tx=0x7efcb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8040070 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcb803a830 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc0154f10 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb8035040 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.973+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc01554d0 con 0x7efcc006e970 2024-04-14T10:02:58.979 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.974+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc00756f0 con 0x7efcc006e970 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.975+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efcb804b060 con 0x7efcc006e970 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.975+0000 7efcbe7fc640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 0x7efcac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.975+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7efcb80ad400 con 0x7efcc006e970 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.975+0000 7efcc533e640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 0x7efcac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.976+0000 7efcc533e640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 0x7efcac06edb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efcc01532a0 tx=0x7efcb4009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:58.980 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:58.980+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7efcb807b030 con 0x7efcc006e970 2024-04-14T10:02:59.161 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.160+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 --> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efcc0145eb0 con 0x7efcac06c8f0 2024-04-14T10:02:59.167 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.167+0000 7efcbe7fc640 1 -- 172.21.15.40:0/2300107362 <== mgr.4114 v2:172.21.15.136:6832/2043813119 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251898 (secure 0 0 0) 0x7efcc0145eb0 con 0x7efcac06c8f0 2024-04-14T10:02:59.170 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:02:59.171 INFO:teuthology.orchestra.run.smithi040.stderr:dumped all 2024-04-14T10:02:59.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 msgr2=0x7efcac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 0x7efcac06edb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efcc01532a0 tx=0x7efcb4009040 comp rx=0 tx=0).stop 2024-04-14T10:02:59.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 msgr2=0x7efcc0154930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.173 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efcb8034040 tx=0x7efcb80046c0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 shutdown_connections 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7efcac06c8f0 0x7efcac06edb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efcc0159f50 0x7efcc0145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efcc00cda00 0x7efcc0153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 --2- 172.21.15.40:0/2300107362 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7efcc006e970 0x7efcc0154930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.174 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 >> 172.21.15.40:0/2300107362 conn(0x7efcc00b6540 msgr2=0x7efcc0072f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:59.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 shutdown_connections 2024-04-14T10:02:59.175 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.170+0000 7efcc7da3640 1 -- 172.21.15.40:0/2300107362 wait complete. 2024-04-14T10:02:59.180 INFO:teuthology.orchestra.run.smithi040.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-04-14T10:02:58.858003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":598311,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":212,"num_write_kb":2439,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":164,"ondisk_log_size":164,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221084,"kb_used_data":4944,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753636,"statfs":{"total":773094113280,"available":772867723264,"internally_reserved":0,"allocated":5062656,"data_stored":2855790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002005"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427762+0000","last_change":"2024-04-14T10:00:04.418322+0000","last_active":"2024-04-14T10:00:05.427762+0000","last_peered":"2024-04-14T10:00:05.427762+0000","last_clean":"2024-04-14T10:00:05.427762+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.427762+0000","last_undegraded":"2024-04-14T10:00:05.427762+0000","last_fullsized":"2024-04-14T10:00:05.427762+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.418209+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.418209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:30:15.337817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.428778+0000","last_change":"2024-04-14T10:00:06.428778+0000","last_active":"2024-04-14T10:00:06.428778+0000","last_peered":"2024-04-14T10:00:06.428778+0000","last_clean":"2024-04-14T10:00:06.428778+0000","last_became_active":"2024-04-14T09:59:37.669334+0000","last_became_peered":"2024-04-14T09:59:37.669334+0000","last_unstale":"2024-04-14T10:00:06.428778+0000","last_undegraded":"2024-04-14T10:00:06.428778+0000","last_fullsized":"2024-04-14T10:00:06.428778+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.428657+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.428657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:11:28.715326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939293+0000","last_change":"2024-04-14T09:59:57.501607+0000","last_active":"2024-04-14T10:00:04.939293+0000","last_peered":"2024-04-14T10:00:04.939293+0000","last_clean":"2024-04-14T10:00:04.939293+0000","last_became_active":"2024-04-14T09:59:37.663588+0000","last_became_peered":"2024-04-14T09:59:37.663588+0000","last_unstale":"2024-04-14T10:00:04.939293+0000","last_undegraded":"2024-04-14T10:00:04.939293+0000","last_fullsized":"2024-04-14T10:00:04.939293+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:57.501503+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.501503+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.664768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071225+0000","last_change":"2024-04-14T10:00:02.678909+0000","last_active":"2024-04-14T10:00:05.071225+0000","last_peered":"2024-04-14T10:00:05.071225+0000","last_clean":"2024-04-14T10:00:05.071225+0000","last_became_active":"2024-04-14T09:59:37.670711+0000","last_became_peered":"2024-04-14T09:59:37.670711+0000","last_unstale":"2024-04-14T10:00:05.071225+0000","last_undegraded":"2024-04-14T10:00:05.071225+0000","last_fullsized":"2024-04-14T10:00:05.071225+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.678796+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.678796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:30.617746+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071240+0000","last_change":"2024-04-14T09:59:59.740956+0000","last_active":"2024-04-14T10:00:05.071240+0000","last_peered":"2024-04-14T10:00:05.071240+0000","last_clean":"2024-04-14T10:00:05.071240+0000","last_became_active":"2024-04-14T09:59:37.666321+0000","last_became_peered":"2024-04-14T09:59:37.666321+0000","last_unstale":"2024-04-14T10:00:05.071240+0000","last_undegraded":"2024-04-14T10:00:05.071240+0000","last_fullsized":"2024-04-14T10:00:05.071240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.740847+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.740847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:25.518036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650186+0000","last_change":"2024-04-14T09:59:58.038706+0000","last_active":"2024-04-14T10:00:05.650186+0000","last_peered":"2024-04-14T10:00:05.650186+0000","last_clean":"2024-04-14T10:00:05.650186+0000","last_became_active":"2024-04-14T09:59:37.663049+0000","last_became_peered":"2024-04-14T09:59:37.663049+0000","last_unstale":"2024-04-14T10:00:05.650186+0000","last_undegraded":"2024-04-14T10:00:05.650186+0000","last_fullsized":"2024-04-14T10:00:05.650186+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.038595+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.038595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:29.817327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.208386+0000","last_change":"2024-04-14T10:00:07.208386+0000","last_active":"2024-04-14T10:00:07.208386+0000","last_peered":"2024-04-14T10:00:07.208386+0000","last_clean":"2024-04-14T10:00:07.208386+0000","last_became_active":"2024-04-14T09:59:37.667122+0000","last_became_peered":"2024-04-14T09:59:37.667122+0000","last_unstale":"2024-04-14T10:00:07.208386+0000","last_undegraded":"2024-04-14T10:00:07.208386+0000","last_fullsized":"2024-04-14T10:00:07.208386+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.208308+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.208308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:11:37.652921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427211+0000","last_change":"2024-04-14T10:00:01.474694+0000","last_active":"2024-04-14T10:00:05.427211+0000","last_peered":"2024-04-14T10:00:05.427211+0000","last_clean":"2024-04-14T10:00:05.427211+0000","last_became_active":"2024-04-14T09:59:37.659460+0000","last_became_peered":"2024-04-14T09:59:37.659460+0000","last_unstale":"2024-04-14T10:00:05.427211+0000","last_undegraded":"2024-04-14T10:00:05.427211+0000","last_fullsized":"2024-04-14T10:00:05.427211+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.474575+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.474575+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:30:24.016545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939402+0000","last_change":"2024-04-14T10:00:02.557840+0000","last_active":"2024-04-14T10:00:04.939402+0000","last_peered":"2024-04-14T10:00:04.939402+0000","last_clean":"2024-04-14T10:00:04.939402+0000","last_became_active":"2024-04-14T09:59:37.673025+0000","last_became_peered":"2024-04-14T09:59:37.673025+0000","last_unstale":"2024-04-14T10:00:04.939402+0000","last_undegraded":"2024-04-14T10:00:04.939402+0000","last_fullsized":"2024-04-14T10:00:04.939402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.557692+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.557692+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:02.884286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651181+0000","last_change":"2024-04-14T10:00:00.224668+0000","last_active":"2024-04-14T10:00:05.651181+0000","last_peered":"2024-04-14T10:00:05.651181+0000","last_clean":"2024-04-14T10:00:05.651181+0000","last_became_active":"2024-04-14T09:59:37.663208+0000","last_became_peered":"2024-04-14T09:59:37.663208+0000","last_unstale":"2024-04-14T10:00:05.651181+0000","last_undegraded":"2024-04-14T10:00:05.651181+0000","last_fullsized":"2024-04-14T10:00:05.651181+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.224540+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.224540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:23.232677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.232939+0000","last_change":"2024-04-14T10:00:09.232939+0000","last_active":"2024-04-14T10:00:09.232939+0000","last_peered":"2024-04-14T10:00:09.232939+0000","last_clean":"2024-04-14T10:00:09.232939+0000","last_became_active":"2024-04-14T09:59:37.669822+0000","last_became_peered":"2024-04-14T09:59:37.669822+0000","last_unstale":"2024-04-14T10:00:09.232939+0000","last_undegraded":"2024-04-14T10:00:09.232939+0000","last_fullsized":"2024-04-14T10:00:09.232939+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.232803+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.232803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:47:10.194726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939092+0000","last_change":"2024-04-14T09:59:58.485400+0000","last_active":"2024-04-14T10:00:04.939092+0000","last_peered":"2024-04-14T10:00:04.939092+0000","last_clean":"2024-04-14T10:00:04.939092+0000","last_became_active":"2024-04-14T09:59:37.665175+0000","last_became_peered":"2024-04-14T09:59:37.665175+0000","last_unstale":"2024-04-14T10:00:04.939092+0000","last_undegraded":"2024-04-14T10:00:04.939092+0000","last_fullsized":"2024-04-14T10:00:04.939092+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.485260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.485260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:23.885632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651173+0000","last_change":"2024-04-14T10:00:02.244994+0000","last_active":"2024-04-14T10:00:05.651173+0000","last_peered":"2024-04-14T10:00:05.651173+0000","last_clean":"2024-04-14T10:00:05.651173+0000","last_became_active":"2024-04-14T09:59:37.663970+0000","last_became_peered":"2024-04-14T09:59:37.663970+0000","last_unstale":"2024-04-14T10:00:05.651173+0000","last_undegraded":"2024-04-14T10:00:05.651173+0000","last_fullsized":"2024-04-14T10:00:05.651173+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.244897+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.244897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:33:56.197218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651542+0000","last_change":"2024-04-14T10:00:04.750961+0000","last_active":"2024-04-14T10:00:05.651542+0000","last_peered":"2024-04-14T10:00:05.651542+0000","last_clean":"2024-04-14T10:00:05.651542+0000","last_became_active":"2024-04-14T09:59:37.674372+0000","last_became_peered":"2024-04-14T09:59:37.674372+0000","last_unstale":"2024-04-14T10:00:05.651542+0000","last_undegraded":"2024-04-14T10:00:05.651542+0000","last_fullsized":"2024-04-14T10:00:05.651542+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.750834+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.750834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:09.630648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650953+0000","last_change":"2024-04-14T10:00:04.181803+0000","last_active":"2024-04-14T10:00:05.650953+0000","last_peered":"2024-04-14T10:00:05.650953+0000","last_clean":"2024-04-14T10:00:05.650953+0000","last_became_active":"2024-04-14T09:59:37.664984+0000","last_became_peered":"2024-04-14T09:59:37.664984+0000","last_unstale":"2024-04-14T10:00:05.650953+0000","last_undegraded":"2024-04-14T10:00:05.650953+0000","last_fullsized":"2024-04-14T10:00:05.650953+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.181730+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.181730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:01:32.036464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936736+0000","last_change":"2024-04-14T10:00:03.082709+0000","last_active":"2024-04-14T10:00:04.936736+0000","last_peered":"2024-04-14T10:00:04.936736+0000","last_clean":"2024-04-14T10:00:04.936736+0000","last_became_active":"2024-04-14T09:59:37.659376+0000","last_became_peered":"2024-04-14T09:59:37.659376+0000","last_unstale":"2024-04-14T10:00:04.936736+0000","last_undegraded":"2024-04-14T10:00:04.936736+0000","last_fullsized":"2024-04-14T10:00:04.936736+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.082626+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.082626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:34:03.409220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937743+0000","last_change":"2024-04-14T10:00:01.065298+0000","last_active":"2024-04-14T10:00:04.937743+0000","last_peered":"2024-04-14T10:00:04.937743+0000","last_clean":"2024-04-14T10:00:04.937743+0000","last_became_active":"2024-04-14T09:59:37.658708+0000","last_became_peered":"2024-04-14T09:59:37.658708+0000","last_unstale":"2024-04-14T10:00:04.937743+0000","last_undegraded":"2024-04-14T10:00:04.937743+0000","last_fullsized":"2024-04-14T10:00:04.937743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.065213+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.065213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:28.614951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937985+0000","last_change":"2024-04-14T10:00:02.192178+0000","last_active":"2024-04-14T10:00:04.937985+0000","last_peered":"2024-04-14T10:00:04.937985+0000","last_clean":"2024-04-14T10:00:04.937985+0000","last_became_active":"2024-04-14T09:59:37.667429+0000","last_became_peered":"2024-04-14T09:59:37.667429+0000","last_unstale":"2024-04-14T10:00:04.937985+0000","last_undegraded":"2024-04-14T10:00:04.937985+0000","last_fullsized":"2024-04-14T10:00:04.937985+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.192095+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.192095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:10.097655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071266+0000","last_change":"2024-04-14T10:00:00.759798+0000","last_active":"2024-04-14T10:00:05.071266+0000","last_peered":"2024-04-14T10:00:05.071266+0000","last_clean":"2024-04-14T10:00:05.071266+0000","last_became_active":"2024-04-14T09:59:37.668929+0000","last_became_peered":"2024-04-14T09:59:37.668929+0000","last_unstale":"2024-04-14T10:00:05.071266+0000","last_undegraded":"2024-04-14T10:00:05.071266+0000","last_fullsized":"2024-04-14T10:00:05.071266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.759676+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.759676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:54.266181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937869+0000","last_change":"2024-04-14T10:00:04.199312+0000","last_active":"2024-04-14T10:00:04.937869+0000","last_peered":"2024-04-14T10:00:04.937869+0000","last_clean":"2024-04-14T10:00:04.937869+0000","last_became_active":"2024-04-14T09:59:37.669817+0000","last_became_peered":"2024-04-14T09:59:37.669817+0000","last_unstale":"2024-04-14T10:00:04.937869+0000","last_undegraded":"2024-04-14T10:00:04.937869+0000","last_fullsized":"2024-04-14T10:00:04.937869+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.199236+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.199236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:29.599609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651216+0000","last_change":"2024-04-14T10:00:03.226189+0000","last_active":"2024-04-14T10:00:05.651216+0000","last_peered":"2024-04-14T10:00:05.651216+0000","last_clean":"2024-04-14T10:00:05.651216+0000","last_became_active":"2024-04-14T09:59:37.664616+0000","last_became_peered":"2024-04-14T09:59:37.664616+0000","last_unstale":"2024-04-14T10:00:05.651216+0000","last_undegraded":"2024-04-14T10:00:05.651216+0000","last_fullsized":"2024-04-14T10:00:05.651216+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.226102+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.226102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:52.624504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651764+0000","last_change":"2024-04-14T09:59:58.691410+0000","last_active":"2024-04-14T10:00:05.651764+0000","last_peered":"2024-04-14T10:00:05.651764+0000","last_clean":"2024-04-14T10:00:05.651764+0000","last_became_active":"2024-04-14T09:59:37.668623+0000","last_became_peered":"2024-04-14T09:59:37.668623+0000","last_unstale":"2024-04-14T10:00:05.651764+0000","last_undegraded":"2024-04-14T10:00:05.651764+0000","last_fullsized":"2024-04-14T10:00:05.651764+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.691329+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.691329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:06.596890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:09.042391+0000","last_change":"2024-04-14T10:00:09.042391+0000","last_active":"2024-04-14T10:00:09.042391+0000","last_peered":"2024-04-14T10:00:09.042391+0000","last_clean":"2024-04-14T10:00:09.042391+0000","last_became_active":"2024-04-14T09:59:37.670672+0000","last_became_peered":"2024-04-14T09:59:37.670672+0000","last_unstale":"2024-04-14T10:00:09.042391+0000","last_undegraded":"2024-04-14T10:00:09.042391+0000","last_fullsized":"2024-04-14T10:00:09.042391+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:09.042299+0000","last_clean_scrub_stamp":"2024-04-14T10:00:09.042299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:35:36.062586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070989+0000","last_change":"2024-04-14T10:00:03.635218+0000","last_active":"2024-04-14T10:00:05.070989+0000","last_peered":"2024-04-14T10:00:05.070989+0000","last_clean":"2024-04-14T10:00:05.070989+0000","last_became_active":"2024-04-14T09:59:37.674065+0000","last_became_peered":"2024-04-14T09:59:37.674065+0000","last_unstale":"2024-04-14T10:00:05.070989+0000","last_undegraded":"2024-04-14T10:00:05.070989+0000","last_fullsized":"2024-04-14T10:00:05.070989+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.635111+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:09:32.601696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938019+0000","last_change":"2024-04-14T10:00:01.175697+0000","last_active":"2024-04-14T10:00:04.938019+0000","last_peered":"2024-04-14T10:00:04.938019+0000","last_clean":"2024-04-14T10:00:04.938019+0000","last_became_active":"2024-04-14T09:59:37.666502+0000","last_became_peered":"2024-04-14T09:59:37.666502+0000","last_unstale":"2024-04-14T10:00:04.938019+0000","last_undegraded":"2024-04-14T10:00:04.938019+0000","last_fullsized":"2024-04-14T10:00:04.938019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.175617+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.175617+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:38.797502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650549+0000","last_change":"2024-04-14T10:00:01.902016+0000","last_active":"2024-04-14T10:00:05.650549+0000","last_peered":"2024-04-14T10:00:05.650549+0000","last_clean":"2024-04-14T10:00:05.650549+0000","last_became_active":"2024-04-14T09:59:37.664893+0000","last_became_peered":"2024-04-14T09:59:37.664893+0000","last_unstale":"2024-04-14T10:00:05.650549+0000","last_undegraded":"2024-04-14T10:00:05.650549+0000","last_fullsized":"2024-04-14T10:00:05.650549+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.901908+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.901908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937896+0000","last_change":"2024-04-14T10:00:03.218396+0000","last_active":"2024-04-14T10:00:04.937896+0000","last_peered":"2024-04-14T10:00:04.937896+0000","last_clean":"2024-04-14T10:00:04.937896+0000","last_became_active":"2024-04-14T09:59:37.668481+0000","last_became_peered":"2024-04-14T09:59:37.668481+0000","last_unstale":"2024-04-14T10:00:04.937896+0000","last_undegraded":"2024-04-14T10:00:04.937896+0000","last_fullsized":"2024-04-14T10:00:04.937896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.218320+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.218320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:34.997051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.236650+0000","last_change":"2024-04-14T10:00:06.236650+0000","last_active":"2024-04-14T10:00:06.236650+0000","last_peered":"2024-04-14T10:00:06.236650+0000","last_clean":"2024-04-14T10:00:06.236650+0000","last_became_active":"2024-04-14T09:59:37.666726+0000","last_became_peered":"2024-04-14T09:59:37.666726+0000","last_unstale":"2024-04-14T10:00:06.236650+0000","last_undegraded":"2024-04-14T10:00:06.236650+0000","last_fullsized":"2024-04-14T10:00:06.236650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.236547+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.236547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:58:19.686501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937590+0000","last_change":"2024-04-14T09:59:59.192966+0000","last_active":"2024-04-14T10:00:04.937590+0000","last_peered":"2024-04-14T10:00:04.937590+0000","last_clean":"2024-04-14T10:00:04.937590+0000","last_became_active":"2024-04-14T09:59:37.660532+0000","last_became_peered":"2024-04-14T09:59:37.660532+0000","last_unstale":"2024-04-14T10:00:04.937590+0000","last_undegraded":"2024-04-14T10:00:04.937590+0000","last_fullsized":"2024-04-14T10:00:04.937590+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.192869+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.192869+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:27.131819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937977+0000","last_change":"2024-04-14T10:00:00.218499+0000","last_active":"2024-04-14T10:00:04.937977+0000","last_peered":"2024-04-14T10:00:04.937977+0000","last_clean":"2024-04-14T10:00:04.937977+0000","last_became_active":"2024-04-14T09:59:37.664095+0000","last_became_peered":"2024-04-14T09:59:37.664095+0000","last_unstale":"2024-04-14T10:00:04.937977+0000","last_undegraded":"2024-04-14T10:00:04.937977+0000","last_fullsized":"2024-04-14T10:00:04.937977+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.218420+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.218420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:58.669755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:10.011850+0000","last_change":"2024-04-14T10:00:10.011850+0000","last_active":"2024-04-14T10:00:10.011850+0000","last_peered":"2024-04-14T10:00:10.011850+0000","last_clean":"2024-04-14T10:00:10.011850+0000","last_became_active":"2024-04-14T09:59:37.671016+0000","last_became_peered":"2024-04-14T09:59:37.671016+0000","last_unstale":"2024-04-14T10:00:10.011850+0000","last_undegraded":"2024-04-14T10:00:10.011850+0000","last_fullsized":"2024-04-14T10:00:10.011850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:10.011761+0000","last_clean_scrub_stamp":"2024-04-14T10:00:10.011761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:45.772056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650234+0000","last_change":"2024-04-14T09:59:58.994046+0000","last_active":"2024-04-14T10:00:05.650234+0000","last_peered":"2024-04-14T10:00:05.650234+0000","last_clean":"2024-04-14T10:00:05.650234+0000","last_became_active":"2024-04-14T09:59:37.664247+0000","last_became_peered":"2024-04-14T09:59:37.664247+0000","last_unstale":"2024-04-14T10:00:05.650234+0000","last_undegraded":"2024-04-14T10:00:05.650234+0000","last_fullsized":"2024-04-14T10:00:05.650234+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.993931+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.993931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:24.394304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937324+0000","last_change":"2024-04-14T10:00:04.090630+0000","last_active":"2024-04-14T10:00:04.937324+0000","last_peered":"2024-04-14T10:00:04.937324+0000","last_clean":"2024-04-14T10:00:04.937324+0000","last_became_active":"2024-04-14T09:59:37.661292+0000","last_became_peered":"2024-04-14T09:59:37.661292+0000","last_unstale":"2024-04-14T10:00:04.937324+0000","last_undegraded":"2024-04-14T10:00:04.937324+0000","last_fullsized":"2024-04-14T10:00:04.937324+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:04.090551+0000","last_clean_scrub_stamp":"2024-04-14T10:00:04.090551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:04.826525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":32,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938022+0000","last_change":"2024-04-14T09:59:57.198856+0000","last_active":"2024-04-14T10:00:04.938022+0000","last_peered":"2024-04-14T10:00:04.938022+0000","last_clean":"2024-04-14T10:00:04.938022+0000","last_became_active":"2024-04-14T09:59:36.648739+0000","last_became_peered":"2024-04-14T09:59:36.648739+0000","last_unstale":"2024-04-14T10:00:04.938022+0000","last_undegraded":"2024-04-14T10:00:04.938022+0000","last_fullsized":"2024-04-14T10:00:04.938022+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'4","last_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_deep_scrub":"38'4","last_deep_scrub_stamp":"2024-04-14T09:59:57.198736+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.198736+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:39:50.705241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650546+0000","last_change":"2024-04-14T10:00:00.926698+0000","last_active":"2024-04-14T10:00:05.650546+0000","last_peered":"2024-04-14T10:00:05.650546+0000","last_clean":"2024-04-14T10:00:05.650546+0000","last_became_active":"2024-04-14T09:59:37.664722+0000","last_became_peered":"2024-04-14T09:59:37.664722+0000","last_unstale":"2024-04-14T10:00:05.650546+0000","last_undegraded":"2024-04-14T10:00:05.650546+0000","last_fullsized":"2024-04-14T10:00:05.650546+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.926577+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.926577+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.830260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939251+0000","last_change":"2024-04-14T09:59:53.541354+0000","last_active":"2024-04-14T10:00:04.939251+0000","last_peered":"2024-04-14T10:00:04.939251+0000","last_clean":"2024-04-14T10:00:04.939251+0000","last_became_active":"2024-04-14T09:59:36.656331+0000","last_became_peered":"2024-04-14T09:59:36.656331+0000","last_unstale":"2024-04-14T10:00:04.939251+0000","last_undegraded":"2024-04-14T10:00:04.939251+0000","last_fullsized":"2024-04-14T10:00:04.939251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:53.541260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.541260+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.480210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651557+0000","last_change":"2024-04-14T10:00:03.760687+0000","last_active":"2024-04-14T10:00:05.651557+0000","last_peered":"2024-04-14T10:00:05.651557+0000","last_clean":"2024-04-14T10:00:05.651557+0000","last_became_active":"2024-04-14T09:59:37.673302+0000","last_became_peered":"2024-04-14T09:59:37.673302+0000","last_unstale":"2024-04-14T10:00:05.651557+0000","last_undegraded":"2024-04-14T10:00:05.651557+0000","last_fullsized":"2024-04-14T10:00:05.651557+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.760601+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.760601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:31.310339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650599+0000","last_change":"2024-04-14T09:59:52.968537+0000","last_active":"2024-04-14T10:00:05.650599+0000","last_peered":"2024-04-14T10:00:05.650599+0000","last_clean":"2024-04-14T10:00:05.650599+0000","last_became_active":"2024-04-14T09:59:36.657319+0000","last_became_peered":"2024-04-14T09:59:36.657319+0000","last_unstale":"2024-04-14T10:00:05.650599+0000","last_undegraded":"2024-04-14T10:00:05.650599+0000","last_fullsized":"2024-04-14T10:00:05.650599+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:52.968443+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.968443+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:03.313601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427798+0000","last_change":"2024-04-14T10:00:03.459581+0000","last_active":"2024-04-14T10:00:05.427798+0000","last_peered":"2024-04-14T10:00:05.427798+0000","last_clean":"2024-04-14T10:00:05.427798+0000","last_became_active":"2024-04-14T09:59:37.664082+0000","last_became_peered":"2024-04-14T09:59:37.664082+0000","last_unstale":"2024-04-14T10:00:05.427798+0000","last_undegraded":"2024-04-14T10:00:05.427798+0000","last_fullsized":"2024-04-14T10:00:05.427798+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:03.459470+0000","last_clean_scrub_stamp":"2024-04-14T10:00:03.459470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:54.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651268+0000","last_change":"2024-04-14T09:59:57.667988+0000","last_active":"2024-04-14T10:00:05.651268+0000","last_peered":"2024-04-14T10:00:05.651268+0000","last_clean":"2024-04-14T10:00:05.651268+0000","last_became_active":"2024-04-14T09:59:36.656918+0000","last_became_peered":"2024-04-14T09:59:36.656918+0000","last_unstale":"2024-04-14T10:00:05.651268+0000","last_undegraded":"2024-04-14T10:00:05.651268+0000","last_fullsized":"2024-04-14T10:00:05.651268+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:57.667897+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.667897+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:35.289781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938923+0000","last_change":"2024-04-14T09:59:56.498710+0000","last_active":"2024-04-14T10:00:04.938923+0000","last_peered":"2024-04-14T10:00:04.938923+0000","last_clean":"2024-04-14T10:00:04.938923+0000","last_became_active":"2024-04-14T09:59:37.660673+0000","last_became_peered":"2024-04-14T09:59:37.660673+0000","last_unstale":"2024-04-14T10:00:04.938923+0000","last_undegraded":"2024-04-14T10:00:04.938923+0000","last_fullsized":"2024-04-14T10:00:04.938923+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.498622+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.498622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.404183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651264+0000","last_change":"2024-04-14T09:59:59.218825+0000","last_active":"2024-04-14T10:00:05.651264+0000","last_peered":"2024-04-14T10:00:05.651264+0000","last_clean":"2024-04-14T10:00:05.651264+0000","last_became_active":"2024-04-14T09:59:36.662302+0000","last_became_peered":"2024-04-14T09:59:36.662302+0000","last_unstale":"2024-04-14T10:00:05.651264+0000","last_undegraded":"2024-04-14T10:00:05.651264+0000","last_fullsized":"2024-04-14T10:00:05.651264+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:59.218741+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.218741+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:29:59.954715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651042+0000","last_change":"2024-04-14T10:00:01.224058+0000","last_active":"2024-04-14T10:00:05.651042+0000","last_peered":"2024-04-14T10:00:05.651042+0000","last_clean":"2024-04-14T10:00:05.651042+0000","last_became_active":"2024-04-14T09:59:37.663679+0000","last_became_peered":"2024-04-14T09:59:37.663679+0000","last_unstale":"2024-04-14T10:00:05.651042+0000","last_undegraded":"2024-04-14T10:00:05.651042+0000","last_fullsized":"2024-04-14T10:00:05.651042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.223918+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.223918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:43.176941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937061+0000","last_change":"2024-04-14T09:59:58.070139+0000","last_active":"2024-04-14T10:00:04.937061+0000","last_peered":"2024-04-14T10:00:04.937061+0000","last_clean":"2024-04-14T10:00:04.937061+0000","last_became_active":"2024-04-14T09:59:36.653175+0000","last_became_peered":"2024-04-14T09:59:36.653175+0000","last_unstale":"2024-04-14T10:00:04.937061+0000","last_undegraded":"2024-04-14T10:00:04.937061+0000","last_fullsized":"2024-04-14T10:00:04.937061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:58.070041+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.070041+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:07.403212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651678+0000","last_change":"2024-04-14T10:00:02.742604+0000","last_active":"2024-04-14T10:00:05.651678+0000","last_peered":"2024-04-14T10:00:05.651678+0000","last_clean":"2024-04-14T10:00:05.651678+0000","last_became_active":"2024-04-14T09:59:37.672762+0000","last_became_peered":"2024-04-14T09:59:37.672762+0000","last_unstale":"2024-04-14T10:00:05.651678+0000","last_undegraded":"2024-04-14T10:00:05.651678+0000","last_fullsized":"2024-04-14T10:00:05.651678+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.742520+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.742520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:42.065889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650259+0000","last_change":"2024-04-14T09:59:54.921581+0000","last_active":"2024-04-14T10:00:05.650259+0000","last_peered":"2024-04-14T10:00:05.650259+0000","last_clean":"2024-04-14T10:00:05.650259+0000","last_became_active":"2024-04-14T09:59:36.658796+0000","last_became_peered":"2024-04-14T09:59:36.658796+0000","last_unstale":"2024-04-14T10:00:05.650259+0000","last_undegraded":"2024-04-14T10:00:05.650259+0000","last_fullsized":"2024-04-14T10:00:05.650259+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.921498+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.921498+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:53.372833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427435+0000","last_change":"2024-04-14T09:59:58.475011+0000","last_active":"2024-04-14T10:00:05.427435+0000","last_peered":"2024-04-14T10:00:05.427435+0000","last_clean":"2024-04-14T10:00:05.427435+0000","last_became_active":"2024-04-14T09:59:37.659505+0000","last_became_peered":"2024-04-14T09:59:37.659505+0000","last_unstale":"2024-04-14T10:00:05.427435+0000","last_undegraded":"2024-04-14T10:00:05.427435+0000","last_fullsized":"2024-04-14T10:00:05.427435+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.474906+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.474906+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:17.283846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651041+0000","last_change":"2024-04-14T09:59:54.660243+0000","last_active":"2024-04-14T10:00:05.651041+0000","last_peered":"2024-04-14T10:00:05.651041+0000","last_clean":"2024-04-14T10:00:05.651041+0000","last_became_active":"2024-04-14T09:59:36.654188+0000","last_became_peered":"2024-04-14T09:59:36.654188+0000","last_unstale":"2024-04-14T10:00:05.651041+0000","last_undegraded":"2024-04-14T10:00:05.651041+0000","last_fullsized":"2024-04-14T10:00:05.651041+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.660117+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.660117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:50:14.071170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071200+0000","last_change":"2024-04-14T10:00:01.720159+0000","last_active":"2024-04-14T10:00:05.071200+0000","last_peered":"2024-04-14T10:00:05.071200+0000","last_clean":"2024-04-14T10:00:05.071200+0000","last_became_active":"2024-04-14T09:59:37.670366+0000","last_became_peered":"2024-04-14T09:59:37.670366+0000","last_unstale":"2024-04-14T10:00:05.071200+0000","last_undegraded":"2024-04-14T10:00:05.071200+0000","last_fullsized":"2024-04-14T10:00:05.071200+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.720053+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.720053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:12.065211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427828+0000","last_change":"2024-04-14T09:59:55.500075+0000","last_active":"2024-04-14T10:00:05.427828+0000","last_peered":"2024-04-14T10:00:05.427828+0000","last_clean":"2024-04-14T10:00:05.427828+0000","last_became_active":"2024-04-14T09:59:36.652228+0000","last_became_peered":"2024-04-14T09:59:36.652228+0000","last_unstale":"2024-04-14T10:00:05.427828+0000","last_undegraded":"2024-04-14T10:00:05.427828+0000","last_fullsized":"2024-04-14T10:00:05.427828+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.499983+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.499983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:04:20.900355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.029473+0000","last_change":"2024-04-14T10:00:07.029473+0000","last_active":"2024-04-14T10:00:07.029473+0000","last_peered":"2024-04-14T10:00:07.029473+0000","last_clean":"2024-04-14T10:00:07.029473+0000","last_became_active":"2024-04-14T09:59:37.658139+0000","last_became_peered":"2024-04-14T09:59:37.658139+0000","last_unstale":"2024-04-14T10:00:07.029473+0000","last_undegraded":"2024-04-14T10:00:07.029473+0000","last_fullsized":"2024-04-14T10:00:07.029473+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.029324+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.029324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:34:00.981646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651374+0000","last_change":"2024-04-14T09:59:56.210048+0000","last_active":"2024-04-14T10:00:05.651374+0000","last_peered":"2024-04-14T10:00:05.651374+0000","last_clean":"2024-04-14T10:00:05.651374+0000","last_became_active":"2024-04-14T09:59:36.655220+0000","last_became_peered":"2024-04-14T09:59:36.655220+0000","last_unstale":"2024-04-14T10:00:05.651374+0000","last_undegraded":"2024-04-14T10:00:05.651374+0000","last_fullsized":"2024-04-14T10:00:05.651374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.209922+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.209922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:59:23.759661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939303+0000","last_change":"2024-04-14T10:00:01.546467+0000","last_active":"2024-04-14T10:00:04.939303+0000","last_peered":"2024-04-14T10:00:04.939303+0000","last_clean":"2024-04-14T10:00:04.939303+0000","last_became_active":"2024-04-14T09:59:37.669390+0000","last_became_peered":"2024-04-14T09:59:37.669390+0000","last_unstale":"2024-04-14T10:00:04.939303+0000","last_undegraded":"2024-04-14T10:00:04.939303+0000","last_fullsized":"2024-04-14T10:00:04.939303+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.546359+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.546359+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:20:20.355299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651178+0000","last_change":"2024-04-14T09:59:57.166451+0000","last_active":"2024-04-14T10:00:05.651178+0000","last_peered":"2024-04-14T10:00:05.651178+0000","last_clean":"2024-04-14T10:00:05.651178+0000","last_became_active":"2024-04-14T09:59:36.659995+0000","last_became_peered":"2024-04-14T09:59:36.659995+0000","last_unstale":"2024-04-14T10:00:05.651178+0000","last_undegraded":"2024-04-14T10:00:05.651178+0000","last_fullsized":"2024-04-14T10:00:05.651178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'3","last_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_deep_scrub":"38'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.166309+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.166309+0000","objects_scrubbed":2,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:02.046123+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651071+0000","last_change":"2024-04-14T10:00:00.723754+0000","last_active":"2024-04-14T10:00:05.651071+0000","last_peered":"2024-04-14T10:00:05.651071+0000","last_clean":"2024-04-14T10:00:05.651071+0000","last_became_active":"2024-04-14T09:59:37.670475+0000","last_became_peered":"2024-04-14T09:59:37.670475+0000","last_unstale":"2024-04-14T10:00:05.651071+0000","last_undegraded":"2024-04-14T10:00:05.651071+0000","last_fullsized":"2024-04-14T10:00:05.651071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.723604+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.723604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:40:10.056775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'10","reported_seq":38,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427656+0000","last_change":"2024-04-14T09:59:57.520486+0000","last_active":"2024-04-14T10:00:05.427656+0000","last_peered":"2024-04-14T10:00:05.427656+0000","last_clean":"2024-04-14T10:00:05.427656+0000","last_became_active":"2024-04-14T09:59:36.656110+0000","last_became_peered":"2024-04-14T09:59:36.656110+0000","last_unstale":"2024-04-14T10:00:05.427656+0000","last_undegraded":"2024-04-14T10:00:05.427656+0000","last_fullsized":"2024-04-14T10:00:05.427656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'10","last_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_deep_scrub":"39'10","last_deep_scrub_stamp":"2024-04-14T09:59:57.520316+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.520316+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:43:58.423999+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7145,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938976+0000","last_change":"2024-04-14T09:59:59.496346+0000","last_active":"2024-04-14T10:00:04.938976+0000","last_peered":"2024-04-14T10:00:04.938976+0000","last_clean":"2024-04-14T10:00:04.938976+0000","last_became_active":"2024-04-14T09:59:37.667730+0000","last_became_peered":"2024-04-14T09:59:37.667730+0000","last_unstale":"2024-04-14T10:00:04.938976+0000","last_undegraded":"2024-04-14T10:00:04.938976+0000","last_fullsized":"2024-04-14T10:00:04.938976+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.496202+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.496202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:06.998079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427697+0000","last_change":"2024-04-14T09:59:56.479136+0000","last_active":"2024-04-14T10:00:05.427697+0000","last_peered":"2024-04-14T10:00:05.427697+0000","last_clean":"2024-04-14T10:00:05.427697+0000","last_became_active":"2024-04-14T09:59:36.654478+0000","last_became_peered":"2024-04-14T09:59:36.654478+0000","last_unstale":"2024-04-14T10:00:05.427697+0000","last_undegraded":"2024-04-14T10:00:05.427697+0000","last_fullsized":"2024-04-14T10:00:05.427697+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:56.479032+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.479032+0000","objects_scrubbed":2,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:48:35.512827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427256+0000","last_change":"2024-04-14T10:00:02.428451+0000","last_active":"2024-04-14T10:00:05.427256+0000","last_peered":"2024-04-14T10:00:05.427256+0000","last_clean":"2024-04-14T10:00:05.427256+0000","last_became_active":"2024-04-14T09:59:37.663919+0000","last_became_peered":"2024-04-14T09:59:37.663919+0000","last_unstale":"2024-04-14T10:00:05.427256+0000","last_undegraded":"2024-04-14T10:00:05.427256+0000","last_fullsized":"2024-04-14T10:00:05.427256+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.428335+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.428335+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:55:51.264082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650195+0000","last_change":"2024-04-14T09:59:55.966111+0000","last_active":"2024-04-14T10:00:05.650195+0000","last_peered":"2024-04-14T10:00:05.650195+0000","last_clean":"2024-04-14T10:00:05.650195+0000","last_became_active":"2024-04-14T09:59:36.659657+0000","last_became_peered":"2024-04-14T09:59:36.659657+0000","last_unstale":"2024-04-14T10:00:05.650195+0000","last_undegraded":"2024-04-14T10:00:05.650195+0000","last_fullsized":"2024-04-14T10:00:05.650195+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.966028+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.966028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.587912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:06.024685+0000","last_change":"2024-04-14T10:00:06.024685+0000","last_active":"2024-04-14T10:00:06.024685+0000","last_peered":"2024-04-14T10:00:06.024685+0000","last_clean":"2024-04-14T10:00:06.024685+0000","last_became_active":"2024-04-14T09:59:37.663468+0000","last_became_peered":"2024-04-14T09:59:37.663468+0000","last_unstale":"2024-04-14T10:00:06.024685+0000","last_undegraded":"2024-04-14T10:00:06.024685+0000","last_fullsized":"2024-04-14T10:00:06.024685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:06.024589+0000","last_clean_scrub_stamp":"2024-04-14T10:00:06.024589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:20:47.977611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937403+0000","last_change":"2024-04-14T09:59:56.161942+0000","last_active":"2024-04-14T10:00:04.937403+0000","last_peered":"2024-04-14T10:00:04.937403+0000","last_clean":"2024-04-14T10:00:04.937403+0000","last_became_active":"2024-04-14T09:59:36.648755+0000","last_became_peered":"2024-04-14T09:59:36.648755+0000","last_unstale":"2024-04-14T10:00:04.937403+0000","last_undegraded":"2024-04-14T10:00:04.937403+0000","last_fullsized":"2024-04-14T10:00:04.937403+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.161826+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.161826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:34:21.939015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427444+0000","last_change":"2024-04-14T10:00:00.486839+0000","last_active":"2024-04-14T10:00:05.427444+0000","last_peered":"2024-04-14T10:00:05.427444+0000","last_clean":"2024-04-14T10:00:05.427444+0000","last_became_active":"2024-04-14T09:59:37.660029+0000","last_became_peered":"2024-04-14T09:59:37.660029+0000","last_unstale":"2024-04-14T10:00:05.427444+0000","last_undegraded":"2024-04-14T10:00:05.427444+0000","last_fullsized":"2024-04-14T10:00:05.427444+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.486716+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.486716+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T19:30:01.222690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":36,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.936785+0000","last_change":"2024-04-14T09:59:57.038492+0000","last_active":"2024-04-14T10:00:04.936785+0000","last_peered":"2024-04-14T10:00:04.936785+0000","last_clean":"2024-04-14T10:00:04.936785+0000","last_became_active":"2024-04-14T09:59:36.652511+0000","last_became_peered":"2024-04-14T09:59:36.652511+0000","last_unstale":"2024-04-14T10:00:04.936785+0000","last_undegraded":"2024-04-14T10:00:04.936785+0000","last_fullsized":"2024-04-14T10:00:04.936785+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'8","last_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_deep_scrub":"38'8","last_deep_scrub_stamp":"2024-04-14T09:59:57.038391+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.038391+0000","objects_scrubbed":4,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:48.201657+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427588+0000","last_change":"2024-04-14T10:00:05.426899+0000","last_active":"2024-04-14T10:00:05.427588+0000","last_peered":"2024-04-14T10:00:05.427588+0000","last_clean":"2024-04-14T10:00:05.427588+0000","last_became_active":"2024-04-14T09:59:37.667419+0000","last_became_peered":"2024-04-14T09:59:37.667419+0000","last_unstale":"2024-04-14T10:00:05.427588+0000","last_undegraded":"2024-04-14T10:00:05.427588+0000","last_fullsized":"2024-04-14T10:00:05.427588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.426728+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.426728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:55:57.647948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651389+0000","last_change":"2024-04-14T09:59:55.160759+0000","last_active":"2024-04-14T10:00:05.651389+0000","last_peered":"2024-04-14T10:00:05.651389+0000","last_clean":"2024-04-14T10:00:05.651389+0000","last_became_active":"2024-04-14T09:59:36.653722+0000","last_became_peered":"2024-04-14T09:59:36.653722+0000","last_unstale":"2024-04-14T10:00:05.651389+0000","last_undegraded":"2024-04-14T10:00:05.651389+0000","last_fullsized":"2024-04-14T10:00:05.651389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.160673+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.160673+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:34.484042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651089+0000","last_change":"2024-04-14T10:00:05.205554+0000","last_active":"2024-04-14T10:00:05.651089+0000","last_peered":"2024-04-14T10:00:05.651089+0000","last_clean":"2024-04-14T10:00:05.651089+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:05.651089+0000","last_undegraded":"2024-04-14T10:00:05.651089+0000","last_fullsized":"2024-04-14T10:00:05.651089+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.205457+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.205457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:55:40.965752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651643+0000","last_change":"2024-04-14T09:59:55.620357+0000","last_active":"2024-04-14T10:00:05.651643+0000","last_peered":"2024-04-14T10:00:05.651643+0000","last_clean":"2024-04-14T10:00:05.651643+0000","last_became_active":"2024-04-14T09:59:36.655771+0000","last_became_peered":"2024-04-14T09:59:36.655771+0000","last_unstale":"2024-04-14T10:00:05.651643+0000","last_undegraded":"2024-04-14T10:00:05.651643+0000","last_fullsized":"2024-04-14T10:00:05.651643+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:55.620260+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.620260+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:38:00.736834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651478+0000","last_change":"2024-04-14T09:59:59.695720+0000","last_active":"2024-04-14T10:00:05.651478+0000","last_peered":"2024-04-14T10:00:05.651478+0000","last_clean":"2024-04-14T10:00:05.651478+0000","last_became_active":"2024-04-14T09:59:37.668755+0000","last_became_peered":"2024-04-14T09:59:37.668755+0000","last_unstale":"2024-04-14T10:00:05.651478+0000","last_undegraded":"2024-04-14T10:00:05.651478+0000","last_fullsized":"2024-04-14T10:00:05.651478+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.695578+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.695578+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:46:50.858844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":29,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071269+0000","last_change":"2024-04-14T09:59:55.784111+0000","last_active":"2024-04-14T10:00:05.071269+0000","last_peered":"2024-04-14T10:00:05.071269+0000","last_clean":"2024-04-14T10:00:05.071269+0000","last_became_active":"2024-04-14T09:59:36.652938+0000","last_became_peered":"2024-04-14T09:59:36.652938+0000","last_unstale":"2024-04-14T10:00:05.071269+0000","last_undegraded":"2024-04-14T10:00:05.071269+0000","last_fullsized":"2024-04-14T10:00:05.071269+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'1","last_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_deep_scrub":"38'1","last_deep_scrub_stamp":"2024-04-14T09:59:55.784017+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.784017+0000","objects_scrubbed":1,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:33:53.952724+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071394+0000","last_change":"2024-04-14T09:59:58.739528+0000","last_active":"2024-04-14T10:00:05.071394+0000","last_peered":"2024-04-14T10:00:05.071394+0000","last_clean":"2024-04-14T10:00:05.071394+0000","last_became_active":"2024-04-14T09:59:37.665428+0000","last_became_peered":"2024-04-14T09:59:37.665428+0000","last_unstale":"2024-04-14T10:00:05.071394+0000","last_undegraded":"2024-04-14T10:00:05.071394+0000","last_fullsized":"2024-04-14T10:00:05.071394+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.739425+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.739425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:56:06.148471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650406+0000","last_change":"2024-04-14T09:59:53.939793+0000","last_active":"2024-04-14T10:00:05.650406+0000","last_peered":"2024-04-14T10:00:05.650406+0000","last_clean":"2024-04-14T10:00:05.650406+0000","last_became_active":"2024-04-14T09:59:36.658014+0000","last_became_peered":"2024-04-14T09:59:36.658014+0000","last_unstale":"2024-04-14T10:00:05.650406+0000","last_undegraded":"2024-04-14T10:00:05.650406+0000","last_fullsized":"2024-04-14T10:00:05.650406+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.939698+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.939698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:01:21.878648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070233+0000","last_change":"2024-04-14T10:00:05.070233+0000","last_active":"2024-04-14T10:00:05.070233+0000","last_peered":"2024-04-14T10:00:05.070233+0000","last_clean":"2024-04-14T10:00:05.070233+0000","last_became_active":"2024-04-14T09:59:37.663293+0000","last_became_peered":"2024-04-14T09:59:37.663293+0000","last_unstale":"2024-04-14T10:00:05.070233+0000","last_undegraded":"2024-04-14T10:00:05.070233+0000","last_fullsized":"2024-04-14T10:00:05.070233+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:05.070134+0000","last_clean_scrub_stamp":"2024-04-14T10:00:05.070134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:47:28.078272+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071112+0000","last_change":"2024-04-14T09:59:54.816305+0000","last_active":"2024-04-14T10:00:05.071112+0000","last_peered":"2024-04-14T10:00:05.071112+0000","last_clean":"2024-04-14T10:00:05.071112+0000","last_became_active":"2024-04-14T09:59:36.652881+0000","last_became_peered":"2024-04-14T09:59:36.652881+0000","last_unstale":"2024-04-14T10:00:05.071112+0000","last_undegraded":"2024-04-14T10:00:05.071112+0000","last_fullsized":"2024-04-14T10:00:05.071112+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:54.816213+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.816213+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:44:10.058209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.938986+0000","last_change":"2024-04-14T10:00:00.519650+0000","last_active":"2024-04-14T10:00:04.938986+0000","last_peered":"2024-04-14T10:00:04.938986+0000","last_clean":"2024-04-14T10:00:04.938986+0000","last_became_active":"2024-04-14T09:59:37.668874+0000","last_became_peered":"2024-04-14T09:59:37.668874+0000","last_unstale":"2024-04-14T10:00:04.938986+0000","last_undegraded":"2024-04-14T10:00:04.938986+0000","last_fullsized":"2024-04-14T10:00:04.938986+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.519543+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.519543+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:44:01.423226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.070983+0000","last_change":"2024-04-14T09:59:53.864978+0000","last_active":"2024-04-14T10:00:05.070983+0000","last_peered":"2024-04-14T10:00:05.070983+0000","last_clean":"2024-04-14T10:00:05.070983+0000","last_became_active":"2024-04-14T09:59:36.649528+0000","last_became_peered":"2024-04-14T09:59:36.649528+0000","last_unstale":"2024-04-14T10:00:05.070983+0000","last_undegraded":"2024-04-14T10:00:05.070983+0000","last_fullsized":"2024-04-14T10:00:05.070983+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:53.864882+0000","last_clean_scrub_stamp":"2024-04-14T09:59:53.864882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:31:14.962700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:08.200991+0000","last_change":"2024-04-14T10:00:08.200991+0000","last_active":"2024-04-14T10:00:08.200991+0000","last_peered":"2024-04-14T10:00:08.200991+0000","last_clean":"2024-04-14T10:00:08.200991+0000","last_became_active":"2024-04-14T09:59:37.669191+0000","last_became_peered":"2024-04-14T09:59:37.669191+0000","last_unstale":"2024-04-14T10:00:08.200991+0000","last_undegraded":"2024-04-14T10:00:08.200991+0000","last_fullsized":"2024-04-14T10:00:08.200991+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:08.200895+0000","last_clean_scrub_stamp":"2024-04-14T10:00:08.200895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:29.839449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937010+0000","last_change":"2024-04-14T10:00:00.052503+0000","last_active":"2024-04-14T10:00:04.937010+0000","last_peered":"2024-04-14T10:00:04.937010+0000","last_clean":"2024-04-14T10:00:04.937010+0000","last_became_active":"2024-04-14T09:59:36.657534+0000","last_became_peered":"2024-04-14T09:59:36.657534+0000","last_unstale":"2024-04-14T10:00:04.937010+0000","last_undegraded":"2024-04-14T10:00:04.937010+0000","last_fullsized":"2024-04-14T10:00:04.937010+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:00.052415+0000","last_clean_scrub_stamp":"2024-04-14T10:00:00.052415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:32:39.375784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427690+0000","last_change":"2024-04-14T09:59:59.437938+0000","last_active":"2024-04-14T10:00:05.427690+0000","last_peered":"2024-04-14T10:00:05.427690+0000","last_clean":"2024-04-14T10:00:05.427690+0000","last_became_active":"2024-04-14T09:59:37.659728+0000","last_became_peered":"2024-04-14T09:59:37.659728+0000","last_unstale":"2024-04-14T10:00:05.427690+0000","last_undegraded":"2024-04-14T10:00:05.427690+0000","last_fullsized":"2024-04-14T10:00:05.427690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.437814+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.437814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T18:55:34.396579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071008+0000","last_change":"2024-04-14T09:59:56.783239+0000","last_active":"2024-04-14T10:00:05.071008+0000","last_peered":"2024-04-14T10:00:05.071008+0000","last_clean":"2024-04-14T10:00:05.071008+0000","last_became_active":"2024-04-14T09:59:36.654171+0000","last_became_peered":"2024-04-14T09:59:36.654171+0000","last_unstale":"2024-04-14T10:00:05.071008+0000","last_undegraded":"2024-04-14T10:00:05.071008+0000","last_fullsized":"2024-04-14T10:00:05.071008+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.783131+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.783131+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:29:50.184936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650297+0000","last_change":"2024-04-14T09:59:59.970804+0000","last_active":"2024-04-14T10:00:05.650297+0000","last_peered":"2024-04-14T10:00:05.650297+0000","last_clean":"2024-04-14T10:00:05.650297+0000","last_became_active":"2024-04-14T09:59:37.664837+0000","last_became_peered":"2024-04-14T09:59:37.664837+0000","last_unstale":"2024-04-14T10:00:05.650297+0000","last_undegraded":"2024-04-14T10:00:05.650297+0000","last_fullsized":"2024-04-14T10:00:05.650297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.970670+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.970670+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:07.472548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":30,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651441+0000","last_change":"2024-04-14T09:59:58.204151+0000","last_active":"2024-04-14T10:00:05.651441+0000","last_peered":"2024-04-14T10:00:05.651441+0000","last_clean":"2024-04-14T10:00:05.651441+0000","last_became_active":"2024-04-14T09:59:36.660105+0000","last_became_peered":"2024-04-14T09:59:36.660105+0000","last_unstale":"2024-04-14T10:00:05.651441+0000","last_undegraded":"2024-04-14T10:00:05.651441+0000","last_fullsized":"2024-04-14T10:00:05.651441+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'2","last_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_deep_scrub":"38'2","last_deep_scrub_stamp":"2024-04-14T09:59:58.204055+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.204055+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:33:58.530650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.992266+0000","last_change":"2024-04-14T10:00:07.992266+0000","last_active":"2024-04-14T10:00:07.992266+0000","last_peered":"2024-04-14T10:00:07.992266+0000","last_clean":"2024-04-14T10:00:07.992266+0000","last_became_active":"2024-04-14T09:59:37.664447+0000","last_became_peered":"2024-04-14T09:59:37.664447+0000","last_unstale":"2024-04-14T10:00:07.992266+0000","last_undegraded":"2024-04-14T10:00:07.992266+0000","last_fullsized":"2024-04-14T10:00:07.992266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.992187+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.992187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:03:57.390589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'3","reported_seq":31,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.071339+0000","last_change":"2024-04-14T09:59:57.734358+0000","last_active":"2024-04-14T10:00:05.071339+0000","last_peered":"2024-04-14T10:00:05.071339+0000","last_clean":"2024-04-14T10:00:05.071339+0000","last_became_active":"2024-04-14T09:59:36.654881+0000","last_became_peered":"2024-04-14T09:59:36.654881+0000","last_unstale":"2024-04-14T10:00:05.071339+0000","last_undegraded":"2024-04-14T10:00:05.071339+0000","last_fullsized":"2024-04-14T10:00:05.071339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'3","last_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_deep_scrub":"39'3","last_deep_scrub_stamp":"2024-04-14T09:59:57.734246+0000","last_clean_scrub_stamp":"2024-04-14T09:59:57.734246+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T14:47:37.219837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:07.394029+0000","last_change":"2024-04-14T10:00:07.394029+0000","last_active":"2024-04-14T10:00:07.394029+0000","last_peered":"2024-04-14T10:00:07.394029+0000","last_clean":"2024-04-14T10:00:07.394029+0000","last_became_active":"2024-04-14T09:59:37.671989+0000","last_became_peered":"2024-04-14T09:59:37.671989+0000","last_unstale":"2024-04-14T10:00:07.394029+0000","last_undegraded":"2024-04-14T10:00:07.394029+0000","last_fullsized":"2024-04-14T10:00:07.394029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:07.393916+0000","last_clean_scrub_stamp":"2024-04-14T10:00:07.393916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T17:31:28.505378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939257+0000","last_change":"2024-04-14T09:59:52.539549+0000","last_active":"2024-04-14T10:00:04.939257+0000","last_peered":"2024-04-14T10:00:04.939257+0000","last_clean":"2024-04-14T10:00:04.939257+0000","last_became_active":"2024-04-14T09:59:36.654329+0000","last_became_peered":"2024-04-14T09:59:36.654329+0000","last_unstale":"2024-04-14T10:00:04.939257+0000","last_undegraded":"2024-04-14T10:00:04.939257+0000","last_fullsized":"2024-04-14T10:00:04.939257+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:52.539450+0000","last_clean_scrub_stamp":"2024-04-14T09:59:52.539450+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:02.884608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939267+0000","last_change":"2024-04-14T09:59:55.531351+0000","last_active":"2024-04-14T10:00:04.939267+0000","last_peered":"2024-04-14T10:00:04.939267+0000","last_clean":"2024-04-14T10:00:04.939267+0000","last_became_active":"2024-04-14T09:59:37.660366+0000","last_became_peered":"2024-04-14T09:59:37.660366+0000","last_unstale":"2024-04-14T10:00:04.939267+0000","last_undegraded":"2024-04-14T10:00:04.939267+0000","last_fullsized":"2024-04-14T10:00:04.939267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:55.531265+0000","last_clean_scrub_stamp":"2024-04-14T09:59:55.531265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T16:31:33.153149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.939238+0000","last_change":"2024-04-14T09:59:54.500040+0000","last_active":"2024-04-14T10:00:04.939238+0000","last_peered":"2024-04-14T10:00:04.939238+0000","last_clean":"2024-04-14T10:00:04.939238+0000","last_became_active":"2024-04-14T09:59:36.658259+0000","last_became_peered":"2024-04-14T09:59:36.658259+0000","last_unstale":"2024-04-14T10:00:04.939238+0000","last_undegraded":"2024-04-14T10:00:04.939238+0000","last_fullsized":"2024-04-14T10:00:04.939238+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.499950+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.499950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:14:52.951285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650147+0000","last_change":"2024-04-14T09:59:56.989320+0000","last_active":"2024-04-14T10:00:05.650147+0000","last_peered":"2024-04-14T10:00:05.650147+0000","last_clean":"2024-04-14T10:00:05.650147+0000","last_became_active":"2024-04-14T09:59:37.659078+0000","last_became_peered":"2024-04-14T09:59:37.659078+0000","last_unstale":"2024-04-14T10:00:05.650147+0000","last_undegraded":"2024-04-14T10:00:05.650147+0000","last_fullsized":"2024-04-14T10:00:05.650147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.989204+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.989204+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T15:54:04.894765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937822+0000","last_change":"2024-04-14T09:59:58.192476+0000","last_active":"2024-04-14T10:00:04.937822+0000","last_peered":"2024-04-14T10:00:04.937822+0000","last_clean":"2024-04-14T10:00:04.937822+0000","last_became_active":"2024-04-14T09:59:36.653448+0000","last_became_peered":"2024-04-14T09:59:36.653448+0000","last_unstale":"2024-04-14T10:00:04.937822+0000","last_undegraded":"2024-04-14T10:00:04.937822+0000","last_fullsized":"2024-04-14T10:00:04.937822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:58.192385+0000","last_clean_scrub_stamp":"2024-04-14T09:59:58.192385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T13:32:08.537543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.651632+0000","last_change":"2024-04-14T10:00:01.730883+0000","last_active":"2024-04-14T10:00:05.651632+0000","last_peered":"2024-04-14T10:00:05.651632+0000","last_clean":"2024-04-14T10:00:05.651632+0000","last_became_active":"2024-04-14T09:59:37.671157+0000","last_became_peered":"2024-04-14T09:59:37.671157+0000","last_unstale":"2024-04-14T10:00:05.651632+0000","last_undegraded":"2024-04-14T10:00:05.651632+0000","last_fullsized":"2024-04-14T10:00:05.651632+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:01.730793+0000","last_clean_scrub_stamp":"2024-04-14T10:00:01.730793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:14:09.232670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.650921+0000","last_change":"2024-04-14T09:59:56.632891+0000","last_active":"2024-04-14T10:00:05.650921+0000","last_peered":"2024-04-14T10:00:05.650921+0000","last_clean":"2024-04-14T10:00:05.650921+0000","last_became_active":"2024-04-14T09:59:36.656221+0000","last_became_peered":"2024-04-14T09:59:36.656221+0000","last_unstale":"2024-04-14T10:00:05.650921+0000","last_undegraded":"2024-04-14T10:00:05.650921+0000","last_fullsized":"2024-04-14T10:00:05.650921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:56.632797+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.632797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T11:21:54.901696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":26,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937188+0000","last_change":"2024-04-14T10:00:02.037396+0000","last_active":"2024-04-14T10:00:04.937188+0000","last_peered":"2024-04-14T10:00:04.937188+0000","last_clean":"2024-04-14T10:00:04.937188+0000","last_became_active":"2024-04-14T09:59:37.658329+0000","last_became_peered":"2024-04-14T09:59:37.658329+0000","last_unstale":"2024-04-14T10:00:04.937188+0000","last_undegraded":"2024-04-14T10:00:04.937188+0000","last_fullsized":"2024-04-14T10:00:04.937188+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:00:02.037312+0000","last_clean_scrub_stamp":"2024-04-14T10:00:02.037312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T10:46:06.917126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:05.427262+0000","last_change":"2024-04-14T09:59:54.497946+0000","last_active":"2024-04-14T10:00:05.427262+0000","last_peered":"2024-04-14T10:00:05.427262+0000","last_clean":"2024-04-14T10:00:05.427262+0000","last_became_active":"2024-04-14T09:59:36.651528+0000","last_became_peered":"2024-04-14T09:59:36.651528+0000","last_unstale":"2024-04-14T10:00:05.427262+0000","last_undegraded":"2024-04-14T10:00:05.427262+0000","last_fullsized":"2024-04-14T10:00:05.427262+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:54.497855+0000","last_clean_scrub_stamp":"2024-04-14T09:59:54.497855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T12:20:26.276587+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:02:39.676844+0000","last_change":"2024-04-14T10:02:39.676885+0000","last_active":"2024-04-14T10:02:39.676844+0000","last_peered":"2024-04-14T10:02:39.676844+0000","last_clean":"2024-04-14T10:02:39.676844+0000","last_became_active":"2024-04-14T10:00:05.430230+0000","last_became_peered":"2024-04-14T10:00:05.430230+0000","last_unstale":"2024-04-14T10:02:39.676844+0000","last_undegraded":"2024-04-14T10:02:39.676844+0000","last_fullsized":"2024-04-14T10:02:39.676844+0000","mapping_epoch":40,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":41,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T10:02:39.676722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T10:02:39.676722+0000","last_clean_scrub_stamp":"2024-04-14T10:02:39.676722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:45:27.860966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:04.937407+0000","last_change":"2024-04-14T09:59:59.085280+0000","last_active":"2024-04-14T10:00:04.937407+0000","last_peered":"2024-04-14T10:00:04.937407+0000","last_clean":"2024-04-14T10:00:04.937407+0000","last_became_active":"2024-04-14T09:59:36.657093+0000","last_became_peered":"2024-04-14T09:59:36.657093+0000","last_unstale":"2024-04-14T10:00:04.937407+0000","last_undegraded":"2024-04-14T10:00:04.937407+0000","last_fullsized":"2024-04-14T10:00:04.937407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-14T09:59:59.085191+0000","last_clean_scrub_stamp":"2024-04-14T09:59:59.085191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T21:58:13.184739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"39'119","reported_seq":220,"reported_epoch":41,"state":"active+clean","last_fresh":"2024-04-14T10:00:14.837176+0000","last_change":"2024-04-14T09:59:56.018373+0000","last_active":"2024-04-14T10:00:14.837176+0000","last_peered":"2024-04-14T10:00:14.837176+0000","last_clean":"2024-04-14T10:00:14.837176+0000","last_became_active":"2024-04-14T09:58:12.863213+0000","last_became_peered":"2024-04-14T09:58:12.863213+0000","last_unstale":"2024-04-14T10:00:14.837176+0000","last_undegraded":"2024-04-14T10:00:14.837176+0000","last_fullsized":"2024-04-14T10:00:14.837176+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"39'119","last_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_deep_scrub":"39'119","last_deep_scrub_stamp":"2024-04-14T09:59:56.018230+0000","last_clean_scrub_stamp":"2024-04-14T09:59:56.018230+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-15T20:15:26.083698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":7943,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1089536,"data_stored":804979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574908,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":483328,"data_stored":207508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":483328,"data_stored":208000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":214575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":479232,"data_stored":207466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":479232,"data_stored":207486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1073152,"data_stored":797798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7179,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":7215,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-14T10:02:59.187 DEBUG:teuthology.orchestra.run.smithi040:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-14T10:02:59.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.322+0000 7f8e85836640 1 Processor -- start 2024-04-14T10:02:59.323 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.322+0000 7f8e85836640 1 -- start start 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e85836640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e800ccca0 0x7f8e8006f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e85836640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8e8006fb70 0x7f8e8015fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e85836640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e800cdf50 con 0x7f8e8015c3c0 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e85836640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800cfd20 con 0x7f8e800ccca0 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e85836640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8e800d0000 con 0x7f8e8006fb70 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e800ccca0 0x7f8e8006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.325 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7effd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7f8e8015c3c0 0x7f8e800d0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33664/0 (socket says 172.21.15.40:33664) 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7e7fc640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7f8e800ccca0 0x7f8e8006f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38986/0 (socket says 172.21.15.40:38986) 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7effd640 1 -- 172.21.15.40:0/1940325084 learned_addr learned my addr 172.21.15.40:0/1940325084 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7f7fe640 1 --2- 172.21.15.40:0/1940325084 >> v2:172.21.15.136:3300/0 conn(0x7f8e8006fb70 0x7f8e8015fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.323+0000 7f8e7e7fc640 1 -- 172.21.15.40:0/1940325084 >> v2:172.21.15.136:3300/0 conn(0x7f8e8006fb70 msgr2=0x7f8e8015fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7e7fc640 1 --2- 172.21.15.40:0/1940325084 >> v2:172.21.15.136:3300/0 conn(0x7f8e8006fb70 0x7f8e8015fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7e7fc640 1 -- 172.21.15.40:0/1940325084 >> v1:172.21.15.40:6789/0 conn(0x7f8e8015c3c0 legacy=0x7f8e800d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7dffb640 1 -- 172.21.15.40:0/1940325084 <== mon.0 v1:172.21.15.40:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641123289 0 0) 0x7f8e800cdf50 con 0x7f8e8015c3c0 2024-04-14T10:02:59.326 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7e7fc640 1 -- 172.21.15.40:0/1940325084 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800d02e0 con 0x7f8e800ccca0 2024-04-14T10:02:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7e7fc640 1 --2- 172.21.15.40:0/1940325084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e800ccca0 0x7f8e8006f630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8e80071640 tx=0x7f8e6802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4ccc6ad0d0532f server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7dffb640 1 -- 172.21.15.40:0/1940325084 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68035020 con 0x7f8e800ccca0 2024-04-14T10:02:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7dffb640 1 -- 172.21.15.40:0/1940325084 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e68031830 con 0x7f8e800ccca0 2024-04-14T10:02:59.327 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.324+0000 7f8e7dffb640 1 -- 172.21.15.40:0/1940325084 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e68031c00 con 0x7f8e800ccca0 2024-04-14T10:02:59.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 -- 172.21.15.40:0/1940325084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e800ccca0 msgr2=0x7f8e8006f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.330 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 --2- 172.21.15.40:0/1940325084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e800ccca0 0x7f8e8006f630 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f8e80071640 tx=0x7f8e6802b8d0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 -- 172.21.15.40:0/1940325084 shutdown_connections 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 --2- 172.21.15.40:0/1940325084 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e800ccca0 0x7f8e8006f630 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 --2- 172.21.15.40:0/1940325084 >> v2:172.21.15.136:3300/0 conn(0x7f8e8006fb70 0x7f8e8015fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 -- 172.21.15.40:0/1940325084 >> 172.21.15.40:0/1940325084 conn(0x7f8e800d20b0 msgr2=0x7f8e800d24c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 -- 172.21.15.40:0/1940325084 shutdown_connections 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.325+0000 7f8e85836640 1 -- 172.21.15.40:0/1940325084 wait complete. 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.326+0000 7f8e85836640 1 Processor -- start 2024-04-14T10:02:59.331 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.326+0000 7f8e85836640 1 -- start start 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 0x7f8e80157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 0x7f8e800c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7f8e800cdbb0 con 0x7f8e8015c3c0 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8015c7a0 con 0x7f8e800ccca0 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e85836640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8e800cdd30 con 0x7f8e8006fb70 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.332 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7e7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 0x7f8e800c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7f7fe640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:38998/0 (socket says 172.21.15.40:38998) 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7f7fe640 1 -- 172.21.15.40:0/2034239039 learned_addr learned my addr 172.21.15.40:0/2034239039 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7effd640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 0x7f8e80157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7f7fe640 1 -- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 msgr2=0x7f8e80157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.327+0000 7f8e7f7fe640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 0x7f8e80157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7f7fe640 1 -- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 msgr2=0x7f8e800c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.333 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7f7fe640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 0x7f8e800c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7f7fe640 1 -- 172.21.15.40:0/2034239039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e800ca940 con 0x7f8e8015c3c0 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7effd640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 0x7f8e80157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7e7fc640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 0x7f8e800c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e7f7fe640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009dd0 tx=0x7f8e7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70018020 con 0x7f8e8015c3c0 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e70014480 con 0x7f8e8015c3c0 2024-04-14T10:02:59.334 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e70014870 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e800c9dc0 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.328+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e800ca380 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.329+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e800b1810 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.329+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e70005d10 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.330+0000 7f8e77fff640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 0x7f8e6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.330+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7f8e7008c930 con 0x7f8e8015c3c0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.330+0000 7f8e7effd640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 0x7f8e6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.335 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.330+0000 7f8e7effd640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 0x7f8e6006edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8e78007fd0 tx=0x7f8e78007de0 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.336 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.334+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7f8e70022030 con 0x7f8e8015c3c0 2024-04-14T10:02:59.519 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.519+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f8e800756f0 con 0x7f8e8015c3c0 2024-04-14T10:02:59.522 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.521+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v11)=0 v11) ==== 123+0+0 (secure 0 0 0) 0x7f8e70010040 con 0x7f8e8015c3c0 2024-04-14T10:02:59.523 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.523+0000 7f8e77fff640 1 -- 172.21.15.40:0/2034239039 <== mon.0 v2:172.21.15.40:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8e7005a5f0 con 0x7f8e8015c3c0 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 msgr2=0x7f8e6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 0x7f8e6006edb0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f8e78007fd0 tx=0x7f8e78007de0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 msgr2=0x7f8e800c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009dd0 tx=0x7f8e7000c490 comp rx=0 tx=0).stop 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 shutdown_connections 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7f8e6006c8f0 0x7f8e6006edb0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7f8e8015c3c0 0x7f8e800c84d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.525 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8e800ccca0 0x7f8e800c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 --2- 172.21.15.40:0/2034239039 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8e8006fb70 0x7f8e80157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 >> 172.21.15.40:0/2034239039 conn(0x7f8e800d20b0 msgr2=0x7f8e800cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:59.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 shutdown_connections 2024-04-14T10:02:59.526 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.524+0000 7f8e85836640 1 -- 172.21.15.40:0/2034239039 wait complete. 2024-04-14T10:02:59.535 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-14T10:02:59.535 DEBUG:teuthology.orchestra.run.smithi040:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-14T10:02:59.636 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.636+0000 7fa6120b7640 1 Processor -- start 2024-04-14T10:02:59.637 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.636+0000 7fa6120b7640 1 -- start start 2024-04-14T10:02:59.638 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa6120b7640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa60c0d15a0 0x7fa60c0cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa6120b7640 1 -- --> v1:172.21.15.40:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c0ceda0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa6120b7640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60c0cf040 con 0x7fa60c15e510 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa6120b7640 1 -- --> v2:172.21.15.40:3300/0 -- mon_getmap magic: 0 -- 0x7fa60c0d19c0 con 0x7fa60c0d15a0 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60bfff640 1 --2- >> v2:172.21.15.40:3300/0 conn(0x7fa60c0d15a0 0x7fa60c0cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60affd640 1 --1- >> v1:172.21.15.40:6789/0 conn(0x7fa60c0d2f10 0x7fa60c0d0e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.40:6789/0 says I am v1:172.21.15.40:33674/0 (socket says 172.21.15.40:33674) 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60affd640 1 -- 172.21.15.40:0/2487018948 learned_addr learned my addr 172.21.15.40:0/2487018948 (peer_addr_for_me v1:172.21.15.40:0/0) 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60bfff640 1 -- 172.21.15.40:0/2487018948 >> v1:172.21.15.136:6789/0 conn(0x7fa60c15e510 legacy=0x7fa60c0d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.639 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60bfff640 1 -- 172.21.15.40:0/2487018948 >> v1:172.21.15.40:6789/0 conn(0x7fa60c0d2f10 legacy=0x7fa60c0d0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.637+0000 7fa60a7fc640 1 -- 172.21.15.40:0/2487018948 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859108155 0 0) 0x7fa60c0cf040 con 0x7fa60c15e510 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.638+0000 7fa60bfff640 1 -- 172.21.15.40:0/2487018948 --> v2:172.21.15.40:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0cf320 con 0x7fa60c0d15a0 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.638+0000 7fa60bfff640 1 --2- 172.21.15.40:0/2487018948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d15a0 0x7fa60c0cfe00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa604009d90 tx=0x7fa60402bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9af2bc5b00c796d server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.638+0000 7fa60a7fc640 1 -- 172.21.15.40:0/2487018948 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604039070 con 0x7fa60c0d15a0 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.638+0000 7fa60a7fc640 1 -- 172.21.15.40:0/2487018948 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa60402ca20 con 0x7fa60c0d15a0 2024-04-14T10:02:59.640 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.638+0000 7fa60a7fc640 1 -- 172.21.15.40:0/2487018948 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60402ce10 con 0x7fa60c0d15a0 2024-04-14T10:02:59.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 -- 172.21.15.40:0/2487018948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d15a0 msgr2=0x7fa60c0cfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 --2- 172.21.15.40:0/2487018948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d15a0 0x7fa60c0cfe00 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fa604009d90 tx=0x7fa60402bcf0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.643 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 -- 172.21.15.40:0/2487018948 shutdown_connections 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 --2- 172.21.15.40:0/2487018948 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d15a0 0x7fa60c0cfe00 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 -- 172.21.15.40:0/2487018948 >> 172.21.15.40:0/2487018948 conn(0x7fa60c09d570 msgr2=0x7fa60c0d4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 -- 172.21.15.40:0/2487018948 shutdown_connections 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.639+0000 7fa6120b7640 1 -- 172.21.15.40:0/2487018948 wait complete. 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.640+0000 7fa6120b7640 1 Processor -- start 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.640+0000 7fa6120b7640 1 -- start start 2024-04-14T10:02:59.644 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa60c0d15a0 0x7fa60c0c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa60c15e510 0x7fa60c1f7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 -- --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c0b3ad0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.645 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c15e8f0 con 0x7fa60c15e510 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa6120b7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa60c0b3c50 con 0x7fa60c0d15a0 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa60affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa60affd640 1 --2- >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.40:3300/0 says I am v2:172.21.15.40:39030/0 (socket says 172.21.15.40:39030) 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa60affd640 1 -- 172.21.15.40:0/1844555340 learned_addr learned my addr 172.21.15.40:0/1844555340 (peer_addr_for_me v2:172.21.15.40:0/0) 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa60b7fe640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa60c0d15a0 0x7fa60c0c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.646 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.641+0000 7fa60bfff640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa60c15e510 0x7fa60c1f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 -- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa60c0d15a0 msgr2=0x7fa60c0c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa60c0d15a0 0x7fa60c0c94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 -- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa60c15e510 msgr2=0x7fa60c1f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa60c15e510 0x7fa60c1f7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 -- 172.21.15.40:0/1844555340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c0ccf40 con 0x7fa60c0d2f10 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa60affd640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c780 tx=0x7fa60000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600017070 con 0x7fa60c0d2f10 2024-04-14T10:02:59.647 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa600005a70 con 0x7fa60c0d2f10 2024-04-14T10:02:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c0cd220 con 0x7fa60c0d2f10 2024-04-14T10:02:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600007070 con 0x7fa60c0d2f10 2024-04-14T10:02:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.642+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c0cd7e0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.648 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.643+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c0756f0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.643+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa60001a070 con 0x7fa60c0d2f10 2024-04-14T10:02:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.644+0000 7fa5f3fff640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-14T10:02:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.644+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6130+0+0 (secure 0 0 0) 0x7fa60008b180 con 0x7fa60c0d2f10 2024-04-14T10:02:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.644+0000 7fa60b7fe640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-14T10:02:59.650 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.644+0000 7fa60b7fe640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 0x7fa5f806edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000f60 tx=0x7fa5fc009040 comp rx=0 tx=0).ready entity=mgr.4114 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-14T10:02:59.651 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.648+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187049 (secure 0 0 0) 0x7fa600058db0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.873 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.873+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 --> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60c15dbd0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.874 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.873+0000 7fa5f3fff640 1 -- 172.21.15.40:0/1844555340 <== mon.0 v2:172.21.15.40:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5184 (secure 0 0 0) 0x7fa60005d0b0 con 0x7fa60c0d2f10 2024-04-14T10:02:59.874 INFO:teuthology.orchestra.run.smithi040.stdout: 2024-04-14T10:02:59.874 INFO:teuthology.orchestra.run.smithi040.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5018,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6837/430592988","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6835","nonce":430592988},{"type":"v1","addr":"172.21.15.136:6837","nonce":430592988}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5310,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6833/1065065307","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6832","nonce":1065065307},{"type":"v1","addr":"172.21.15.40:6833","nonce":1065065307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":5313,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.40:6835/2180057223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.40:6834","nonce":2180057223},{"type":"v1","addr":"172.21.15.40:6835","nonce":2180057223}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-14T09:59:37.013311+0000","modified":"2024-04-14T09:59:40.023578+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5329},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5329":{"gid":5329,"name":"d","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6836/2048712446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6834","nonce":2048712446},{"type":"v1","addr":"172.21.15.136:6836","nonce":2048712446}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5329,"qdb_cluster":[5329]},"id":2}]} 2024-04-14T10:02:59.875 INFO:teuthology.orchestra.run.smithi040.stderr:dumped fsmap epoch 17 2024-04-14T10:02:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 msgr2=0x7fa5f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 0x7fa5f806edb0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc000f60 tx=0x7fa5fc009040 comp rx=0 tx=0).stop 2024-04-14T10:02:59.876 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 msgr2=0x7fa60c161330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa60000c780 tx=0x7fa60000cc40 comp rx=0 tx=0).stop 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 shutdown_connections 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:6832/2043813119,v1:172.21.15.136:6833/2043813119] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa60c15e510 0x7fa60c1f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.40:3300/0,v1:172.21.15.40:6789/0] conn(0x7fa60c0d2f10 0x7fa60c161330 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 --2- 172.21.15.40:0/1844555340 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa60c0d15a0 0x7fa60c0c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 >> 172.21.15.40:0/1844555340 conn(0x7fa60c09d570 msgr2=0x7fa60c06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 shutdown_connections 2024-04-14T10:02:59.877 INFO:teuthology.orchestra.run.smithi040.stderr:2024-04-14T10:02:59.876+0000 7fa6120b7640 1 -- 172.21.15.40:0/1844555340 wait complete. 2024-04-14T10:02:59.887 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-14T10:02:59.887 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-14T10:02:59.887 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-14T10:02:59.887 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:02:59.896 INFO:tasks.ceph.mds.a:Stopped 2024-04-14T10:02:59.897 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-14T10:02:59.897 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:02:59.946 INFO:tasks.ceph.mds.c:Stopped 2024-04-14T10:02:59.947 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-14T10:02:59.947 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:02:59.956 INFO:tasks.ceph.mds.b:Stopped 2024-04-14T10:02:59.956 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-14T10:02:59.957 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.007 INFO:tasks.ceph.mds.d:Stopped 2024-04-14T10:03:00.007 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-14T10:03:00.007 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-14T10:03:00.008 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.043 INFO:tasks.ceph.osd.0:Stopped 2024-04-14T10:03:00.043 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-14T10:03:00.043 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.108 INFO:tasks.ceph.osd.1:Stopped 2024-04-14T10:03:00.109 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-14T10:03:00.109 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.177 INFO:tasks.ceph.osd.2:Stopped 2024-04-14T10:03:00.177 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-14T10:03:00.177 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.247 INFO:tasks.ceph.osd.3:Stopped 2024-04-14T10:03:00.248 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-14T10:03:00.248 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.286 INFO:tasks.ceph.osd.4:Stopped 2024-04-14T10:03:00.287 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-14T10:03:00.287 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.357 INFO:tasks.ceph.osd.5:Stopped 2024-04-14T10:03:00.357 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-14T10:03:00.357 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.422 INFO:tasks.ceph.osd.6:Stopped 2024-04-14T10:03:00.422 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-14T10:03:00.423 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.486 INFO:tasks.ceph.osd.7:Stopped 2024-04-14T10:03:00.487 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-14T10:03:00.487 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-14T10:03:00.487 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.512 INFO:tasks.ceph.mgr.y:Stopped 2024-04-14T10:03:00.513 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-14T10:03:00.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.555 INFO:tasks.ceph.mgr.x:Stopped 2024-04-14T10:03:00.555 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-14T10:03:00.555 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-14T10:03:00.556 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.568 INFO:tasks.ceph.mon.a:Stopped 2024-04-14T10:03:00.568 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-14T10:03:00.568 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.606 INFO:tasks.ceph.mon.b:Stopped 2024-04-14T10:03:00.607 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-14T10:03:00.607 INFO:teuthology.orchestra.run:waiting for 300 2024-04-14T10:03:00.657 INFO:tasks.ceph.mon.c:Stopped 2024-04-14T10:03:00.658 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-14T10:03:00.658 DEBUG:teuthology.orchestra.run.smithi040:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-04-14T10:03:00.693 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T10:03:00.693 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-14T10:03:00.884 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T10:03:00.885 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-14T10:03:01.000 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T10:03:01.000 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-14T10:03:01.074 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T10:03:01.074 DEBUG:teuthology.orchestra.run.smithi040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-14T10:03:01.123 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T10:03:01.124 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-14T10:03:01.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T10:03:01.278 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-14T10:03:01.375 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T10:03:01.375 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-14T10:03:01.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T10:03:01.433 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-14T10:03:01.500 INFO:tasks.ceph:Archiving mon data... 2024-04-14T10:03:01.502 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/data/mon.a.tgz 2024-04-14T10:03:01.502 DEBUG:teuthology.orchestra.run.smithi040:> mktemp 2024-04-14T10:03:01.518 INFO:teuthology.orchestra.run.smithi040.stdout:/tmp/tmp.cTnD58lX79 2024-04-14T10:03:01.519 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.cTnD58lX79 2024-04-14T10:03:01.660 DEBUG:teuthology.orchestra.run.smithi040:> sudo chmod 0666 /tmp/tmp.cTnD58lX79 2024-04-14T10:03:01.746 DEBUG:teuthology.orchestra.remote:smithi040:/tmp/tmp.cTnD58lX79 is 326KB 2024-04-14T10:03:01.841 DEBUG:teuthology.orchestra.run.smithi040:> rm -fr /tmp/tmp.cTnD58lX79 2024-04-14T10:03:01.855 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/data/mon.b.tgz 2024-04-14T10:03:01.855 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-14T10:03:01.873 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.XdxUXpJwg5 2024-04-14T10:03:01.874 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.XdxUXpJwg5 2024-04-14T10:03:02.061 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.XdxUXpJwg5 2024-04-14T10:03:02.146 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.XdxUXpJwg5 is 438KB 2024-04-14T10:03:02.245 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.XdxUXpJwg5 2024-04-14T10:03:02.260 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/data/mon.c.tgz 2024-04-14T10:03:02.261 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-04-14T10:03:02.315 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.88MIHKJKPb 2024-04-14T10:03:02.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.88MIHKJKPb 2024-04-14T10:03:02.462 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.88MIHKJKPb 2024-04-14T10:03:02.548 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.88MIHKJKPb is 438KB 2024-04-14T10:03:02.644 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.88MIHKJKPb 2024-04-14T10:03:02.659 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-14T10:03:02.659 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T10:03:02.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-14T10:03:02.747 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T10:03:02.780 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-14T10:03:02.780 INFO:tasks.ceph:Archiving crash dumps... 2024-04-14T10:03:02.782 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi040/crash 2024-04-14T10:03:02.783 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T10:03:02.818 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi136/crash 2024-04-14T10:03:02.819 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-14T10:03:02.846 INFO:tasks.ceph:Shutting down logrotate 2024-04-14T10:03:02.846 DEBUG:teuthology.orchestra.run.smithi040:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.943 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-14T10:03:02.999 INFO:tasks.ceph:Compressing logs... 2024-04-14T10:03:03.000 DEBUG:teuthology.orchestra.run.smithi040:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T10:03:03.015 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-14T10:03:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2024-04-14T10:03:03.041 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54494.log 2024-04-14T10:03:03.083 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37963.log 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37723.log 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37963.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37723.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37963.log.gz 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37723.log.gz 2024-04-14T10:03:03.084 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38003.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37843.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.38003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37923.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38003.log.gz 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37843.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37923.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37843.log.gz 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37923.log.gz 2024-04-14T10:03:03.085 INFO:teuthology.orchestra.run.smithi136.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37763.log 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37883.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44097.log 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37763.log.gz 2024-04-14T10:03:03.086 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37803.log 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.3.44097.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.3.44097.log.gz 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr: --verbose -- /var/log/ceph/ceph.log 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37803.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37803.log.gz 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43699.log 2024-04-14T10:03:03.087 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.d.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T10:03:03.091 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-14T10:03:03.092 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.1.43699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43699.log.gz 2024-04-14T10:03:03.130 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.c.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-14T10:03:03.136 INFO:teuthology.orchestra.run.smithi136.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-14T10:03:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49056.log/var/log/ceph/ceph-client.admin.46203.log: 2024-04-14T10:03:03.143 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44852.log 2024-04-14T10:03:03.143 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2024-04-14T10:03:03.143 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54494.log.gz 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43278.log 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44852.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49056.log.gz 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43765.log 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44852.log.gz 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43278.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45881.log 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43278.log.gz 2024-04-14T10:03:03.144 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45872.log 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43765.log.gz 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45618.log 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45872.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45881.log.gz 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49392.log 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45872.log.gz 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47232.log 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49392.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.45618.log.gz --verbose 2024-04-14T10:03:03.145 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.46836.log 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47232.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49392.log.gz 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50715.log 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47232.log.gz 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50715.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.46878.log 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46836.log.gz 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54410.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50715.log.gz 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51363.log 2024-04-14T10:03:03.146 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52705.log 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46878.log.gz 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46555.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51363.log.gz 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49686.log 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50511.log 2024-04-14T10:03:03.147 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49686.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.51573.log 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52705.log.gz 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50511.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49686.log.gz 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46220.log 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50511.log.gz/var/log/ceph/ceph-client.admin.51573.log: 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45366.log 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51776.log 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51573.log.gz 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45366.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46220.log.gz 2024-04-14T10:03:03.148 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45366.log.gz 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54537.log 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2%/var/log/ceph/ceph-client.admin.46435.log: -- replaced with /var/log/ceph/ceph-client.admin.51776.log.gz 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51447.log 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53343.log 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54537.log.gz 2024-04-14T10:03:03.149 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54284.log 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51447.log.gz 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54284.log: gzip -5 89.3% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.53343.log.gz /var/log/ceph/ceph-client.admin.47400.log 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49560.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54284.log.gz 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50985.log 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.47400.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53762.log 2024-04-14T10:03:03.150 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51153.log 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47400.log.gz 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53762.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50985.log.gz 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53259.log 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53762.log.gz 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47022.log 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51153.log.gz 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49140.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2024-04-14T10:03:03.151 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49602.log 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44936.log 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47022.log.gz 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44936.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49602.log.gz 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50799.log 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44936.log.gz 2024-04-14T10:03:03.152 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51818.log 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52029.log 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51818.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50799.log.gz 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37700.log 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51818.log.gz 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46554.log 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52029.log.gz 2024-04-14T10:03:03.153 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46554.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37700.log.gz 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47274.log 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46554.log.gz 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.46218.log: /var/log/ceph/ceph-client.admin.43489.log 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49182.log 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43489.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47274.log.gz 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52155.log 2024-04-14T10:03:03.154 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43489.log.gz 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50883.log 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49182.log.gz 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50883.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52155.log.gz 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54597.log 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50883.log.gz 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54714.log 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2024-04-14T10:03:03.155 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54714.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54597.log.gz 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54714.log.gz 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54846.log 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54888.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48930.log 2024-04-14T10:03:03.156 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.54846.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50925.log 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45884.log 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54846.log.gz 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50925.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48930.log.gz 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43320.log 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50925.log.gz 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53427.log 2024-04-14T10:03:03.157 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45884.log.gz 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53427.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43320.log.gz 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46556.log 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53427.log.gz 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48846.log 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55090.log 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46556.log.gz 2024-04-14T10:03:03.158 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50337.log 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48846.log.gz 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43807.log 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53720.log 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55090.log.gz 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43807.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50337.log.gz 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46920.log 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43807.log.gz 2024-04-14T10:03:03.159 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50427.log 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46920.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.45576.log 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53720.log.gz 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50427.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46920.log.gz 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50427.log.gz 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.45576.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43637.log 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46215.log 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45576.log.gz 2024-04-14T10:03:03.160 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43637.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gz 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49266.log 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43637.log.gz 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.46215.log: -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45660.log 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46215.log.gz 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.audit.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49266.log.gz 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43933.log 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45036.log 2024-04-14T10:03:03.161 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45660.log.gz 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44535.log 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51069.log 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45036.log: 88.6% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44535.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45036.log.gz 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44726.log 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43405.log 2024-04-14T10:03:03.162 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44726.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51069.log.gz 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52663.log 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44726.log.gz 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54242.log 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53001.log 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43405.log.gz 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.44535.log.gz 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54242.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52663.log.gz 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-04-14T10:03:03.163 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45883.log 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.0.53001.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54242.log.gz 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53001.log.gz 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.49350.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.50127.log 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45883.log: gzip -5 89.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz /var/log/ceph/ceph-client.admin.49224.log 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50127.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45883.log.gz 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52453.log 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50127.log.gz 2024-04-14T10:03:03.164 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51279.log 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49224.log.gz 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51279.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52453.log.gz 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45534.log 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51279.log.gz 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49839.log 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45534.log: gzip -5 --verbose 88.7% -- -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2024-04-14T10:03:03.165 INFO:teuthology.orchestra.run.smithi040.stderr: /var/log/ceph/ceph-client.admin.48636.log 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49839.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45534.log.gz -5 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51987.log 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49839.log.gz 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45408.log 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48636.log.gz 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51903.log 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45408.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51987.log.gz 2024-04-14T10:03:03.166 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47064.log 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45408.log.gz 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45324.log 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51903.log.gz 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48804.log 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45324.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47064.log.gz 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45324.log.gz 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46752.log 2024-04-14T10:03:03.167 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48804.log.gz 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46752.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48972.log 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46752.log.gz 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55132.log 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48972.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43197.log 2024-04-14T10:03:03.168 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55132.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48972.log.gz 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31672.log 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55132.log.gz 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45282.log 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43197.log.gz/var/log/ceph/ceph.tmp-client.admin.31672.log: 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31672.log.gz 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52579.log 2024-04-14T10:03:03.169 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45282.log.gz 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51027.log 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53846.log 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51027.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52579.log.gz 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45078.log 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53804.log 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51027.log.gz 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53846.log: /var/log/ceph/ceph-client.admin.45078.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53846.log.gz 2024-04-14T10:03:03.170 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50553.log 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45078.log.gz 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50253.log 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53804.log: /var/log/ceph/ceph-client.admin.50553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50757.log 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53804.log.gz 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50553.log.gz 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45702.log 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50253.log.gz 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44810.log 2024-04-14T10:03:03.171 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50757.log.gz 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52241.log 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45702.log: /var/log/ceph/ceph-client.admin.44810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45702.log.gz 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44810.log.gz 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52327.log 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52241.log.gz 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46794.log 2024-04-14T10:03:03.172 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43531.log: /var/log/ceph/ceph-client.admin.52327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47484.log 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46794.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52327.log.gz 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54990.log 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47106.log 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46794.log.gz 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47484.log: /var/log/ceph/ceph-client.admin.54990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45450.log 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54990.log.gz 2024-04-14T10:03:03.173 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47106.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.47484.log.gz 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48113.log 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47106.log.gz 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46219.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45450.log.gz 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45204.log 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2024-04-14T10:03:03.174 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46545.log 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45204.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48113.log.gz 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48762.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45204.log.gz 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46962.log 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52113.log 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48552.log 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46962.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46545.log.gz 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-04-14T10:03:03.175 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46962.log.gz 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52113.log.gz 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.48552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45880.log 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48552.log.gz 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43575.log 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43849.log: /var/log/ceph/ceph-client.admin.45880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51489.log 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43575.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45880.log.gz 2024-04-14T10:03:03.176 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43575.log.gz 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49728.log 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50169.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51489.log.gz 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47190.log 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45162.log 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47190.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49728.log.gz 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-14T10:03:03.177 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47190.log.gz 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47442.log 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.3.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45162.log.gz 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48594.log 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52285.log 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47442.log: /var/log/ceph/ceph-client.admin.48594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45492.log 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47442.log.gz 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52369.log 2024-04-14T10:03:03.178 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48594.log.gz 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45492.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52285.log.gz 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44017.log 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48418.log 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52369.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45492.log.gz 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50841.log 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52369.log.gz 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44017.log.gz 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.2.48418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49923.log 2024-04-14T10:03:03.179 INFO:teuthology.orchestra.run.smithi040.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.48418.log.gz 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49098.log 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50841.log: /var/log/ceph/ceph-client.admin.49923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50469.log 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50841.log.gz 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49923.log.gz 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45875.log 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50469.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49098.log.gz 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54200.log 2024-04-14T10:03:03.180 INFO:teuthology.orchestra.run.smithi040.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50469.log.gz 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43447.log 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54200.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45875.log.gz 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43721.log 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.43447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54200.log.gz 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51615.log 2024-04-14T10:03:03.181 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43447.log.gz 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43721.log.gz 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47968.log 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45877.log 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51615.log: /var/log/ceph/ceph-client.0.47968.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.0.47968.log.gz 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.54032.log 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51615.log.gz 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52621.log 2024-04-14T10:03:03.182 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54032.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53301.log 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54032.log.gz 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53930.log 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51860.log 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53301.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52621.log.gz 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46550.log 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53301.log.gz 2024-04-14T10:03:03.183 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53930.log.gz 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:gzip/var/log/ceph/ceph-client.admin.46550.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51860.log.gz 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50637.log 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46550.log.gz 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0%/var/log/ceph/ceph-client.admin.47148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50295.log 2024-04-14T10:03:03.184 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43891.log 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52071.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50637.log.gz 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50295.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50049.log 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43891.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50295.log.gz 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54948.log 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43891.log.gz 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50049.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-14T10:03:03.185 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7%/var/log/ceph/ceph-client.admin.54948.log: -- replaced with /var/log/ceph/ceph-client.admin.50049.log.gz 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53990.log 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51321.log 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54948.log.gz 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52813.log 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51321.log: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46553.log 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53990.log.gz 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48678.log 2024-04-14T10:03:03.186 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51321.log.gz 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49014.log 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52813.log.gz 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46553.log: gzip/var/log/ceph/ceph-client.admin.48678.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54452.log 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46553.log.gz 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48678.log.gz 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5/var/log/ceph/ceph-client.admin.49014.log: --verbose -- /var/log/ceph/ceph-client.admin.54326.log 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54452.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49014.log.gz 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45882.log 2024-04-14T10:03:03.187 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54452.log.gz 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46217.log 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54326.log.gz 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52197.log 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45882.log.gz 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51945.log 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46217.log.gz 2024-04-14T10:03:03.188 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52411.log 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52197.log.gz 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51945.log.gz 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43020.log: --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52411.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr:gzip 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52411.log.gz 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51111.log 2024-04-14T10:03:03.189 INFO:teuthology.orchestra.run.smithi040.stderr: 89.5%/var/log/ceph/ceph-osd.0.log: -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45120.log 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43101.log 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.45120.log: 88.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52747.log 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51111.log.gz 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43101.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45120.log.gz 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47358.log 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49308.log 2024-04-14T10:03:03.190 INFO:teuthology.orchestra.run.smithi040.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43101.log.gz 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52747.log: /var/log/ceph/ceph-client.admin.47358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49308.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47358.log.gz 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51695.log 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49308.log.gz 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.38056.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.52747.log.gz 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-14T10:03:03.191 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51695.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49965.log 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51695.log.gz 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43679.log 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49965.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49965.log.gz 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48888.log 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr: 86.5% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43679.log.gz 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-04-14T10:03:03.192 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44768.log 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.48888.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44768.log: gzip 88.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.48888.log.gz --verbose 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr: -- /var/log/ceph/ceph-client.admin.54158.log 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46213.log 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44768.log.gz 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55050.log 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.46213.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2024-04-14T10:03:03.193 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46213.log.gz 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37953.log 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.55050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49881.log 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.37953.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55050.log.gz 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43363.log 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37953.log.gz 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54657.log 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49881.log.gz 2024-04-14T10:03:03.194 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44059.log 2024-04-14T10:03:03.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53636.log 2024-04-14T10:03:03.197 INFO:teuthology.orchestra.run.smithi040.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43363.log.gz 2024-04-14T10:03:03.197 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.44059.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54657.log.gz 2024-04-14T10:03:03.197 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51531.log 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53678.log 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.44059.log.gz/var/log/ceph/ceph-client.admin.51531.log: 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53636.log.gz 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51405.log 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51531.log.gz 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47648.log 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51405.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53678.log.gz -5 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-04-14T10:03:03.198 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.47648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43975.log 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51405.log.gz 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50007.log 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47648.log.gz 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.43975.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50595.log 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43975.log.gz 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2024-04-14T10:03:03.199 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.50595.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50007.log.gz 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53385.log 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.52537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50595.log.gz 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-mds.a.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51237.log 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.53385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.51237.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53385.log.gz 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51237.log.gz 2024-04-14T10:03:03.200 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr: 92.4%/var/log/ceph/ceph-client.admin.51195.log: -- replaced with /var/log/ceph/ceph-mds.a.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49434.log 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49644.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54074.log 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.49434.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr:/var/log/ceph/ceph-client.admin.54074.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49434.log.gz 2024-04-14T10:03:03.201 INFO:teuthology.orchestra.run.smithi040.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54074.log.gz 2024-04-14T10:03:03.202 INFO:teuthology.orchestra.run.smithi136.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-14T10:03:03.248 INFO:teuthology.orchestra.run.smithi136.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-14T10:03:03.377 INFO:teuthology.orchestra.run.smithi040.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-14T10:03:03.749 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-14T10:03:03.756 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-14T10:03:03.768 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-14T10:03:03.784 INFO:teuthology.orchestra.run.smithi136.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-14T10:03:03.792 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-14T10:03:03.793 INFO:teuthology.orchestra.run.smithi040.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-14T10:03:03.828 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-14T10:03:03.830 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-04-14T10:03:03.830 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m0.776s 2024-04-14T10:03:03.831 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m3.141s 2024-04-14T10:03:03.831 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.137s 2024-04-14T10:03:03.836 INFO:teuthology.orchestra.run.smithi040.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-14T10:03:03.838 INFO:teuthology.orchestra.run.smithi040.stderr: 2024-04-14T10:03:03.838 INFO:teuthology.orchestra.run.smithi040.stderr:real 0m0.810s 2024-04-14T10:03:03.838 INFO:teuthology.orchestra.run.smithi040.stderr:user 0m3.144s 2024-04-14T10:03:03.838 INFO:teuthology.orchestra.run.smithi040.stderr:sys 0m0.254s 2024-04-14T10:03:03.839 INFO:tasks.ceph:Archiving logs... 2024-04-14T10:03:03.839 DEBUG:teuthology.misc:Transferring archived files from smithi040:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi040/log 2024-04-14T10:03:03.840 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T10:03:04.542 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi136/log 2024-04-14T10:03:04.542 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-14T10:03:05.031 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-14T10:03:05.044 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-14T10:03:05.044 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T10:03:05.047 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-14T10:03:05.129 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-14T10:03:05.139 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-14T10:03:05.140 DEBUG:teuthology.orchestra.run.smithi040:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:03:05.142 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-14T10:03:05.157 INFO:teuthology.orchestra.run.smithi040.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:03:05.158 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:=============================================================================== 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:^* hv01.front.sepia.ceph.com 3 6 377 16 +1120us[ +975us] +/- 44ms 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 17 -1301us[-1446us] +/- 49ms 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -125us[ -270us] +/- 62ms 2024-04-14T10:03:05.162 INFO:teuthology.orchestra.run.smithi040.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-04-14T10:03:05.163 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1097us[ +909us] +/- 44ms 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -1326us[-1513us] +/- 49ms 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 -153us[ -153us] +/- 62ms 2024-04-14T10:03:05.164 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-14T10:03:05.165 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-14T10:03:05.175 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-14T10:03:05.177 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-14T10:03:05.188 DEBUG:teuthology.orchestra.run.smithi040:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T10:03:05.287 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-14T10:03:05.359 DEBUG:teuthology.orchestra.run.smithi040:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:03:05.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:03:05.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-14T10:03:05.422 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:03:05.423 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-14T10:03:05.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-14T10:03:05.450 INFO:teuthology.task.internal:Duration was 757.965288 seconds 2024-04-14T10:03:05.451 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-14T10:03:05.461 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-14T10:03:05.461 DEBUG:teuthology.orchestra.run.smithi040:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T10:03:05.463 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-14T10:03:05.507 INFO:teuthology.orchestra.run.smithi040.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:03:05.507 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-14T10:03:05.845 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-14T10:03:05.845 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi040.front.sepia.ceph.com 2024-04-14T10:03:05.845 DEBUG:teuthology.orchestra.run.smithi040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T10:03:05.866 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-04-14T10:03:05.866 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-14T10:03:05.889 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-14T10:03:05.889 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T10:03:05.910 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-14T10:03:05.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-14T10:03:05.958 DEBUG:teuthology.orchestra.run.smithi040:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T10:03:05.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-14T10:03:06.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-14T10:03:06.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-14T10:03:06.108 DEBUG:teuthology.orchestra.run.smithi040:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T10:03:06.137 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-14T10:03:06.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-14T10:03:06.175 DEBUG:teuthology.orchestra.run.smithi040:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:03:06.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:03:06.203 INFO:teuthology.orchestra.run.smithi040.stdout:kernel.core_pattern = core 2024-04-14T10:03:06.231 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-04-14T10:03:06.247 DEBUG:teuthology.orchestra.run.smithi040:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:03:06.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:03:06.273 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-14T10:03:06.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-14T10:03:06.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-14T10:03:06.313 INFO:teuthology.task.internal:Transferring archived files... 2024-04-14T10:03:06.314 DEBUG:teuthology.misc:Transferring archived files from smithi040:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi040 2024-04-14T10:03:06.314 DEBUG:teuthology.orchestra.run.smithi040:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T10:03:06.349 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509/remote/smithi136 2024-04-14T10:03:06.349 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-14T10:03:06.387 INFO:teuthology.task.internal:Removing archive directory... 2024-04-14T10:03:06.387 DEBUG:teuthology.orchestra.run.smithi040:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T10:03:06.390 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-14T10:03:06.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-14T10:03:06.448 INFO:teuthology.task.internal:Not uploading archives. 2024-04-14T10:03:06.448 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-14T10:03:06.458 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-14T10:03:06.458 DEBUG:teuthology.orchestra.run.smithi040:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T10:03:06.461 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-14T10:03:06.472 INFO:teuthology.orchestra.run.smithi040.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 10:03 /home/ubuntu/cephtest 2024-04-14T10:03:06.490 INFO:teuthology.orchestra.run.smithi136.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 14 10:03 /home/ubuntu/cephtest 2024-04-14T10:03:06.492 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-14T10:03:06.503 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-14T10:03:06.537 INFO:teuthology.nuke:Checking targets against current locks 2024-04-14T10:03:06.563 DEBUG:teuthology.nuke:shortname: smithi040 2024-04-14T10:03:06.564 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:03:06.587 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi040.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:41:52.101174', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOzH7cJXkvjPgH0AvDFhJfPkIoJqQaDdZOD6OC0IFwm6yFotdZmjaUcPkUxG/fSqo05knPl+wIqZamAcCiQvA9g='} 2024-04-14T10:03:06.592 DEBUG:teuthology.nuke:shortname: smithi136 2024-04-14T10:03:06.593 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-14T10:03:06.618 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-03_20:24:15-fs-main-distro-default-smithi/7638509', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-14 09:41:52.099603', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCn5zvmtuuyG6cFSTvPJHmGvLNanQPKwdkeociGSt0ivzkIViLM/cBKcnE3qgeEXabU8rDzxsUaIVPP9e4sqiSM='} 2024-04-14T10:03:06.643 INFO:teuthology.orchestra.console.smithi040:Power off 2024-04-14T10:03:06.644 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T10:03:06.671 DEBUG:teuthology.orchestra.console.smithi040:power off output: Chassis Power Control: Down/Off 2024-04-14T10:03:06.671 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:06.689 INFO:teuthology.orchestra.console.smithi136:Power off 2024-04-14T10:03:06.689 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-14T10:03:06.702 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-14T10:03:06.714 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-04-14T10:03:06.714 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:06.740 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-14T10:03:10.704 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:10.742 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:10.818 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-14T10:03:10.853 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-04-14T10:03:14.822 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:14.854 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:14.933 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is on 2024-04-14T10:03:14.970 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-04-14T10:03:15.071 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-04-14T10:03:18.934 DEBUG:teuthology.orchestra.console.smithi040:pexpect command: ipmitool -H smithi040.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-14T10:03:19.045 DEBUG:teuthology.orchestra.console.smithi040:check power output: Chassis Power is off 2024-04-14T10:03:19.146 INFO:teuthology.orchestra.console.smithi040:Power off completed 2024-04-14T10:03:19.251 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/acls} duration: 757.96528840065 failure_reason: 'Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=dd0d1c3404634add85e647eca7c45f00 status: fail success: false 2024-04-14T10:03:19.251 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-14T10:03:19.329 INFO:teuthology.run:FAIL